-- Logs begin at Tue 2022-02-08 15:48:36 UTC, end at Tue 2022-02-08 17:04:21 UTC. -- Feb 08 16:28:04.485962 dv-cinder-827860-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 08 16:28:04.493828 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 08 16:28:04.499781 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Feb 8 16:28:04 2022] *** Feb 08 16:28:04.499781 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 08 16:28:04.499781 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 08 16:28:04.499781 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: nodename: dv-cinder-827860-2-iscsi Feb 08 16:28:04.499781 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: machine: x86_64 Feb 08 16:28:04.499781 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: clock source: unix Feb 08 16:28:04.499781 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: pcre jit disabled Feb 08 16:28:04.499781 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: detected number of CPU cores: 4 Feb 08 16:28:04.499781 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: current working directory: / Feb 08 16:28:04.499781 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: detected binary path: /usr/bin/uwsgi-core Feb 08 16:28:04.499781 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: your processes number limit is 47680 Feb 08 16:28:04.499781 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: your memory page size is 4096 bytes Feb 08 16:28:04.499781 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: detected max file descriptor number: 2048 Feb 08 16:28:04.499781 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: lock engine: pthread robust mutexes Feb 08 16:28:04.499781 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: thunder lock: enabled Feb 08 16:28:04.499781 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 08 16:28:04.499781 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 08 16:28:04.545038 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: Python main interpreter initialized at 0x55b21eaa69c0 Feb 08 16:28:04.545038 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: python threads support enabled Feb 08 16:28:04.545038 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: your server socket listen backlog is limited to 100 connections Feb 08 16:28:04.545038 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: your mercy for graceful operations on workers is 90 seconds Feb 08 16:28:04.545422 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: mapped 403077 bytes (393 KB) for 2 cores Feb 08 16:28:04.545498 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: *** Operational MODE: preforking *** Feb 08 16:28:04.545773 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: *** uWSGI is running in multiple interpreter mode *** Feb 08 16:28:04.545773 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: spawned uWSGI master process (pid: 79322) Feb 08 16:28:04.545980 dv-cinder-827860-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 08 16:28:04.547002 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: spawned uWSGI worker 1 (pid: 79339, cores: 1) Feb 08 16:28:04.547002 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: spawned uWSGI worker 2 (pid: 79340, cores: 1) Feb 08 16:28:04.547153 dv-cinder-827860-2-iscsi devstack@keystone.service[79322]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 08 16:28:10.372999 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 16:28:10.372999 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: from cryptography.utils import int_from_bytes Feb 08 16:28:10.373713 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 16:28:10.373713 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: from cryptography.utils import int_from_bytes Feb 08 16:28:10.374734 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 16:28:10.374734 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: from cryptography.utils import int_from_bytes Feb 08 16:28:10.375170 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 16:28:10.375170 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: from cryptography.utils import int_from_bytes Feb 08 16:28:10.419992 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 08 16:28:10.420175 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 08 16:28:10.420401 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] command line args: [] {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 08 16:28:10.420626 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 08 16:28:10.420799 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ================================================================================ {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 08 16:28:10.421048 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] admin_token = **** {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.421292 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] config_dir = [] {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.421477 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.421619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 08 16:28:10.421700 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] config_source = [] {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.421831 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 08 16:28:10.421917 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] debug = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.422046 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.424261 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] command line args: [] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 08 16:28:10.424261 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 08 16:28:10.424410 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.424475 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ================================================================================ {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 08 16:28:10.424533 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.424597 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] admin_token = **** {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.424655 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.424715 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] config_dir = [] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.424772 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.424927 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.425046 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] list_limit = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.425115 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] config_source = [] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.425181 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] log_config_append = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.425243 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] debug = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.425307 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.425369 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.425459 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] log_dir = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.425459 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] log_file = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.425569 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.425569 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.425678 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.425735 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.425800 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.425863 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.425924 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.425986 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] list_limit = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.426047 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.426047 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.426162 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] log_config_append = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.426218 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.426279 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.426336 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.426336 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.426446 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] log_dir = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.426526 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.426584 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] log_file = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.426640 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.426694 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.426749 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.426811 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.426874 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.426931 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.426985 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.427046 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.427110 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.427174 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.427174 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.427287 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.428017 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.428017 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.428430 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.35/identity {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.428430 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] publish_errors = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.428842 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.429043 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.429248 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.429450 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.429619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.429814 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.430008 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.430202 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.430430 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.430630 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.430830 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.431044 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] standard_threads = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.431044 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.431391 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.431619 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.431619 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.432101 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.35/identity {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.432302 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] use_journal = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.432510 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] publish_errors = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.432677 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] use_json = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.432677 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] use_stderr = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.433022 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.433185 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] use_syslog = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.433327 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.433504 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.433640 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.433812 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.434071 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.434226 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.434379 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.434379 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] standard_threads = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.434699 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.434830 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.434959 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.435094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.435240 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.435375 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.435513 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.435648 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] use_journal = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.435795 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.435930 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] use_json = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.435930 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] use_stderr = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.436196 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.436370 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] use_syslog = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.436511 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.436641 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:28:10.436775 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.436983 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.437120 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.437256 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.437386 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.437530 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.437660 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.437800 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.437930 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.438058 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.438191 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.438322 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.438461 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.438591 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.438720 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.438854 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.438983 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.439119 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.439270 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.439401 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.439529 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.439657 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.439822 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.439959 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.440100 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.440236 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.440365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.441022 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.441203 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.441335 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.441478 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.441610 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.441754 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.441754 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.442005 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.442134 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.442274 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.442403 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.442539 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.442668 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.442803 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.442931 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.443068 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.443197 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.443326 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.443463 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.443594 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.443722 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.444015 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.444238 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.444389 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.444521 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.444658 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.444789 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.444926 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.445057 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.445193 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.445325 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.445460 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.445600 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.445738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.445868 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.445996 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.446131 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.446266 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.446395 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.446395 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.446647 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.446776 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.446776 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.447018 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.447146 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.447292 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.447422 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.447550 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.447678 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.447827 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.447970 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.448101 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.448229 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.448365 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.448495 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.448630 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.448768 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.448898 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.449027 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.450320 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.450497 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.450697 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.450933 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.451104 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.451363 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.451570 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.451740 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.452067 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.452278 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.452446 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.452640 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.452833 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.453041 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.453235 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.453463 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.453633 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.453826 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.454060 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.454228 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.454421 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.454654 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.454863 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.455064 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.455272 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.455439 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.455604 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.455831 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.456003 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.456843 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.457035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.457171 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.457303 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.457441 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.457607 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.457751 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.457883 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.458013 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.458013 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.458268 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.458409 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.458551 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.458682 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.458812 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.458983 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.459120 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.459250 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.459389 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.459522 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.459651 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.459857 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.459995 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.460125 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.460276 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.460410 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.460546 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.460685 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.460815 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.460945 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.461151 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.461285 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.461422 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.461589 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.461751 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.461882 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.462020 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.462152 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.462299 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.462439 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.462570 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.462699 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.462837 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.462968 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.463097 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.463226 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.463354 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.463484 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.463622 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.463807 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.463946 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.464076 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.464216 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.464347 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.464493 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.464637 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.464769 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.464899 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.464899 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.465151 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.465151 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.465411 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.465411 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.465660 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.465660 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.465926 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.466058 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.466196 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.466328 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.466458 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.466458 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] auth.external = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.466703 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.466833 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.466975 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.466975 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.467222 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.467355 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.467485 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.467624 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.467817 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] auth.password = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.467957 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.468088 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] auth.token = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.468088 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.468334 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.468473 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.468616 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.468767 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.468975 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.469139 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.469300 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.469441 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.469575 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.469706 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.469856 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.469988 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.470119 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.470250 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] credential.caching = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.470381 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.470512 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.470653 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] auth.external = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.470786 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.470918 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.471048 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.471048 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.471296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.471437 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.471586 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.471744 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.471913 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] auth.password = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.472055 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.472188 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] auth.token = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.472188 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.472522 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.472655 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.472786 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.472920 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.473060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.473194 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.473325 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.473457 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.473606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.473740 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.473879 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.474013 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.474145 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.474284 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] credential.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.474416 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.474548 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.474687 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] federation.caching = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.474819 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.474958 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.475098 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.475235 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.475376 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.475521 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.475656 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.475816 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.475955 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.476088 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.476229 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.476375 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.476508 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.476639 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.476639 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.476886 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.477016 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.477224 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.477373 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.477505 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.477636 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.477768 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.477898 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] identity.caching = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.478037 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.478172 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.478309 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.478442 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.478573 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.478703 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.478845 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] federation.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.478977 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.479124 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.479257 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.479388 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.479520 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.479662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.479849 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.479995 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.480128 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.480260 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.480392 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.480531 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.480670 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.480802 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.480939 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.481080 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.481212 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.481354 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.481488 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.481619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.481750 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.481880 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.482011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.482150 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.482282 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.482414 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.482545 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.482676 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.482676 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.482952 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.483092 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.483223 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.483223 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.483472 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.483631 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.483807 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.483947 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.484079 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.484210 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.484342 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.484486 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.484619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.484766 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.484898 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.485036 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.485172 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.485311 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.485444 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.485575 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.485705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.485705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.485705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.486079 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.486211 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.486348 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.486489 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.486622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.486753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.486893 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.487025 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.487156 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.487287 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.487478 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.487650 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.487886 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.488025 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.488157 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.488289 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.488421 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.488566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.488708 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.488841 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.488973 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.489104 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.489234 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.489365 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.489505 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.489638 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.489770 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.489908 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.490041 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.490173 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.490312 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.490454 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.490586 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.490718 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.490850 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.490990 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.491131 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.491270 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.491402 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.491533 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.491665 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.491838 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.491991 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.492124 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.492266 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.user = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.492399 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.492530 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.492662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.492805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.492939 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.493070 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.493201 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.493332 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.493463 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.493602 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.493734 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.493866 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.493998 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.494138 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.494269 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.494426 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.494619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.494784 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.494919 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.495061 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.495194 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.495334 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.495467 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.495599 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.495730 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.495885 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.496028 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.496179 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.496312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.496443 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.496443 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.496690 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.496821 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.496961 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.497094 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.497226 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.497356 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.497356 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.497603 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.497743 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.497884 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.498016 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.498147 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.498285 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.498417 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.498555 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.498555 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.498804 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.498935 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.499065 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.499205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.499337 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.499467 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.499597 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.499737 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.499737 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.500118 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.500271 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.500406 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.500538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.500538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.500785 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.500924 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.501056 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.501186 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.501186 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.501436 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.501567 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] resource.caching = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.501715 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.501848 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.501978 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.502109 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.502239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.502370 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.502508 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.502646 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.502778 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.502909 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.503562 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.503694 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.503929 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.504076 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.504076 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.504325 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.504457 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.504588 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.504727 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] role.caching = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.504727 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] role.driver = sql {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.504983 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.505119 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.505250 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.505381 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.505525 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.505659 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.505790 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.505931 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.506069 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.506253 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.506399 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.506534 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.506679 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.506817 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.506947 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.506947 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.507203 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.507335 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.507466 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.507597 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] resource.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.507739 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.507739 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.508061 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.508194 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.508325 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.508455 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.508588 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.508719 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.508859 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.508859 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.509107 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.509238 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.509368 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.509499 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.509649 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.509783 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.509920 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.510053 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.510183 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.510313 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] role.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.510518 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.510668 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] role.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.510801 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.510932 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.511063 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.511193 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.511331 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.511472 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.511603 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.511735 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.511893 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.512037 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.512171 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.512302 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.512433 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.512433 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.512682 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.512822 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.512955 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.513086 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.513216 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.513360 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.513491 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.513630 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.513762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.513895 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.514031 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.514170 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] token.caching = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.514308 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.514454 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.514597 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.514735 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.514735 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.515008 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.515157 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.515305 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.515444 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.515582 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.515720 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.515869 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.515968 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.516067 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.516147 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.516222 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.516295 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.516368 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.516436 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.516516 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.516590 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.516660 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.516735 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.516805 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.516875 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.516954 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.517027 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.517099 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.517170 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.517240 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.517311 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.517389 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.517462 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.517532 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.517602 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] database.connection = **** {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.517685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.517763 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.517824 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.517903 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.517976 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.518047 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.518117 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.518187 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.518513 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] token.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.518686 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.519308 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.519386 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.519489 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.519564 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.519636 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.519717 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.519807 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.519881 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.519964 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.520038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.520110 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.520189 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.520189 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.520320 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.520390 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.520390 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.520507 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.520584 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.520657 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.520727 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.520797 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.520867 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.520936 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.521014 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.521087 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.521157 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 08 16:28:10.521227 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.521227 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.521227 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.521227 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.521227 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.521227 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.connection = **** {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.521227 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.521227 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.521227 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.521788 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.521788 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.521788 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.521788 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.521788 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.521788 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.521788 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.521788 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.521788 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.522385 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.522385 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.522385 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.522385 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.522385 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.522385 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:28:10.522385 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 08 16:28:10.539041 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.539291 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.539494 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.542930 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.543163 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.543408 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.548086 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.552194 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.577293 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.577516 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.579029 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.579257 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.631927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.632243 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.684223 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.684514 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.684704 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.684941 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.749740 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.749981 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.750183 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.750398 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.750611 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.750697 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.750843 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.750930 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.751229 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.751509 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.751811 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.752090 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.775845 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.776025 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.776094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.776235 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.776393 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.776480 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.776657 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.776742 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.776867 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.777072 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.777157 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.777273 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.777356 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.777642 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.789340 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.789723 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.802768 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.802909 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.802978 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.803041 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.803209 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.803450 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.803591 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.803656 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.803717 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.803891 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.803964 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.804025 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79340) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.804261 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.804542 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 08 16:28:10.821254 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.821453 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 08 16:28:10.821715 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.821844 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.821966 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 08 16:28:10.822087 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 08 16:28:10.822220 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.822452 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.822577 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.822698 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.822856 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 08 16:28:10.822983 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.823239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.823560 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.824025 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.824361 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.834157 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.834385 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.834644 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.834927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.836044 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.836383 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.836716 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.837061 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.842779 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.845301 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.845978 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.846259 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.846540 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.847369 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.847652 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.848106 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.848486 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.848763 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.849032 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.849308 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.849577 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.849951 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.850289 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.850630 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.850984 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.851324 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.851647 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.852111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.852449 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.852784 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.853129 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.853457 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.875196 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.877181 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.877459 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.879485 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.881274 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.881623 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.882595 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.882873 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.883148 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.886981 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.887327 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.887669 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.890189 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.890470 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.895693 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.895850 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.896117 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.896256 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.896404 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.896687 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.896959 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.897229 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.897493 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.897754 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.900954 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.901441 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.901790 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.902138 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.902477 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.902817 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.903150 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.903479 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.916430 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.916706 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.921292 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.922421 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.922764 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.924891 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.925184 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.927616 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.930128 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.931292 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.931657 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.933620 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.936680 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.937293 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.937587 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.937866 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.938147 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.938423 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.938712 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.940625 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.944377 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.944740 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.945090 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.945451 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.945795 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.946149 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.958231 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.958522 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.958787 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.959049 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.965570 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.965925 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.966254 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.966596 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.966721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.968365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.968647 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.971569 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.974107 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.974107 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.974107 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.974107 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.975613 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.977365 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.977724 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.980743 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.981088 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.981430 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.981783 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.982148 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.986625 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.986903 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.987179 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.988069 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.988359 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.988630 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.988903 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.996152 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:10.996503 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.996852 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.997198 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.997559 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.997897 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:10.998237 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.007018 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:11.010198 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:11.013403 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.014955 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.016563 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:11.016841 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.017123 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:11.017252 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.020960 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:11.024434 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.026120 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.026315 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.027920 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:11.028060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:11.028200 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.028605 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.031155 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.031450 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.031730 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.032039 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.037865 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.039548 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:11.040966 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:11.041263 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.043093 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.043220 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.043567 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.043915 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.053676 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:11.054080 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.141882 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.150128 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79340) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:11.150415 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.150697 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.150970 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.151237 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.151505 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.151817 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.152093 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.152359 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.152641 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.152909 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.153164 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.153431 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.153844 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79340) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.154804 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.163422 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 08 16:28:11.163791 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.164144 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.164486 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.164819 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.165168 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.165511 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.165839 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.166172 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.166544 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.166877 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.167210 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.167546 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.168053 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 08 16:28:11.192289 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b21eaa69c0 pid: 79340 (default app) Feb 08 16:28:11.195662 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc6ab6-8a14-4d34-95b8-b4a8572d3ce6 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:11.195974 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc6ab6-8a14-4d34-95b8-b4a8572d3ce6 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:11.196250 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc6ab6-8a14-4d34-95b8-b4a8572d3ce6 None None] PATH_INFO: `/v3` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:11.202134 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1/1] 10.222.0.35 () {50 vars in 791 bytes} [Tue Feb 8 16:28:11 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:11.206599 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b21eaa69c0 pid: 79339 (default app) Feb 08 16:28:19.430336 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bfccb-cb88-4bf2-8b12-5a84ac4e8eb9 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:19.430905 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bfccb-cb88-4bf2-8b12-5a84ac4e8eb9 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:19.430905 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bfccb-cb88-4bf2-8b12-5a84ac4e8eb9 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:19.432988 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 2/2] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:28:19.441369 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d15f4-9c0c-46f2-b557-2a0ec34da73c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:19.441766 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d15f4-9c0c-46f2-b557-2a0ec34da73c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:19.441917 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d15f4-9c0c-46f2-b557-2a0ec34da73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:19.471702 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG oslo_db.sqlalchemy.engines [None req-261d15f4-9c0c-46f2-b557-2a0ec34da73c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 16:28:19.657238 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG passlib.handlers.bcrypt [None req-261d15f4-9c0c-46f2-b557-2a0ec34da73c None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79339) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 08 16:28:19.657578 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG passlib.handlers.bcrypt [None req-261d15f4-9c0c-46f2-b557-2a0ec34da73c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79339) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 08 16:28:19.712953 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-261d15f4-9c0c-46f2-b557-2a0ec34da73c None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:19.714527 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-261d15f4-9c0c-46f2-b557-2a0ec34da73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:19.837312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1/3] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:28:19.956037 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bfccb-cb88-4bf2-8b12-5a84ac4e8eb9 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:19.990055 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG oslo_db.sqlalchemy.engines [None req-110bfccb-cb88-4bf2-8b12-5a84ac4e8eb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 16:28:20.116723 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bfccb-cb88-4bf2-8b12-5a84ac4e8eb9 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:20.121053 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea75801-03db-4454-8f6a-aeffcadd0907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:20.121705 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea75801-03db-4454-8f6a-aeffcadd0907 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:20.121987 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea75801-03db-4454-8f6a-aeffcadd0907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:20.122263 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea75801-03db-4454-8f6a-aeffcadd0907 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:20.131180 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea75801-03db-4454-8f6a-aeffcadd0907 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:20.182779 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3ea75801-03db-4454-8f6a-aeffcadd0907 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 08 16:28:20.183114 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea75801-03db-4454-8f6a-aeffcadd0907 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:20.193237 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 3/4] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:28:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 08 16:28:20.199213 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d15f4-9c0c-46f2-b557-2a0ec34da73c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:20.213484 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d15f4-9c0c-46f2-b557-2a0ec34da73c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:20.218000 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693e29d-1a8c-4ada-a011-779bf76d9429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:20.219088 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693e29d-1a8c-4ada-a011-779bf76d9429 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:20.219372 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693e29d-1a8c-4ada-a011-779bf76d9429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:20.219649 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693e29d-1a8c-4ada-a011-779bf76d9429 admin admin] PATH_INFO: `/v3/projects/2b5e4fc6dd694372b7f8775a6f881cca` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:20.221832 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693e29d-1a8c-4ada-a011-779bf76d9429 admin admin] RBAC: Authorizing `identity:get_project(project_id=2b5e4fc6dd694372b7f8775a6f881cca)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:20.274708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6693e29d-1a8c-4ada-a011-779bf76d9429 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 08 16:28:20.275038 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693e29d-1a8c-4ada-a011-779bf76d9429 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:20.279695 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 2/5] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:20 2022] GET /identity/v3/projects/2b5e4fc6dd694372b7f8775a6f881cca => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:22.496321 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d673e8e-eae8-45b6-990d-9e57d2e64548 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:22.496863 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d673e8e-eae8-45b6-990d-9e57d2e64548 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:22.496863 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d673e8e-eae8-45b6-990d-9e57d2e64548 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:22.501341 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 4/6] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:22.507618 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a869101-0176-4d28-aa0d-466474febb66 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:22.508091 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a869101-0176-4d28-aa0d-466474febb66 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:22.508218 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a869101-0176-4d28-aa0d-466474febb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:22.527673 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-9a869101-0176-4d28-aa0d-466474febb66 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:22.529239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9a869101-0176-4d28-aa0d-466474febb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:22.537371 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 3/7] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:22.560001 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d673e8e-eae8-45b6-990d-9e57d2e64548 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:22.572649 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d673e8e-eae8-45b6-990d-9e57d2e64548 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:22.576874 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a9667-5843-4f56-ae1b-dfe174f7f505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:22.577494 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a9667-5843-4f56-ae1b-dfe174f7f505 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:22.577777 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a9667-5843-4f56-ae1b-dfe174f7f505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:22.578051 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a9667-5843-4f56-ae1b-dfe174f7f505 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:22.586429 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a9667-5843-4f56-ae1b-dfe174f7f505 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:22.588308 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a9667-5843-4f56-ae1b-dfe174f7f505 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:22.597293 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 5/8] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:28:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:28:22.602504 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a869101-0176-4d28-aa0d-466474febb66 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:22.611249 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a869101-0176-4d28-aa0d-466474febb66 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:22.615696 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c92402-34b9-40df-80df-39d437c446ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:22.616581 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c92402-34b9-40df-80df-39d437c446ba admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:22.616862 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c92402-34b9-40df-80df-39d437c446ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:22.617135 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c92402-34b9-40df-80df-39d437c446ba admin admin] PATH_INFO: `/v3/users/3e3abf5e1906480a9a6c24bfbb2057a5` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:22.618519 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c92402-34b9-40df-80df-39d437c446ba admin admin] RBAC: Authorizing `identity:get_user(user_id=3e3abf5e1906480a9a6c24bfbb2057a5)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:22.620355 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c92402-34b9-40df-80df-39d437c446ba admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:22.621891 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 4/9] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:22 2022] GET /identity/v3/users/3e3abf5e1906480a9a6c24bfbb2057a5 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:24.944369 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a74236-efa4-437d-8a00-025534953130 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:24.944909 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a74236-efa4-437d-8a00-025534953130 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:24.944909 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a74236-efa4-437d-8a00-025534953130 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:24.946645 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 6/10] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:24.951878 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa75157-3e1a-4ff2-b0ad-48ef1110e45f None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:24.952296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa75157-3e1a-4ff2-b0ad-48ef1110e45f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:24.952570 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa75157-3e1a-4ff2-b0ad-48ef1110e45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:24.970874 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-efa75157-3e1a-4ff2-b0ad-48ef1110e45f None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:24.972830 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-efa75157-3e1a-4ff2-b0ad-48ef1110e45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:24.977406 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4eeaa-7020-4e31-99d5-ca0a2b691a56 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:24.977694 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4eeaa-7020-4e31-99d5-ca0a2b691a56 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:24.977971 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4eeaa-7020-4e31-99d5-ca0a2b691a56 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:24.979699 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 7/11] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:24.980771 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 5/12] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:24.985065 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e854528-1bc1-481b-8e41-d17b490ac9ea None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:24.985065 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e854528-1bc1-481b-8e41-d17b490ac9ea None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:24.985335 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e854528-1bc1-481b-8e41-d17b490ac9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:25.004494 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa75157-3e1a-4ff2-b0ad-48ef1110e45f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:25.013440 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa75157-3e1a-4ff2-b0ad-48ef1110e45f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:25.017866 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d768da-8610-4e9a-816e-d8df165eadf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:25.018908 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d768da-8610-4e9a-816e-d8df165eadf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:25.019186 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d768da-8610-4e9a-816e-d8df165eadf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:25.019455 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d768da-8610-4e9a-816e-d8df165eadf2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:25.027574 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG passlib.handlers.bcrypt [None req-3e854528-1bc1-481b-8e41-d17b490ac9ea None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79340) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 08 16:28:25.028029 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG passlib.handlers.bcrypt [None req-3e854528-1bc1-481b-8e41-d17b490ac9ea None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79340) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 08 16:28:25.032515 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d768da-8610-4e9a-816e-d8df165eadf2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:25.039880 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-87d768da-8610-4e9a-816e-d8df165eadf2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:28:25.041071 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 6/13] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:28:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:28:25.046753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d768da-8610-4e9a-816e-d8df165eadf2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:25.056828 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d768da-8610-4e9a-816e-d8df165eadf2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:25.061269 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7194a4-2679-412e-bd11-7fac2e6694d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:25.062143 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7194a4-2679-412e-bd11-7fac2e6694d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:25.062422 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7194a4-2679-412e-bd11-7fac2e6694d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:25.062695 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7194a4-2679-412e-bd11-7fac2e6694d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:25.063435 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7194a4-2679-412e-bd11-7fac2e6694d6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:25.063738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7194a4-2679-412e-bd11-7fac2e6694d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:25.065591 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-ce7194a4-2679-412e-bd11-7fac2e6694d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:28:25.065591 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Feb 08 16:28:25.065591 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: Feb 08 16:28:25.066475 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7194a4-2679-412e-bd11-7fac2e6694d6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:25.075702 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-3e854528-1bc1-481b-8e41-d17b490ac9ea None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:25.077339 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-3e854528-1bc1-481b-8e41-d17b490ac9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:25.078930 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 7/14] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:25.085858 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7194a4-2679-412e-bd11-7fac2e6694d6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:25.095102 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7194a4-2679-412e-bd11-7fac2e6694d6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:25.099989 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f8b52-4013-4a39-b77a-784a2e135697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:25.100809 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f8b52-4013-4a39-b77a-784a2e135697 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:25.100918 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 8/15] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:25.101090 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f8b52-4013-4a39-b77a-784a2e135697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:25.101359 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f8b52-4013-4a39-b77a-784a2e135697 admin admin] PATH_INFO: `/v3/users/3e3abf5e1906480a9a6c24bfbb2057a5` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:25.102567 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f8b52-4013-4a39-b77a-784a2e135697 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e3abf5e1906480a9a6c24bfbb2057a5)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:25.104406 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f8b52-4013-4a39-b77a-784a2e135697 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:25.105961 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 8/16] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:25 2022] GET /identity/v3/users/3e3abf5e1906480a9a6c24bfbb2057a5 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:25.111099 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e854528-1bc1-481b-8e41-d17b490ac9ea None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:25.120598 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e854528-1bc1-481b-8e41-d17b490ac9ea None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:25.122872 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f8b52-4013-4a39-b77a-784a2e135697 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:25.125368 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23786678-3668-472d-9857-95eb2f0344f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:25.126464 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23786678-3668-472d-9857-95eb2f0344f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:25.126747 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23786678-3668-472d-9857-95eb2f0344f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:25.127023 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23786678-3668-472d-9857-95eb2f0344f7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:25.128594 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23786678-3668-472d-9857-95eb2f0344f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:25.130340 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23786678-3668-472d-9857-95eb2f0344f7 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:25.131941 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 9/17] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:28:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:25.132644 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f8b52-4013-4a39-b77a-784a2e135697 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:25.137058 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb1dcc-34ba-472c-8617-f36b35455228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:25.137191 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23786678-3668-472d-9857-95eb2f0344f7 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:25.137673 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb1dcc-34ba-472c-8617-f36b35455228 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:25.137957 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb1dcc-34ba-472c-8617-f36b35455228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:25.138234 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb1dcc-34ba-472c-8617-f36b35455228 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:25.146814 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb1dcc-34ba-472c-8617-f36b35455228 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:25.147021 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23786678-3668-472d-9857-95eb2f0344f7 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:25.148605 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb1dcc-34ba-472c-8617-f36b35455228 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:25.151342 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973725a-bcf7-441f-99d7-cf30c1e74b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:25.151976 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973725a-bcf7-441f-99d7-cf30c1e74b3d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:25.152253 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973725a-bcf7-441f-99d7-cf30c1e74b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:25.152528 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973725a-bcf7-441f-99d7-cf30c1e74b3d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:25.153345 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973725a-bcf7-441f-99d7-cf30c1e74b3d admin admin] RBAC: Adding query filter params (role.id=e6d18df5c4e74dfd8ebd9c636f45936e, scope.domain.id=default, user.id=3e3abf5e1906480a9a6c24bfbb2057a5) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:25.153647 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973725a-bcf7-441f-99d7-cf30c1e74b3d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:25.155317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING py.warnings [None req-3973725a-bcf7-441f-99d7-cf30c1e74b3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:28:25.155317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: warnings.warn(msg) Feb 08 16:28:25.155317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: Feb 08 16:28:25.156474 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973725a-bcf7-441f-99d7-cf30c1e74b3d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:25.157400 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 9/18] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:28:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 08 16:28:25.163369 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb1dcc-34ba-472c-8617-f36b35455228 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:25.165985 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 10/19] 10.222.0.35 () {56 vars in 1343 bytes} [Tue Feb 8 16:28:25 2022] GET /identity/v3/role_assignments?user.id=3e3abf5e1906480a9a6c24bfbb2057a5&scope.domain.id=default&role.id=e6d18df5c4e74dfd8ebd9c636f45936e => generated 233 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:25.171888 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb1dcc-34ba-472c-8617-f36b35455228 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:25.176697 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b34f8-6b3b-4cb2-a919-bd832db71a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:25.177487 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b34f8-6b3b-4cb2-a919-bd832db71a93 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:25.177764 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b34f8-6b3b-4cb2-a919-bd832db71a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:25.178031 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b34f8-6b3b-4cb2-a919-bd832db71a93 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:25.179252 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b34f8-6b3b-4cb2-a919-bd832db71a93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:25.181037 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b34f8-6b3b-4cb2-a919-bd832db71a93 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:25.182708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 10/20] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:28:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:27.583415 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a70f47-d0d6-49f3-9426-e8ad9e5e8b9a None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:27.584540 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a70f47-d0d6-49f3-9426-e8ad9e5e8b9a None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:27.585059 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a70f47-d0d6-49f3-9426-e8ad9e5e8b9a None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:27.587509 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 11/21] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:27.598307 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61fd0d-4e2c-4d28-92fa-3e44ba96bd8d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:27.598811 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61fd0d-4e2c-4d28-92fa-3e44ba96bd8d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:27.598883 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61fd0d-4e2c-4d28-92fa-3e44ba96bd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:27.629005 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-4b61fd0d-4e2c-4d28-92fa-3e44ba96bd8d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:27.630223 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4b61fd0d-4e2c-4d28-92fa-3e44ba96bd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:27.638448 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 11/22] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:27.669715 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a70f47-d0d6-49f3-9426-e8ad9e5e8b9a None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:27.686089 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a70f47-d0d6-49f3-9426-e8ad9e5e8b9a None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:27.690963 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c6751-9717-40ed-99ca-93d5bc392750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:27.691774 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c6751-9717-40ed-99ca-93d5bc392750 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:27.692057 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c6751-9717-40ed-99ca-93d5bc392750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:27.692331 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c6751-9717-40ed-99ca-93d5bc392750 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:27.712632 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c6751-9717-40ed-99ca-93d5bc392750 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:27.724267 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-ea1c6751-9717-40ed-99ca-93d5bc392750 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:28:27.725548 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 12/23] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:28:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:27.731251 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61fd0d-4e2c-4d28-92fa-3e44ba96bd8d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:27.745070 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61fd0d-4e2c-4d28-92fa-3e44ba96bd8d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:27.756799 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b33e8-8948-4f20-9245-73468c50632a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:27.757474 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b33e8-8948-4f20-9245-73468c50632a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:27.757753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b33e8-8948-4f20-9245-73468c50632a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:27.758021 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b33e8-8948-4f20-9245-73468c50632a admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:27.758967 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b33e8-8948-4f20-9245-73468c50632a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:27.759272 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b33e8-8948-4f20-9245-73468c50632a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:27.760909 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b33e8-8948-4f20-9245-73468c50632a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:27.784328 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 12/24] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:27.790613 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c6751-9717-40ed-99ca-93d5bc392750 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:27.806606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c6751-9717-40ed-99ca-93d5bc392750 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:27.817831 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44699c8-8acd-4fd1-bc3c-704fb1d8cbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:27.818716 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44699c8-8acd-4fd1-bc3c-704fb1d8cbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:27.818991 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44699c8-8acd-4fd1-bc3c-704fb1d8cbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:27.819261 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44699c8-8acd-4fd1-bc3c-704fb1d8cbf1 admin admin] PATH_INFO: `/v3/users/3e3abf5e1906480a9a6c24bfbb2057a5` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:27.820821 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44699c8-8acd-4fd1-bc3c-704fb1d8cbf1 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e3abf5e1906480a9a6c24bfbb2057a5)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:27.822664 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44699c8-8acd-4fd1-bc3c-704fb1d8cbf1 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:27.824606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 13/25] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:27 2022] GET /identity/v3/users/3e3abf5e1906480a9a6c24bfbb2057a5 => generated 247 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:27.829843 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b33e8-8948-4f20-9245-73468c50632a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:27.845867 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b33e8-8948-4f20-9245-73468c50632a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:27.853740 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026a45b-5ee6-40df-8bb0-361d0f2232c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:27.854792 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026a45b-5ee6-40df-8bb0-361d0f2232c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:27.855275 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026a45b-5ee6-40df-8bb0-361d0f2232c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:27.855738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026a45b-5ee6-40df-8bb0-361d0f2232c5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:27.859469 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026a45b-5ee6-40df-8bb0-361d0f2232c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:27.861433 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026a45b-5ee6-40df-8bb0-361d0f2232c5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:27.863536 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 13/26] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:28:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:27.869407 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44699c8-8acd-4fd1-bc3c-704fb1d8cbf1 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:27.888343 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44699c8-8acd-4fd1-bc3c-704fb1d8cbf1 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:27.894230 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea7672-f6e6-4841-b928-270d123bd010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:27.895245 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea7672-f6e6-4841-b928-270d123bd010 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:27.895534 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea7672-f6e6-4841-b928-270d123bd010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:27.895852 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea7672-f6e6-4841-b928-270d123bd010 admin admin] PATH_INFO: `/v3/domains/default/users/3e3abf5e1906480a9a6c24bfbb2057a5/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:27.897964 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea7672-f6e6-4841-b928-270d123bd010 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3e3abf5e1906480a9a6c24bfbb2057a5, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:27.899039 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING py.warnings [None req-49ea7672-f6e6-4841-b928-270d123bd010 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:28:27.899039 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: warnings.warn(msg) Feb 08 16:28:27.899039 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: Feb 08 16:28:27.901046 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea7672-f6e6-4841-b928-270d123bd010 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:28.053617 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 14/27] 10.222.0.35 () {58 vars in 1382 bytes} [Tue Feb 8 16:28:27 2022] PUT /identity/v3/domains/default/users/3e3abf5e1906480a9a6c24bfbb2057a5/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:28:28.112721 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed7848-343f-4469-a4e0-fd3d1b0e0305 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:28.113556 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed7848-343f-4469-a4e0-fd3d1b0e0305 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:28.114398 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed7848-343f-4469-a4e0-fd3d1b0e0305 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:28.119289 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 14/28] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:28.137283 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cb4c3-90c8-4bf9-9f6c-8d1865479117 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:28.137617 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cb4c3-90c8-4bf9-9f6c-8d1865479117 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:28.137857 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cb4c3-90c8-4bf9-9f6c-8d1865479117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:28.162743 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-e57cb4c3-90c8-4bf9-9f6c-8d1865479117 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:28.164386 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-e57cb4c3-90c8-4bf9-9f6c-8d1865479117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:28.180934 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b77a76-37c9-4b3f-a1cf-67006cb1fb0a None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:28.181274 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b77a76-37c9-4b3f-a1cf-67006cb1fb0a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:28.181489 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b77a76-37c9-4b3f-a1cf-67006cb1fb0a None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:28.183300 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 15/29] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:28.188875 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032431f-a6b7-49aa-b199-da32752242b3 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:28.189154 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032431f-a6b7-49aa-b199-da32752242b3 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:28.189430 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032431f-a6b7-49aa-b199-da32752242b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:28.219008 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2032431f-a6b7-49aa-b199-da32752242b3 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:28.220272 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2032431f-a6b7-49aa-b199-da32752242b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:28.310499 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 15/30] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:28.336201 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 16/31] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:28:28.340134 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cb4c3-90c8-4bf9-9f6c-8d1865479117 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:28.350988 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cb4c3-90c8-4bf9-9f6c-8d1865479117 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:28.361454 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f08b23-07ef-4336-9dc8-cf0e1009adde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:28.362298 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f08b23-07ef-4336-9dc8-cf0e1009adde admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:28.362589 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f08b23-07ef-4336-9dc8-cf0e1009adde admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:28.362924 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f08b23-07ef-4336-9dc8-cf0e1009adde admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:28.363786 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f08b23-07ef-4336-9dc8-cf0e1009adde admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:28.365089 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING py.warnings [None req-84f08b23-07ef-4336-9dc8-cf0e1009adde admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:28:28.365089 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: warnings.warn(msg) Feb 08 16:28:28.365089 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: Feb 08 16:28:28.366006 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f08b23-07ef-4336-9dc8-cf0e1009adde admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:28.376900 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032431f-a6b7-49aa-b199-da32752242b3 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:28.390468 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032431f-a6b7-49aa-b199-da32752242b3 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:28.411015 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853e25b-d1f2-4b3a-b52a-5f5a19a640f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:28.411856 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853e25b-d1f2-4b3a-b52a-5f5a19a640f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:28.413830 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 16/32] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:28:28 2022] POST /identity/v3/roles => generated 219 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:28:28.413949 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853e25b-d1f2-4b3a-b52a-5f5a19a640f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:28.414217 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853e25b-d1f2-4b3a-b52a-5f5a19a640f2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:28.430440 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853e25b-d1f2-4b3a-b52a-5f5a19a640f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:28.432466 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853e25b-d1f2-4b3a-b52a-5f5a19a640f2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:28.458728 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-9853e25b-d1f2-4b3a-b52a-5f5a19a640f2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:28:28.460254 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 17/33] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:28.466217 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f08b23-07ef-4336-9dc8-cf0e1009adde admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:28.477381 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f08b23-07ef-4336-9dc8-cf0e1009adde admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:28.487504 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe6d1a-9289-42b4-9afa-e552d0a23054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:28.488342 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe6d1a-9289-42b4-9afa-e552d0a23054 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:28.488630 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe6d1a-9289-42b4-9afa-e552d0a23054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:28.488909 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe6d1a-9289-42b4-9afa-e552d0a23054 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:28.489686 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe6d1a-9289-42b4-9afa-e552d0a23054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:28.489996 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe6d1a-9289-42b4-9afa-e552d0a23054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:28.491043 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING py.warnings [None req-dffe6d1a-9289-42b4-9afa-e552d0a23054 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:28:28.491043 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: warnings.warn(msg) Feb 08 16:28:28.491043 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: Feb 08 16:28:28.492025 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe6d1a-9289-42b4-9afa-e552d0a23054 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:28.517610 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 17/34] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:28.524473 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853e25b-d1f2-4b3a-b52a-5f5a19a640f2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:28.537545 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853e25b-d1f2-4b3a-b52a-5f5a19a640f2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:28.543069 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fac85-2a73-4979-a74a-6f0194dbfbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:28.543733 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fac85-2a73-4979-a74a-6f0194dbfbdf admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:28.544040 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fac85-2a73-4979-a74a-6f0194dbfbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:28.544318 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fac85-2a73-4979-a74a-6f0194dbfbdf admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:28.545597 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04fac85-2a73-4979-a74a-6f0194dbfbdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:28.546101 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-c04fac85-2a73-4979-a74a-6f0194dbfbdf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:28:28.546101 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Feb 08 16:28:28.546101 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: Feb 08 16:28:28.547343 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04fac85-2a73-4979-a74a-6f0194dbfbdf admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:28.701392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 18/35] 10.222.0.35 () {60 vars in 1162 bytes} [Tue Feb 8 16:28:28 2022] POST /identity/v3/projects => generated 301 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:28:28.913940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb573aa-8245-4179-8b02-8e8ef54372ef None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:28.914476 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb573aa-8245-4179-8b02-8e8ef54372ef None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:28.914476 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb573aa-8245-4179-8b02-8e8ef54372ef None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:28.916686 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 18/36] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:28.922731 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc1238-b806-4879-8c9a-76b5161a9a2b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:28.923272 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc1238-b806-4879-8c9a-76b5161a9a2b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:28.923723 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc1238-b806-4879-8c9a-76b5161a9a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:28.953079 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-b7cc1238-b806-4879-8c9a-76b5161a9a2b None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:28.954973 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b7cc1238-b806-4879-8c9a-76b5161a9a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:29.024544 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 19/37] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:29.050712 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb573aa-8245-4179-8b02-8e8ef54372ef None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:29.070070 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb573aa-8245-4179-8b02-8e8ef54372ef None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:29.079477 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e8ee8-0309-4f05-978f-4d7fd22387fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:29.080189 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e8ee8-0309-4f05-978f-4d7fd22387fc admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:29.080705 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e8ee8-0309-4f05-978f-4d7fd22387fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:29.081178 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e8ee8-0309-4f05-978f-4d7fd22387fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:29.082064 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e8ee8-0309-4f05-978f-4d7fd22387fc admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:29.083709 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e8ee8-0309-4f05-978f-4d7fd22387fc admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:29.107365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 19/38] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:28:29 2022] POST /identity/v3/roles => generated 225 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:28:29.580957 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55e4d3-d446-44e1-95e8-d7d7f5b8a3ec None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:29.581146 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55e4d3-d446-44e1-95e8-d7d7f5b8a3ec None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:29.581434 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55e4d3-d446-44e1-95e8-d7d7f5b8a3ec None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:29.583231 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 20/39] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:29.588535 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24a517-0423-4e33-9c18-f0f71fe25e9d None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:29.588833 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24a517-0423-4e33-9c18-f0f71fe25e9d None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:29.589119 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24a517-0423-4e33-9c18-f0f71fe25e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:29.605659 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9138c-4ec3-4687-822c-7f5020045c83 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:29.605939 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9138c-4ec3-4687-822c-7f5020045c83 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:29.606344 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9138c-4ec3-4687-822c-7f5020045c83 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:29.607040 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-5e24a517-0423-4e33-9c18-f0f71fe25e9d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:29.608321 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 21/40] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:28:29.608420 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5e24a517-0423-4e33-9c18-f0f71fe25e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:29.613774 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0869efd-9a16-4a0b-8e1f-73ba3d15dc9d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:29.614064 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0869efd-9a16-4a0b-8e1f-73ba3d15dc9d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:29.614348 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0869efd-9a16-4a0b-8e1f-73ba3d15dc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:29.618213 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 20/41] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:29.632345 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-b0869efd-9a16-4a0b-8e1f-73ba3d15dc9d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:29.633541 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b0869efd-9a16-4a0b-8e1f-73ba3d15dc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:29.641231 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 22/42] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:28:29.641841 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24a517-0423-4e33-9c18-f0f71fe25e9d None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:29.651059 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24a517-0423-4e33-9c18-f0f71fe25e9d None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:29.655501 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd728c-0a76-477d-804a-b13c9cc03c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:29.656417 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd728c-0a76-477d-804a-b13c9cc03c96 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:29.656701 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd728c-0a76-477d-804a-b13c9cc03c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:29.656974 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd728c-0a76-477d-804a-b13c9cc03c96 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:29.658150 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd728c-0a76-477d-804a-b13c9cc03c96 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:29.659907 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd728c-0a76-477d-804a-b13c9cc03c96 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:29.661656 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 21/43] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:28:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:29.664320 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0869efd-9a16-4a0b-8e1f-73ba3d15dc9d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:29.666758 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd728c-0a76-477d-804a-b13c9cc03c96 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:29.673535 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0869efd-9a16-4a0b-8e1f-73ba3d15dc9d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:29.677264 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd728c-0a76-477d-804a-b13c9cc03c96 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:29.678492 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556fed4-33f7-44cc-8133-4d989f3da2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:29.679146 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556fed4-33f7-44cc-8133-4d989f3da2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:29.679430 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556fed4-33f7-44cc-8133-4d989f3da2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:29.679708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556fed4-33f7-44cc-8133-4d989f3da2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:29.680507 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556fed4-33f7-44cc-8133-4d989f3da2d9 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:29.681705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-f556fed4-33f7-44cc-8133-4d989f3da2d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:28:29.681705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Feb 08 16:28:29.681705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: Feb 08 16:28:29.682039 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08260db7-daf2-40d8-afe8-3bb95c9b26a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:29.682606 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556fed4-33f7-44cc-8133-4d989f3da2d9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:29.682696 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08260db7-daf2-40d8-afe8-3bb95c9b26a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:29.682937 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08260db7-daf2-40d8-afe8-3bb95c9b26a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:29.683239 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08260db7-daf2-40d8-afe8-3bb95c9b26a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:29.683988 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08260db7-daf2-40d8-afe8-3bb95c9b26a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:29.684980 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING py.warnings [None req-08260db7-daf2-40d8-afe8-3bb95c9b26a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:28:29.684980 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: warnings.warn(msg) Feb 08 16:28:29.684980 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: Feb 08 16:28:29.686167 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08260db7-daf2-40d8-afe8-3bb95c9b26a3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:29.698628 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 23/44] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:28:29 2022] POST /identity/v3/roles => generated 223 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:28:29.723797 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 22/45] 10.222.0.35 () {60 vars in 1162 bytes} [Tue Feb 8 16:28:29 2022] POST /identity/v3/projects => generated 312 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:28:30.652604 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9ab17-bdad-4998-9149-76f3520fde82 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:30.653095 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9ab17-bdad-4998-9149-76f3520fde82 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:30.653095 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9ab17-bdad-4998-9149-76f3520fde82 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:30.654852 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 24/46] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:30.660409 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febd9f3-474b-4e8f-b772-f56aa30f1164 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:30.660819 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febd9f3-474b-4e8f-b772-f56aa30f1164 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:30.660977 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febd9f3-474b-4e8f-b772-f56aa30f1164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:30.679103 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-4febd9f3-474b-4e8f-b772-f56aa30f1164 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:30.680333 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-4febd9f3-474b-4e8f-b772-f56aa30f1164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:30.736156 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 23/47] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:30.760582 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9ab17-bdad-4998-9149-76f3520fde82 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:30.773131 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9ab17-bdad-4998-9149-76f3520fde82 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:30.777450 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151c1e4-4f80-47b7-b6be-1f44303336b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:30.778292 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151c1e4-4f80-47b7-b6be-1f44303336b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:30.778929 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151c1e4-4f80-47b7-b6be-1f44303336b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:30.779218 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151c1e4-4f80-47b7-b6be-1f44303336b1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:30.790243 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151c1e4-4f80-47b7-b6be-1f44303336b1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:30.797474 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-d151c1e4-4f80-47b7-b6be-1f44303336b1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:28:30.798660 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 25/48] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:28:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:30.805078 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febd9f3-474b-4e8f-b772-f56aa30f1164 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:30.813972 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febd9f3-474b-4e8f-b772-f56aa30f1164 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:30.819489 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae401e-4db6-4f3b-8241-ac81fa6966ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:30.820181 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae401e-4db6-4f3b-8241-ac81fa6966ac admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:30.820469 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae401e-4db6-4f3b-8241-ac81fa6966ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:30.820747 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae401e-4db6-4f3b-8241-ac81fa6966ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:30.821514 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae401e-4db6-4f3b-8241-ac81fa6966ac admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:30.821823 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae401e-4db6-4f3b-8241-ac81fa6966ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:30.822833 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING py.warnings [None req-5aae401e-4db6-4f3b-8241-ac81fa6966ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:28:30.822833 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: warnings.warn(msg) Feb 08 16:28:30.822833 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: Feb 08 16:28:30.823740 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae401e-4db6-4f3b-8241-ac81fa6966ac admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:30.837249 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 24/49] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:30.842633 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151c1e4-4f80-47b7-b6be-1f44303336b1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:30.852957 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151c1e4-4f80-47b7-b6be-1f44303336b1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:30.857668 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c54877-cbc7-42cf-ac74-8a983b993426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:30.858527 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c54877-cbc7-42cf-ac74-8a983b993426 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:30.858813 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c54877-cbc7-42cf-ac74-8a983b993426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:30.859092 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c54877-cbc7-42cf-ac74-8a983b993426 admin admin] PATH_INFO: `/v3/users/3e3abf5e1906480a9a6c24bfbb2057a5` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:30.860384 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c54877-cbc7-42cf-ac74-8a983b993426 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e3abf5e1906480a9a6c24bfbb2057a5)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:30.862962 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c54877-cbc7-42cf-ac74-8a983b993426 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:30.864767 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 26/50] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:30 2022] GET /identity/v3/users/3e3abf5e1906480a9a6c24bfbb2057a5 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:30.870382 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae401e-4db6-4f3b-8241-ac81fa6966ac admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:30.881337 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae401e-4db6-4f3b-8241-ac81fa6966ac admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:30.885824 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a9675-d5a3-42f8-911f-3324e78326bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:30.886606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a9675-d5a3-42f8-911f-3324e78326bc admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:30.886894 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a9675-d5a3-42f8-911f-3324e78326bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:30.887170 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a9675-d5a3-42f8-911f-3324e78326bc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:30.888415 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a9675-d5a3-42f8-911f-3324e78326bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:30.890128 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a9675-d5a3-42f8-911f-3324e78326bc admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:30.891774 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 25/51] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:28:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:30.898229 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c54877-cbc7-42cf-ac74-8a983b993426 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:30.908200 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c54877-cbc7-42cf-ac74-8a983b993426 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:30.912575 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1d1af-baed-4146-9072-a451500b21a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:30.913209 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1d1af-baed-4146-9072-a451500b21a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:30.913494 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1d1af-baed-4146-9072-a451500b21a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:30.913770 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1d1af-baed-4146-9072-a451500b21a0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:30.914604 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1d1af-baed-4146-9072-a451500b21a0 admin admin] RBAC: Adding query filter params (role.id=e6d18df5c4e74dfd8ebd9c636f45936e, scope.domain.id=default, user.id=3e3abf5e1906480a9a6c24bfbb2057a5) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:30.914915 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1d1af-baed-4146-9072-a451500b21a0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:30.915947 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-a2d1d1af-baed-4146-9072-a451500b21a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:28:30.915947 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Feb 08 16:28:30.915947 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: Feb 08 16:28:30.917094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1d1af-baed-4146-9072-a451500b21a0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:30.924243 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 27/52] 10.222.0.35 () {56 vars in 1343 bytes} [Tue Feb 8 16:28:30 2022] GET /identity/v3/role_assignments?user.id=3e3abf5e1906480a9a6c24bfbb2057a5&scope.domain.id=default&role.id=e6d18df5c4e74dfd8ebd9c636f45936e => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:31.968457 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068370b-0350-4b9f-876c-5d1a7eef4c61 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:31.969013 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068370b-0350-4b9f-876c-5d1a7eef4c61 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:31.969013 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068370b-0350-4b9f-876c-5d1a7eef4c61 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:31.970823 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 26/53] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:31.975995 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fc69d-e66f-4f66-ab6b-7aba03b0712f None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:31.976407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fc69d-e66f-4f66-ab6b-7aba03b0712f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:31.976548 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fc69d-e66f-4f66-ab6b-7aba03b0712f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:31.994426 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-9d3fc69d-e66f-4f66-ab6b-7aba03b0712f None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:31.995614 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9d3fc69d-e66f-4f66-ab6b-7aba03b0712f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:32.003721 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 28/54] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:28:32.026961 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068370b-0350-4b9f-876c-5d1a7eef4c61 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:32.039085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068370b-0350-4b9f-876c-5d1a7eef4c61 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:32.043352 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b1a43-80e8-4ed9-8165-944890124008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:32.044145 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b1a43-80e8-4ed9-8165-944890124008 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:32.044431 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b1a43-80e8-4ed9-8165-944890124008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:32.044712 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b1a43-80e8-4ed9-8165-944890124008 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:32.045898 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b1a43-80e8-4ed9-8165-944890124008 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:32.047587 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b1a43-80e8-4ed9-8165-944890124008 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:32.049774 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 27/55] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:28:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:32.055000 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fc69d-e66f-4f66-ab6b-7aba03b0712f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:32.063732 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fc69d-e66f-4f66-ab6b-7aba03b0712f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:32.068863 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e471c-a297-42d1-b8ab-52db932baabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:32.069537 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e471c-a297-42d1-b8ab-52db932baabc admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:32.069821 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e471c-a297-42d1-b8ab-52db932baabc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:32.070092 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e471c-a297-42d1-b8ab-52db932baabc admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:32.070818 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e471c-a297-42d1-b8ab-52db932baabc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:32.072786 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e471c-a297-42d1-b8ab-52db932baabc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:32.096430 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 29/56] 10.222.0.35 () {60 vars in 1161 bytes} [Tue Feb 8 16:28:32 2022] POST /identity/v3/projects => generated 298 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:28:34.322664 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1a5ae-07b4-477e-847a-d6ed46038bf2 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:34.323081 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1a5ae-07b4-477e-847a-d6ed46038bf2 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:34.323224 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1a5ae-07b4-477e-847a-d6ed46038bf2 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:34.325049 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 28/57] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:34.330845 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d751b-3663-4a88-82e8-2b07a2986f6e None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:34.331265 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d751b-3663-4a88-82e8-2b07a2986f6e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:34.331401 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d751b-3663-4a88-82e8-2b07a2986f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:34.349206 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e26d751b-3663-4a88-82e8-2b07a2986f6e None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:34.350383 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e26d751b-3663-4a88-82e8-2b07a2986f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:34.405478 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 30/58] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:28:34.430684 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1a5ae-07b4-477e-847a-d6ed46038bf2 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:34.443347 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1a5ae-07b4-477e-847a-d6ed46038bf2 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:34.447599 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0339ee-f50c-4aa1-a674-14e587c7db1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:34.448549 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0339ee-f50c-4aa1-a674-14e587c7db1e admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:34.448833 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0339ee-f50c-4aa1-a674-14e587c7db1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:34.449113 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0339ee-f50c-4aa1-a674-14e587c7db1e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:34.450310 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0339ee-f50c-4aa1-a674-14e587c7db1e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:34.452035 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0339ee-f50c-4aa1-a674-14e587c7db1e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:34.453599 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 29/59] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:28:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:34.459461 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d751b-3663-4a88-82e8-2b07a2986f6e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:34.468239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d751b-3663-4a88-82e8-2b07a2986f6e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:34.472753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a338d-f9bd-4489-ad72-9d9bdcf95d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:34.473390 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a338d-f9bd-4489-ad72-9d9bdcf95d38 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:34.473672 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a338d-f9bd-4489-ad72-9d9bdcf95d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:34.473946 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a338d-f9bd-4489-ad72-9d9bdcf95d38 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:34.474665 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a338d-f9bd-4489-ad72-9d9bdcf95d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:34.475672 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-5c2a338d-f9bd-4489-ad72-9d9bdcf95d38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:28:34.475672 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Feb 08 16:28:34.475672 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: Feb 08 16:28:34.476914 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a338d-f9bd-4489-ad72-9d9bdcf95d38 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:34.502805 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 31/60] 10.222.0.35 () {60 vars in 1153 bytes} [Tue Feb 8 16:28:34 2022] POST /identity/v3/users => generated 275 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:28:37.814030 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5025fe-ed4b-49cb-9266-174c33d98c51 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:37.814897 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5025fe-ed4b-49cb-9266-174c33d98c51 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:37.815320 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5025fe-ed4b-49cb-9266-174c33d98c51 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:37.817583 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 30/61] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:37.823480 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018262f7-98c2-45a0-85dd-cb3477e25436 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:37.824342 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018262f7-98c2-45a0-85dd-cb3477e25436 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:37.824778 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018262f7-98c2-45a0-85dd-cb3477e25436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:37.857084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-018262f7-98c2-45a0-85dd-cb3477e25436 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:37.858566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-018262f7-98c2-45a0-85dd-cb3477e25436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:37.867678 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 32/62] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:28:37.906861 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5025fe-ed4b-49cb-9266-174c33d98c51 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:37.925698 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5025fe-ed4b-49cb-9266-174c33d98c51 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:37.934448 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec06af-00db-4b2f-9c39-b460fc916692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:37.935585 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec06af-00db-4b2f-9c39-b460fc916692 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:37.936119 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec06af-00db-4b2f-9c39-b460fc916692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:37.936589 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec06af-00db-4b2f-9c39-b460fc916692 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:37.953054 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec06af-00db-4b2f-9c39-b460fc916692 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:37.961019 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-5bec06af-00db-4b2f-9c39-b460fc916692 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 08 16:28:37.962803 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 31/63] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:37.968743 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018262f7-98c2-45a0-85dd-cb3477e25436 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:37.985045 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018262f7-98c2-45a0-85dd-cb3477e25436 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:37.993259 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbf133-155d-4a0a-96a6-fa02e0c27679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:37.994201 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbf133-155d-4a0a-96a6-fa02e0c27679 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:37.994706 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbf133-155d-4a0a-96a6-fa02e0c27679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:37.995178 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbf133-155d-4a0a-96a6-fa02e0c27679 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:37.996203 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbf133-155d-4a0a-96a6-fa02e0c27679 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:37.996711 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbf133-155d-4a0a-96a6-fa02e0c27679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:37.998575 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbf133-155d-4a0a-96a6-fa02e0c27679 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:38.021138 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 33/64] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:28:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:38.027170 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec06af-00db-4b2f-9c39-b460fc916692 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.038716 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec06af-00db-4b2f-9c39-b460fc916692 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.047925 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e641a-7099-4638-9eb2-f126916adf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.049126 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e641a-7099-4638-9eb2-f126916adf38 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.049632 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e641a-7099-4638-9eb2-f126916adf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.050105 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e641a-7099-4638-9eb2-f126916adf38 admin admin] PATH_INFO: `/v3/users/0e4d9d73cebf4ad3a98486b7af465c46` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.070206 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e641a-7099-4638-9eb2-f126916adf38 admin admin] RBAC: Authorizing `identity:get_user(user_id=0e4d9d73cebf4ad3a98486b7af465c46)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:38.072322 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e641a-7099-4638-9eb2-f126916adf38 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:38.074344 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 32/65] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/users/0e4d9d73cebf4ad3a98486b7af465c46 => generated 275 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:38.079674 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbf133-155d-4a0a-96a6-fa02e0c27679 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.093571 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbf133-155d-4a0a-96a6-fa02e0c27679 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.104071 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda389b-29ba-4270-95ed-be5834528515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.104981 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda389b-29ba-4270-95ed-be5834528515 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.105460 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda389b-29ba-4270-95ed-be5834528515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.105950 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda389b-29ba-4270-95ed-be5834528515 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.120164 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda389b-29ba-4270-95ed-be5834528515 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:38.122263 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda389b-29ba-4270-95ed-be5834528515 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:38.137520 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 34/66] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:28:38.145998 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda389b-29ba-4270-95ed-be5834528515 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.146785 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9af19d-899b-432f-b67b-cc6ab3a4c357 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.147205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9af19d-899b-432f-b67b-cc6ab3a4c357 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.147604 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9af19d-899b-432f-b67b-cc6ab3a4c357 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.149696 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 33/67] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:38.155330 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76f483-f09c-426c-a4e6-7bca239133c3 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.155620 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76f483-f09c-426c-a4e6-7bca239133c3 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.155922 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76f483-f09c-426c-a4e6-7bca239133c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.156945 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda389b-29ba-4270-95ed-be5834528515 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.167929 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247d9cd-1ef9-45a2-9644-06a26d31ce64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.168792 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247d9cd-1ef9-45a2-9644-06a26d31ce64 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.169074 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247d9cd-1ef9-45a2-9644-06a26d31ce64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.169353 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247d9cd-1ef9-45a2-9644-06a26d31ce64 admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.175208 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-9a76f483-f09c-426c-a4e6-7bca239133c3 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:38.176539 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247d9cd-1ef9-45a2-9644-06a26d31ce64 admin admin] RBAC: Authorizing `identity:get_project(project_id=67f1c5c4abff46008cee0510849c586e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:38.176731 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-9a76f483-f09c-426c-a4e6-7bca239133c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:38.178648 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247d9cd-1ef9-45a2-9644-06a26d31ce64 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:38.180814 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 35/68] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/projects/67f1c5c4abff46008cee0510849c586e => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:38.186506 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247d9cd-1ef9-45a2-9644-06a26d31ce64 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.194036 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 34/69] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:28:38.201922 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247d9cd-1ef9-45a2-9644-06a26d31ce64 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.207032 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c9dad-21ac-4b1d-bd8e-3261f198edf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.207937 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c9dad-21ac-4b1d-bd8e-3261f198edf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.208398 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c9dad-21ac-4b1d-bd8e-3261f198edf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.208852 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c9dad-21ac-4b1d-bd8e-3261f198edf9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.209868 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c9dad-21ac-4b1d-bd8e-3261f198edf9 admin admin] RBAC: Adding query filter params (role.id=c5c492cc34274d1db36b946b78fa47d7, scope.project.id=67f1c5c4abff46008cee0510849c586e, user.id=0e4d9d73cebf4ad3a98486b7af465c46) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:38.210381 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c9dad-21ac-4b1d-bd8e-3261f198edf9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:38.212453 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c9dad-21ac-4b1d-bd8e-3261f198edf9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:38.224995 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76f483-f09c-426c-a4e6-7bca239133c3 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.237163 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76f483-f09c-426c-a4e6-7bca239133c3 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.240239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 36/70] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/role_assignments?user.id=0e4d9d73cebf4ad3a98486b7af465c46&scope.project.id=67f1c5c4abff46008cee0510849c586e&role.id=c5c492cc34274d1db36b946b78fa47d7 => generated 259 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:38.251596 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfee02-600c-4393-9ebe-1af2497ff95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.253345 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfee02-600c-4393-9ebe-1af2497ff95e admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.253815 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfee02-600c-4393-9ebe-1af2497ff95e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.254269 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfee02-600c-4393-9ebe-1af2497ff95e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.277838 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edfee02-600c-4393-9ebe-1af2497ff95e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:38.292493 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-7edfee02-600c-4393-9ebe-1af2497ff95e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 08 16:28:38.294071 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 35/71] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:28:38.300861 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c9dad-21ac-4b1d-bd8e-3261f198edf9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.321604 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c9dad-21ac-4b1d-bd8e-3261f198edf9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.327815 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542355e-5a69-4c30-865a-6538a125c040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.328520 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542355e-5a69-4c30-865a-6538a125c040 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.328803 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542355e-5a69-4c30-865a-6538a125c040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.329083 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542355e-5a69-4c30-865a-6538a125c040 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.330478 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542355e-5a69-4c30-865a-6538a125c040 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:38.331007 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542355e-5a69-4c30-865a-6538a125c040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:38.337296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542355e-5a69-4c30-865a-6538a125c040 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:38.348231 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 37/72] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:38.354461 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfee02-600c-4393-9ebe-1af2497ff95e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.372860 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfee02-600c-4393-9ebe-1af2497ff95e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.384730 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f103208-d2cf-4e4a-b1ab-18ff88324db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.385621 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f103208-d2cf-4e4a-b1ab-18ff88324db6 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.385789 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f009d-7274-4381-83cc-42b065d7a1c8 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.385886 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f103208-d2cf-4e4a-b1ab-18ff88324db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.386078 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f009d-7274-4381-83cc-42b065d7a1c8 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.386183 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f103208-d2cf-4e4a-b1ab-18ff88324db6 admin admin] PATH_INFO: `/v3/users/0e4d9d73cebf4ad3a98486b7af465c46` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.386328 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f009d-7274-4381-83cc-42b065d7a1c8 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.388351 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 38/73] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:28:38.393596 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f103208-d2cf-4e4a-b1ab-18ff88324db6 admin admin] RBAC: Authorizing `identity:get_user(user_id=0e4d9d73cebf4ad3a98486b7af465c46)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:38.395264 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7c909-9c2a-4e21-b84f-f3990636328c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.395550 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7c909-9c2a-4e21-b84f-f3990636328c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.395858 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7c909-9c2a-4e21-b84f-f3990636328c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.395968 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f103208-d2cf-4e4a-b1ab-18ff88324db6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:38.397930 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 36/74] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/users/0e4d9d73cebf4ad3a98486b7af465c46 => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:38.403328 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f103208-d2cf-4e4a-b1ab-18ff88324db6 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.414872 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f103208-d2cf-4e4a-b1ab-18ff88324db6 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.420144 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61153109-1393-48df-a27a-902693039068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.421618 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61153109-1393-48df-a27a-902693039068 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.422961 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61153109-1393-48df-a27a-902693039068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.423735 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61153109-1393-48df-a27a-902693039068 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.434003 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61153109-1393-48df-a27a-902693039068 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:38.435951 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-6fc7c909-9c2a-4e21-b84f-f3990636328c None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:38.436492 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61153109-1393-48df-a27a-902693039068 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:38.437234 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6fc7c909-9c2a-4e21-b84f-f3990636328c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:38.451904 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 37/75] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 08 16:28:38.454160 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61153109-1393-48df-a27a-902693039068 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.464116 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61153109-1393-48df-a27a-902693039068 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.468876 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a408afb-d0da-45ff-8646-cfc9e017e182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.469956 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a408afb-d0da-45ff-8646-cfc9e017e182 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.471067 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a408afb-d0da-45ff-8646-cfc9e017e182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.471586 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a408afb-d0da-45ff-8646-cfc9e017e182 admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.473075 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a408afb-d0da-45ff-8646-cfc9e017e182 admin admin] RBAC: Authorizing `identity:get_project(project_id=67f1c5c4abff46008cee0510849c586e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:38.475322 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a408afb-d0da-45ff-8646-cfc9e017e182 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:38.480926 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 39/77] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:28:38.481386 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 38/77] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/projects/67f1c5c4abff46008cee0510849c586e => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:38.494836 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7c909-9c2a-4e21-b84f-f3990636328c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.510844 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a408afb-d0da-45ff-8646-cfc9e017e182 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.513577 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7c909-9c2a-4e21-b84f-f3990636328c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.520827 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b17c5-b1ca-4844-92a4-0837593f72b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.521493 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b17c5-b1ca-4844-92a4-0837593f72b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.521768 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b17c5-b1ca-4844-92a4-0837593f72b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.522052 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b17c5-b1ca-4844-92a4-0837593f72b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.522902 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b17c5-b1ca-4844-92a4-0837593f72b0 admin admin] RBAC: Adding query filter params (role.id=519f10f80fbd4e108392697b77c2178a, scope.project.id=67f1c5c4abff46008cee0510849c586e, user.id=0e4d9d73cebf4ad3a98486b7af465c46) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:38.523222 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b17c5-b1ca-4844-92a4-0837593f72b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:38.524380 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a408afb-d0da-45ff-8646-cfc9e017e182 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.525133 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b17c5-b1ca-4844-92a4-0837593f72b0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:38.529294 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8660686-dba9-4768-829d-4227469d7ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.530321 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8660686-dba9-4768-829d-4227469d7ecf admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.530816 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8660686-dba9-4768-829d-4227469d7ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.531307 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8660686-dba9-4768-829d-4227469d7ecf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.535872 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 40/78] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/role_assignments?user.id=0e4d9d73cebf4ad3a98486b7af465c46&scope.project.id=67f1c5c4abff46008cee0510849c586e&role.id=519f10f80fbd4e108392697b77c2178a => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:38.553700 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8660686-dba9-4768-829d-4227469d7ecf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:38.561058 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-a8660686-dba9-4768-829d-4227469d7ecf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:28:38.562503 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 39/79] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:28:38.573011 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b17c5-b1ca-4844-92a4-0837593f72b0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.595338 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b17c5-b1ca-4844-92a4-0837593f72b0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.608607 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089068c8-ccef-477f-8a60-1f8b81d08b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.609301 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089068c8-ccef-477f-8a60-1f8b81d08b00 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.609595 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089068c8-ccef-477f-8a60-1f8b81d08b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.609878 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089068c8-ccef-477f-8a60-1f8b81d08b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.610671 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089068c8-ccef-477f-8a60-1f8b81d08b00 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:38.610981 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089068c8-ccef-477f-8a60-1f8b81d08b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:38.612915 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089068c8-ccef-477f-8a60-1f8b81d08b00 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:38.623263 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 41/80] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:38.630032 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8660686-dba9-4768-829d-4227469d7ecf admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.646264 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8660686-dba9-4768-829d-4227469d7ecf admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.650660 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808a7b0-53cd-4238-95fb-962219d0ea23 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.650956 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808a7b0-53cd-4238-95fb-962219d0ea23 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.651239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808a7b0-53cd-4238-95fb-962219d0ea23 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.652437 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c7161-b12f-40fd-b313-a6f55dc0da81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.653352 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 42/81] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:38.653816 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c7161-b12f-40fd-b313-a6f55dc0da81 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.654302 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c7161-b12f-40fd-b313-a6f55dc0da81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.654876 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c7161-b12f-40fd-b313-a6f55dc0da81 admin admin] PATH_INFO: `/v3/users/3e3abf5e1906480a9a6c24bfbb2057a5` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.656410 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c7161-b12f-40fd-b313-a6f55dc0da81 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e3abf5e1906480a9a6c24bfbb2057a5)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:38.659608 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042a3dc-99f7-4564-b032-ee3e1810ff34 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.659927 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042a3dc-99f7-4564-b032-ee3e1810ff34 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.660146 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c7161-b12f-40fd-b313-a6f55dc0da81 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:38.660244 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042a3dc-99f7-4564-b032-ee3e1810ff34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.662333 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 40/82] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/users/3e3abf5e1906480a9a6c24bfbb2057a5 => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:38.666965 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92536498-9674-4754-9f87-276eaed060ee None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.666965 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92536498-9674-4754-9f87-276eaed060ee None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.666965 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92536498-9674-4754-9f87-276eaed060ee None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.667730 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 41/83] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:38.668581 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92536498-9674-4754-9f87-276eaed060ee None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.683259 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92536498-9674-4754-9f87-276eaed060ee None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.688395 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ef6ca-d35f-416a-83c2-15bb0a5d3e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.689694 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ef6ca-d35f-416a-83c2-15bb0a5d3e25 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.690257 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e042a3dc-99f7-4564-b032-ee3e1810ff34 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:38.690503 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ef6ca-d35f-416a-83c2-15bb0a5d3e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.690973 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ef6ca-d35f-416a-83c2-15bb0a5d3e25 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.691461 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e042a3dc-99f7-4564-b032-ee3e1810ff34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:38.700599 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 43/84] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:28:38.702035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082c6e0-9efb-4ba7-b418-1c2ab6b35087 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.702331 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082c6e0-9efb-4ba7-b418-1c2ab6b35087 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.702608 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082c6e0-9efb-4ba7-b418-1c2ab6b35087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.703376 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ef6ca-d35f-416a-83c2-15bb0a5d3e25 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:38.706521 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ef6ca-d35f-416a-83c2-15bb0a5d3e25 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:38.731448 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 42/85] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 08 16:28:38.732378 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-a082c6e0-9efb-4ba7-b418-1c2ab6b35087 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:38.733079 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ef6ca-d35f-416a-83c2-15bb0a5d3e25 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.733603 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a082c6e0-9efb-4ba7-b418-1c2ab6b35087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:38.742961 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 44/86] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:38.743863 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082c6e0-9efb-4ba7-b418-1c2ab6b35087 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.746240 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ef6ca-d35f-416a-83c2-15bb0a5d3e25 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.751489 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b66997-0b25-4515-b9ed-c2ba90c36ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.753706 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082c6e0-9efb-4ba7-b418-1c2ab6b35087 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.753904 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b66997-0b25-4515-b9ed-c2ba90c36ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.754553 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b66997-0b25-4515-b9ed-c2ba90c36ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.755117 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b66997-0b25-4515-b9ed-c2ba90c36ff6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.758366 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899f10b-4913-4d1d-a2ac-ccda5c91b869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.759247 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899f10b-4913-4d1d-a2ac-ccda5c91b869 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.759517 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899f10b-4913-4d1d-a2ac-ccda5c91b869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.759818 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899f10b-4913-4d1d-a2ac-ccda5c91b869 admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.761037 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899f10b-4913-4d1d-a2ac-ccda5c91b869 admin admin] RBAC: Authorizing `identity:get_project(project_id=67f1c5c4abff46008cee0510849c586e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:38.763148 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899f10b-4913-4d1d-a2ac-ccda5c91b869 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:38.765260 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 45/87] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/projects/67f1c5c4abff46008cee0510849c586e => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:38.771681 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b66997-0b25-4515-b9ed-c2ba90c36ff6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:38.772429 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899f10b-4913-4d1d-a2ac-ccda5c91b869 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.779882 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-98b66997-0b25-4515-b9ed-c2ba90c36ff6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 08 16:28:38.781416 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 43/88] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:38.782705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899f10b-4913-4d1d-a2ac-ccda5c91b869 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.789477 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b66997-0b25-4515-b9ed-c2ba90c36ff6 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.795413 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac6e99-149d-4884-aba6-57835145bbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.796124 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac6e99-149d-4884-aba6-57835145bbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.796412 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac6e99-149d-4884-aba6-57835145bbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.796685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac6e99-149d-4884-aba6-57835145bbd1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.797550 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac6e99-149d-4884-aba6-57835145bbd1 admin admin] RBAC: Adding query filter params (role.id=e6d18df5c4e74dfd8ebd9c636f45936e, scope.project.id=67f1c5c4abff46008cee0510849c586e, user.id=3e3abf5e1906480a9a6c24bfbb2057a5) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:38.797875 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac6e99-149d-4884-aba6-57835145bbd1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:38.800341 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac6e99-149d-4884-aba6-57835145bbd1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:38.803447 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b66997-0b25-4515-b9ed-c2ba90c36ff6 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.806840 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 46/89] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/role_assignments?user.id=3e3abf5e1906480a9a6c24bfbb2057a5&scope.project.id=67f1c5c4abff46008cee0510849c586e&role.id=e6d18df5c4e74dfd8ebd9c636f45936e => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:38.807715 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac6e99-149d-4884-aba6-57835145bbd1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.808575 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c99e05-dc97-43b5-be2e-79cd9d6c018a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.809432 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c99e05-dc97-43b5-be2e-79cd9d6c018a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.809725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c99e05-dc97-43b5-be2e-79cd9d6c018a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.810006 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c99e05-dc97-43b5-be2e-79cd9d6c018a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.811229 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c99e05-dc97-43b5-be2e-79cd9d6c018a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:38.813030 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c99e05-dc97-43b5-be2e-79cd9d6c018a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:38.814798 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 44/90] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:38.821574 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c99e05-dc97-43b5-be2e-79cd9d6c018a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.825886 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac6e99-149d-4884-aba6-57835145bbd1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.833133 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87424ff7-df9e-452b-82f0-95546f55d17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.834185 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87424ff7-df9e-452b-82f0-95546f55d17f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.834662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87424ff7-df9e-452b-82f0-95546f55d17f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.834848 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c99e05-dc97-43b5-be2e-79cd9d6c018a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.835313 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87424ff7-df9e-452b-82f0-95546f55d17f admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.836668 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87424ff7-df9e-452b-82f0-95546f55d17f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:38.837305 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87424ff7-df9e-452b-82f0-95546f55d17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:38.839632 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87424ff7-df9e-452b-82f0-95546f55d17f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:38.840165 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3563c00-d57e-4d85-b846-362626ddd927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.840844 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3563c00-d57e-4d85-b846-362626ddd927 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.841186 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3563c00-d57e-4d85-b846-362626ddd927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.841468 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3563c00-d57e-4d85-b846-362626ddd927 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.842645 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3563c00-d57e-4d85-b846-362626ddd927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:38.844287 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING py.warnings [None req-b3563c00-d57e-4d85-b846-362626ddd927 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:28:38.844287 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: warnings.warn(msg) Feb 08 16:28:38.844287 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: Feb 08 16:28:38.846412 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3563c00-d57e-4d85-b846-362626ddd927 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:38.853670 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 47/91] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:38.858829 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87424ff7-df9e-452b-82f0-95546f55d17f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.872034 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87424ff7-df9e-452b-82f0-95546f55d17f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.876092 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 45/92] 10.222.0.35 () {60 vars in 1153 bytes} [Tue Feb 8 16:28:38 2022] POST /identity/v3/users => generated 289 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:28:38.878391 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcce309-cc4a-4afb-a025-669ceb66ea13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.879939 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcce309-cc4a-4afb-a025-669ceb66ea13 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.880486 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcce309-cc4a-4afb-a025-669ceb66ea13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.880957 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcce309-cc4a-4afb-a025-669ceb66ea13 admin admin] PATH_INFO: `/v3/users/0e4d9d73cebf4ad3a98486b7af465c46` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.882627 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcce309-cc4a-4afb-a025-669ceb66ea13 admin admin] RBAC: Authorizing `identity:get_user(user_id=0e4d9d73cebf4ad3a98486b7af465c46)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:38.885330 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcce309-cc4a-4afb-a025-669ceb66ea13 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:38.887683 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 48/93] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/users/0e4d9d73cebf4ad3a98486b7af465c46 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:38.899590 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3563c00-d57e-4d85-b846-362626ddd927 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.913982 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3563c00-d57e-4d85-b846-362626ddd927 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.923205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff420c1-05c3-44fe-8dde-2f960543a6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.924545 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff420c1-05c3-44fe-8dde-2f960543a6ed admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.924836 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff420c1-05c3-44fe-8dde-2f960543a6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.925115 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff420c1-05c3-44fe-8dde-2f960543a6ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:38.941383 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff420c1-05c3-44fe-8dde-2f960543a6ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:38.943207 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff420c1-05c3-44fe-8dde-2f960543a6ed admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:38.962279 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 46/94] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 08 16:28:38.968091 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcce309-cc4a-4afb-a025-669ceb66ea13 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:38.979288 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcce309-cc4a-4afb-a025-669ceb66ea13 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:38.994673 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e0346-30a5-400f-a76c-c69682b91dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:38.995595 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e0346-30a5-400f-a76c-c69682b91dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:38.995887 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e0346-30a5-400f-a76c-c69682b91dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:38.996173 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e0346-30a5-400f-a76c-c69682b91dc5 admin admin] PATH_INFO: `/v3/projects/eda840bd939e480a9fe86cc56ce668b2` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:39.000904 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e0346-30a5-400f-a76c-c69682b91dc5 admin admin] RBAC: Authorizing `identity:get_project(project_id=eda840bd939e480a9fe86cc56ce668b2)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:39.003225 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e0346-30a5-400f-a76c-c69682b91dc5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:39.005246 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 49/95] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:38 2022] GET /identity/v3/projects/eda840bd939e480a9fe86cc56ce668b2 => generated 312 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:39.011134 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff420c1-05c3-44fe-8dde-2f960543a6ed admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:39.020900 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff420c1-05c3-44fe-8dde-2f960543a6ed admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:39.025710 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2c646-ba38-4c09-9026-fc11246e4203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:39.026376 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2c646-ba38-4c09-9026-fc11246e4203 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:39.026657 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2c646-ba38-4c09-9026-fc11246e4203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:39.026941 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2c646-ba38-4c09-9026-fc11246e4203 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:39.027841 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2c646-ba38-4c09-9026-fc11246e4203 admin admin] RBAC: Adding query filter params (role.id=c5c492cc34274d1db36b946b78fa47d7, scope.project.id=eda840bd939e480a9fe86cc56ce668b2, user.id=0e4d9d73cebf4ad3a98486b7af465c46) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:39.028159 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2c646-ba38-4c09-9026-fc11246e4203 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:39.030052 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2c646-ba38-4c09-9026-fc11246e4203 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:39.037581 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 47/96] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:28:39 2022] GET /identity/v3/role_assignments?user.id=0e4d9d73cebf4ad3a98486b7af465c46&scope.project.id=eda840bd939e480a9fe86cc56ce668b2&role.id=c5c492cc34274d1db36b946b78fa47d7 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:40.927606 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a53c52-cbf2-45f2-a7b8-4ade7ccbea53 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:40.928603 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a53c52-cbf2-45f2-a7b8-4ade7ccbea53 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:40.929092 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a53c52-cbf2-45f2-a7b8-4ade7ccbea53 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:40.931069 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 50/97] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:40.936705 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2151d-edc0-478f-a558-151b04cdca49 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:40.937124 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2151d-edc0-478f-a558-151b04cdca49 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:40.937291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2151d-edc0-478f-a558-151b04cdca49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:40.964862 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-bda2151d-edc0-478f-a558-151b04cdca49 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:40.966090 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-bda2151d-edc0-478f-a558-151b04cdca49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:40.976928 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 48/98] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:41.025300 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a53c52-cbf2-45f2-a7b8-4ade7ccbea53 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:41.042262 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a53c52-cbf2-45f2-a7b8-4ade7ccbea53 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:41.046912 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396fb56-c2d7-474b-881c-52d0fd88063e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:41.047952 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396fb56-c2d7-474b-881c-52d0fd88063e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:41.049040 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396fb56-c2d7-474b-881c-52d0fd88063e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:41.049809 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396fb56-c2d7-474b-881c-52d0fd88063e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:41.068704 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396fb56-c2d7-474b-881c-52d0fd88063e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:41.076110 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-c396fb56-c2d7-474b-881c-52d0fd88063e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 08 16:28:41.077856 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 51/99] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:41.084046 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2151d-edc0-478f-a558-151b04cdca49 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:41.093472 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2151d-edc0-478f-a558-151b04cdca49 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:41.100699 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3a875-a481-4cbf-8a52-7c03e10a56be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:41.101370 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3a875-a481-4cbf-8a52-7c03e10a56be admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:41.101657 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3a875-a481-4cbf-8a52-7c03e10a56be admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:41.101938 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3a875-a481-4cbf-8a52-7c03e10a56be admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:41.102715 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3a875-a481-4cbf-8a52-7c03e10a56be admin admin] RBAC: Adding query filter params (name=member) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:41.103026 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3a875-a481-4cbf-8a52-7c03e10a56be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:41.104686 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3a875-a481-4cbf-8a52-7c03e10a56be admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:41.119891 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 49/100] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:28:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:41.125426 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396fb56-c2d7-474b-881c-52d0fd88063e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:41.140762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396fb56-c2d7-474b-881c-52d0fd88063e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:41.146158 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab42bc-6c0d-490e-b443-ef46156260c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:41.147256 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab42bc-6c0d-490e-b443-ef46156260c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:41.147738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab42bc-6c0d-490e-b443-ef46156260c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:41.148273 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab42bc-6c0d-490e-b443-ef46156260c7 admin admin] PATH_INFO: `/v3/users/0e4d9d73cebf4ad3a98486b7af465c46` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:41.149686 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab42bc-6c0d-490e-b443-ef46156260c7 admin admin] RBAC: Authorizing `identity:get_user(user_id=0e4d9d73cebf4ad3a98486b7af465c46)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:41.152058 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab42bc-6c0d-490e-b443-ef46156260c7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:41.153915 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 52/101] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:41 2022] GET /identity/v3/users/0e4d9d73cebf4ad3a98486b7af465c46 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:41.159814 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3a875-a481-4cbf-8a52-7c03e10a56be admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:41.170182 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3a875-a481-4cbf-8a52-7c03e10a56be admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:41.182964 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e129a-c0b2-4e0f-80f6-3ea130dbc010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:41.183789 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e129a-c0b2-4e0f-80f6-3ea130dbc010 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:41.184078 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e129a-c0b2-4e0f-80f6-3ea130dbc010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:41.184355 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e129a-c0b2-4e0f-80f6-3ea130dbc010 admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:41.188498 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e129a-c0b2-4e0f-80f6-3ea130dbc010 admin admin] RBAC: Authorizing `identity:get_project(project_id=67f1c5c4abff46008cee0510849c586e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:41.191473 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e129a-c0b2-4e0f-80f6-3ea130dbc010 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:41.193502 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 50/102] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:41 2022] GET /identity/v3/projects/67f1c5c4abff46008cee0510849c586e => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:41.199294 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab42bc-6c0d-490e-b443-ef46156260c7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:41.212846 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab42bc-6c0d-490e-b443-ef46156260c7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:41.217634 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b464da2-7e40-4753-96cf-720aa058d171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:41.218734 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b464da2-7e40-4753-96cf-720aa058d171 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:41.219232 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b464da2-7e40-4753-96cf-720aa058d171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:41.219704 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b464da2-7e40-4753-96cf-720aa058d171 admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e/users/0e4d9d73cebf4ad3a98486b7af465c46/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:41.222854 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b464da2-7e40-4753-96cf-720aa058d171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f1c5c4abff46008cee0510849c586e, user_id=0e4d9d73cebf4ad3a98486b7af465c46, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:41.224127 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-3b464da2-7e40-4753-96cf-720aa058d171 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:28:41.224127 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Feb 08 16:28:41.224127 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: Feb 08 16:28:41.231779 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b464da2-7e40-4753-96cf-720aa058d171 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:41.254802 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 53/103] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:28:41 2022] PUT /identity/v3/projects/67f1c5c4abff46008cee0510849c586e/users/0e4d9d73cebf4ad3a98486b7af465c46/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:28:41.606810 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed90cdb-aab0-4331-9be0-0d36c4f966a9 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:41.607199 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed90cdb-aab0-4331-9be0-0d36c4f966a9 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:41.607373 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed90cdb-aab0-4331-9be0-0d36c4f966a9 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:41.609204 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 51/104] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:41.615219 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f812e27-552b-4bd1-819a-f7418a08c774 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:41.615522 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f812e27-552b-4bd1-819a-f7418a08c774 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:41.615829 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f812e27-552b-4bd1-819a-f7418a08c774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:41.639392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-4f812e27-552b-4bd1-819a-f7418a08c774 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:41.640668 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4f812e27-552b-4bd1-819a-f7418a08c774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:41.706854 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c19bb-e0ae-4784-aa9f-52b893f14905 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:41.707153 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c19bb-e0ae-4784-aa9f-52b893f14905 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:41.707425 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c19bb-e0ae-4784-aa9f-52b893f14905 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:41.708993 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 54/105] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:41.709583 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 52/106] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:41.716911 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396be14-880c-42cb-b9f2-47e89c5a141d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:41.717464 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396be14-880c-42cb-b9f2-47e89c5a141d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:41.717886 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396be14-880c-42cb-b9f2-47e89c5a141d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:41.734753 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c19bb-e0ae-4784-aa9f-52b893f14905 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:41.746057 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d396be14-880c-42cb-b9f2-47e89c5a141d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:41.747564 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d396be14-880c-42cb-b9f2-47e89c5a141d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:41.756979 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 55/107] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:41.759861 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c19bb-e0ae-4784-aa9f-52b893f14905 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:41.769119 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c0d51-e9b3-4a97-a194-3385194af3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:41.769895 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c0d51-e9b3-4a97-a194-3385194af3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:41.770183 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c0d51-e9b3-4a97-a194-3385194af3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:41.770463 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c0d51-e9b3-4a97-a194-3385194af3a5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:41.785052 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396be14-880c-42cb-b9f2-47e89c5a141d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:41.794020 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c0d51-e9b3-4a97-a194-3385194af3a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:41.795048 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396be14-880c-42cb-b9f2-47e89c5a141d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:41.800446 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4e00e-99cb-41b6-80a2-5c2e410b6c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:41.801511 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4e00e-99cb-41b6-80a2-5c2e410b6c46 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:41.801616 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-237c0d51-e9b3-4a97-a194-3385194af3a5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 08 16:28:41.802128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4e00e-99cb-41b6-80a2-5c2e410b6c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:41.802977 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 53/108] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:41.803343 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4e00e-99cb-41b6-80a2-5c2e410b6c46 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:41.809544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c0d51-e9b3-4a97-a194-3385194af3a5 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:41.820930 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4e00e-99cb-41b6-80a2-5c2e410b6c46 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:41.822285 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c0d51-e9b3-4a97-a194-3385194af3a5 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:41.836599 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-69b4e00e-99cb-41b6-80a2-5c2e410b6c46 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 08 16:28:41.837890 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 56/109] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:28:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:41.840011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5991441-ba62-41b5-bdf2-1a70f2c5d835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:41.840715 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5991441-ba62-41b5-bdf2-1a70f2c5d835 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:41.840991 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5991441-ba62-41b5-bdf2-1a70f2c5d835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:41.841276 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5991441-ba62-41b5-bdf2-1a70f2c5d835 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:41.842104 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5991441-ba62-41b5-bdf2-1a70f2c5d835 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:41.842430 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5991441-ba62-41b5-bdf2-1a70f2c5d835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:41.844091 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5991441-ba62-41b5-bdf2-1a70f2c5d835 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:41.849030 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4e00e-99cb-41b6-80a2-5c2e410b6c46 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:41.863325 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 54/110] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:28:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:41.864641 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5991441-ba62-41b5-bdf2-1a70f2c5d835 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:41.868023 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4e00e-99cb-41b6-80a2-5c2e410b6c46 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:41.877254 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5991441-ba62-41b5-bdf2-1a70f2c5d835 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:41.885420 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db81cd-b80b-4f9b-9f3a-ba822f715a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:41.886091 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db81cd-b80b-4f9b-9f3a-ba822f715a19 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:41.886396 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db81cd-b80b-4f9b-9f3a-ba822f715a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:41.886643 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db81cd-b80b-4f9b-9f3a-ba822f715a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:41.887407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db81cd-b80b-4f9b-9f3a-ba822f715a19 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:41.887773 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db81cd-b80b-4f9b-9f3a-ba822f715a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:41.888333 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40702a6b-5ef7-4dbb-9c71-43975b25d464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:41.889246 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40702a6b-5ef7-4dbb-9c71-43975b25d464 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:41.889349 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db81cd-b80b-4f9b-9f3a-ba822f715a19 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:41.889538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40702a6b-5ef7-4dbb-9c71-43975b25d464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:41.889867 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40702a6b-5ef7-4dbb-9c71-43975b25d464 admin admin] PATH_INFO: `/v3/users/0e4d9d73cebf4ad3a98486b7af465c46` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:41.897058 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40702a6b-5ef7-4dbb-9c71-43975b25d464 admin admin] RBAC: Authorizing `identity:get_user(user_id=0e4d9d73cebf4ad3a98486b7af465c46)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:41.899249 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40702a6b-5ef7-4dbb-9c71-43975b25d464 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:41.900958 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 55/111] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:41 2022] GET /identity/v3/users/0e4d9d73cebf4ad3a98486b7af465c46 => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:41.907158 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40702a6b-5ef7-4dbb-9c71-43975b25d464 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:41.910647 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 57/112] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:28:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:41.916371 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db81cd-b80b-4f9b-9f3a-ba822f715a19 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:41.921373 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40702a6b-5ef7-4dbb-9c71-43975b25d464 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:41.926755 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302a81b-cbdb-4d31-828f-40819dcb5c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:41.927597 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302a81b-cbdb-4d31-828f-40819dcb5c62 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:41.927917 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302a81b-cbdb-4d31-828f-40819dcb5c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:41.928198 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302a81b-cbdb-4d31-828f-40819dcb5c62 admin admin] PATH_INFO: `/v3/projects/eda840bd939e480a9fe86cc56ce668b2` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:41.929933 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302a81b-cbdb-4d31-828f-40819dcb5c62 admin admin] RBAC: Authorizing `identity:get_project(project_id=eda840bd939e480a9fe86cc56ce668b2)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:41.932202 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302a81b-cbdb-4d31-828f-40819dcb5c62 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:41.939676 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 56/113] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:41 2022] GET /identity/v3/projects/eda840bd939e480a9fe86cc56ce668b2 => generated 312 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:41.940622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302a81b-cbdb-4d31-828f-40819dcb5c62 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:41.941649 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db81cd-b80b-4f9b-9f3a-ba822f715a19 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:41.951528 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302a81b-cbdb-4d31-828f-40819dcb5c62 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:41.955905 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40cd16-ab5f-494b-847c-95ddb5854072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:41.956996 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40cd16-ab5f-494b-847c-95ddb5854072 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:41.958360 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40cd16-ab5f-494b-847c-95ddb5854072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:41.959145 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40cd16-ab5f-494b-847c-95ddb5854072 admin admin] PATH_INFO: `/v3/users/0e4d9d73cebf4ad3a98486b7af465c46` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:41.960940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265728e-40de-4485-83ee-c0561fc7ae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:41.961790 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40cd16-ab5f-494b-847c-95ddb5854072 admin admin] RBAC: Authorizing `identity:get_user(user_id=0e4d9d73cebf4ad3a98486b7af465c46)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:41.962833 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265728e-40de-4485-83ee-c0561fc7ae56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:41.965217 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40cd16-ab5f-494b-847c-95ddb5854072 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:41.965705 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265728e-40de-4485-83ee-c0561fc7ae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:41.966173 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265728e-40de-4485-83ee-c0561fc7ae56 admin admin] PATH_INFO: `/v3/projects/eda840bd939e480a9fe86cc56ce668b2/users/0e4d9d73cebf4ad3a98486b7af465c46/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:41.968399 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265728e-40de-4485-83ee-c0561fc7ae56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda840bd939e480a9fe86cc56ce668b2, user_id=0e4d9d73cebf4ad3a98486b7af465c46, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:41.970772 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 58/114] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:41 2022] GET /identity/v3/users/0e4d9d73cebf4ad3a98486b7af465c46 => generated 275 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:41.973884 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265728e-40de-4485-83ee-c0561fc7ae56 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:41.976499 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40cd16-ab5f-494b-847c-95ddb5854072 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:41.990786 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40cd16-ab5f-494b-847c-95ddb5854072 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:41.996561 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff72be-c000-4c94-91a6-75502de27d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:41.997605 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff72be-c000-4c94-91a6-75502de27d67 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:41.998070 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff72be-c000-4c94-91a6-75502de27d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:41.998686 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff72be-c000-4c94-91a6-75502de27d67 admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:42.004249 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff72be-c000-4c94-91a6-75502de27d67 admin admin] RBAC: Authorizing `identity:get_project(project_id=67f1c5c4abff46008cee0510849c586e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:42.007406 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 57/115] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:28:41 2022] PUT /identity/v3/projects/eda840bd939e480a9fe86cc56ce668b2/users/0e4d9d73cebf4ad3a98486b7af465c46/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:28:42.009816 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff72be-c000-4c94-91a6-75502de27d67 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:42.011816 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 59/116] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:41 2022] GET /identity/v3/projects/67f1c5c4abff46008cee0510849c586e => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:42.024346 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265728e-40de-4485-83ee-c0561fc7ae56 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:42.117438 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265728e-40de-4485-83ee-c0561fc7ae56 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:42.127951 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bf59c-fa34-4e57-b11e-e1e5ebabc6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:42.128869 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bf59c-fa34-4e57-b11e-e1e5ebabc6b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:42.129152 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bf59c-fa34-4e57-b11e-e1e5ebabc6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:42.129435 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bf59c-fa34-4e57-b11e-e1e5ebabc6b1 admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e/users/0e4d9d73cebf4ad3a98486b7af465c46/roles/519f10f80fbd4e108392697b77c2178a` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:42.136402 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bf59c-fa34-4e57-b11e-e1e5ebabc6b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f1c5c4abff46008cee0510849c586e, user_id=0e4d9d73cebf4ad3a98486b7af465c46, role_id=519f10f80fbd4e108392697b77c2178a)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:42.139165 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bf59c-fa34-4e57-b11e-e1e5ebabc6b1 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:42.167176 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 58/117] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:28:42 2022] PUT /identity/v3/projects/67f1c5c4abff46008cee0510849c586e/users/0e4d9d73cebf4ad3a98486b7af465c46/roles/519f10f80fbd4e108392697b77c2178a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:28:42.200505 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a17682-b503-4dc9-bb18-f43ae16d1b91 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:42.201117 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a17682-b503-4dc9-bb18-f43ae16d1b91 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:42.201611 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a17682-b503-4dc9-bb18-f43ae16d1b91 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:42.203614 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 60/118] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:42.210238 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73b257-d2af-440f-bac5-f1b80d437820 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:42.210528 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73b257-d2af-440f-bac5-f1b80d437820 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:42.210808 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73b257-d2af-440f-bac5-f1b80d437820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:42.238941 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-9d73b257-d2af-440f-bac5-f1b80d437820 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:42.240186 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-9d73b257-d2af-440f-bac5-f1b80d437820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:42.330682 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 59/119] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:28:42.366366 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a17682-b503-4dc9-bb18-f43ae16d1b91 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:42.382460 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a17682-b503-4dc9-bb18-f43ae16d1b91 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:42.394878 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80511925-778c-40b5-bc12-3cb5ee0bf84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:42.395694 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80511925-778c-40b5-bc12-3cb5ee0bf84f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:42.396017 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80511925-778c-40b5-bc12-3cb5ee0bf84f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:42.396296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80511925-778c-40b5-bc12-3cb5ee0bf84f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:42.415314 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80511925-778c-40b5-bc12-3cb5ee0bf84f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:42.422502 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-80511925-778c-40b5-bc12-3cb5ee0bf84f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:28:42.424531 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 61/120] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:28:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:42.430412 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73b257-d2af-440f-bac5-f1b80d437820 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:42.442128 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73b257-d2af-440f-bac5-f1b80d437820 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:42.450164 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52cada-1e28-4f27-a310-7f8adc60e85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:42.450840 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52cada-1e28-4f27-a310-7f8adc60e85a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:42.451124 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52cada-1e28-4f27-a310-7f8adc60e85a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:42.451402 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52cada-1e28-4f27-a310-7f8adc60e85a admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:42.452206 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52cada-1e28-4f27-a310-7f8adc60e85a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:42.452517 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52cada-1e28-4f27-a310-7f8adc60e85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:42.454151 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52cada-1e28-4f27-a310-7f8adc60e85a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:42.464643 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 60/121] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:42.470424 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80511925-778c-40b5-bc12-3cb5ee0bf84f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:42.482191 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80511925-778c-40b5-bc12-3cb5ee0bf84f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:42.492605 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfa4eb-add8-455e-91e1-eeb5c5e125cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:42.493497 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfa4eb-add8-455e-91e1-eeb5c5e125cc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:42.493780 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfa4eb-add8-455e-91e1-eeb5c5e125cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:42.494108 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfa4eb-add8-455e-91e1-eeb5c5e125cc admin admin] PATH_INFO: `/v3/users/3e3abf5e1906480a9a6c24bfbb2057a5` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:42.495634 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfa4eb-add8-455e-91e1-eeb5c5e125cc admin admin] RBAC: Authorizing `identity:get_user(user_id=3e3abf5e1906480a9a6c24bfbb2057a5)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:42.497615 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfa4eb-add8-455e-91e1-eeb5c5e125cc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:42.499524 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 62/122] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:42 2022] GET /identity/v3/users/3e3abf5e1906480a9a6c24bfbb2057a5 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:42.506133 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52cada-1e28-4f27-a310-7f8adc60e85a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:42.516259 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52cada-1e28-4f27-a310-7f8adc60e85a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:42.521338 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d709ca-85f8-428d-a4ff-a99dc06a24d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:42.522246 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d709ca-85f8-428d-a4ff-a99dc06a24d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:42.522534 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d709ca-85f8-428d-a4ff-a99dc06a24d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:42.522817 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d709ca-85f8-428d-a4ff-a99dc06a24d1 admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:42.524120 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d709ca-85f8-428d-a4ff-a99dc06a24d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=67f1c5c4abff46008cee0510849c586e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:42.526483 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d709ca-85f8-428d-a4ff-a99dc06a24d1 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:42.528445 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 61/123] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:42 2022] GET /identity/v3/projects/67f1c5c4abff46008cee0510849c586e => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:42.534073 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfa4eb-add8-455e-91e1-eeb5c5e125cc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:42.545366 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfa4eb-add8-455e-91e1-eeb5c5e125cc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:42.551051 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0a10a-4a2e-42a3-8c57-2d3b3a107d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:42.552111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0a10a-4a2e-42a3-8c57-2d3b3a107d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:42.552493 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0a10a-4a2e-42a3-8c57-2d3b3a107d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:42.552776 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0a10a-4a2e-42a3-8c57-2d3b3a107d88 admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e/users/3e3abf5e1906480a9a6c24bfbb2057a5/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:42.555042 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0a10a-4a2e-42a3-8c57-2d3b3a107d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f1c5c4abff46008cee0510849c586e, user_id=3e3abf5e1906480a9a6c24bfbb2057a5, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:42.557890 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0a10a-4a2e-42a3-8c57-2d3b3a107d88 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:42.580624 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 63/124] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:28:42 2022] PUT /identity/v3/projects/67f1c5c4abff46008cee0510849c586e/users/3e3abf5e1906480a9a6c24bfbb2057a5/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:28:43.420265 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f917fc-abf6-491f-ab9b-1cfc2e3711c1 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:43.420827 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f917fc-abf6-491f-ab9b-1cfc2e3711c1 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:43.420827 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f917fc-abf6-491f-ab9b-1cfc2e3711c1 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:43.422588 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 62/125] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:28:43.428304 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ef1f4-0e1f-4c1c-94d9-cd86f5ec530b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:43.428771 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ef1f4-0e1f-4c1c-94d9-cd86f5ec530b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:43.428847 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ef1f4-0e1f-4c1c-94d9-cd86f5ec530b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:43.452715 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c41ef1f4-0e1f-4c1c-94d9-cd86f5ec530b None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:43.453900 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c41ef1f4-0e1f-4c1c-94d9-cd86f5ec530b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:43.468977 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0564db-1fcf-4984-8fe1-b9397f1a8f21 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:43.469280 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0564db-1fcf-4984-8fe1-b9397f1a8f21 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:43.469535 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0564db-1fcf-4984-8fe1-b9397f1a8f21 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:43.471833 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 63/126] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:28:43.477141 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fe972-91dc-448a-a864-afdd201d469b None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:43.477424 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fe972-91dc-448a-a864-afdd201d469b None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:43.477703 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fe972-91dc-448a-a864-afdd201d469b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:43.505519 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-a60fe972-91dc-448a-a864-afdd201d469b None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:43.506716 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a60fe972-91dc-448a-a864-afdd201d469b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:43.569384 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 64/127] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:43.603334 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 64/128] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:43.613898 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ef1f4-0e1f-4c1c-94d9-cd86f5ec530b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:43.623325 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ef1f4-0e1f-4c1c-94d9-cd86f5ec530b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:43.632069 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ec217-3c26-421e-b531-ded58138bb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:43.632859 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ec217-3c26-421e-b531-ded58138bb1c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:43.633146 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ec217-3c26-421e-b531-ded58138bb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:43.633426 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ec217-3c26-421e-b531-ded58138bb1c admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:43.639531 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fe972-91dc-448a-a864-afdd201d469b None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:43.649648 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fe972-91dc-448a-a864-afdd201d469b None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:43.660666 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a71d2-4a22-4554-986c-229246b4e460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:43.661506 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a71d2-4a22-4554-986c-229246b4e460 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:43.661790 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a71d2-4a22-4554-986c-229246b4e460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:43.662066 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a71d2-4a22-4554-986c-229246b4e460 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:43.663094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ec217-3c26-421e-b531-ded58138bb1c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:43.664592 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a71d2-4a22-4554-986c-229246b4e460 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:43.669889 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a71d2-4a22-4554-986c-229246b4e460 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:43.675037 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 65/129] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:28:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:43.677397 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-761ec217-3c26-421e-b531-ded58138bb1c admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 08 16:28:43.678602 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 65/130] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:43.684787 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a71d2-4a22-4554-986c-229246b4e460 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:43.685966 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ec217-3c26-421e-b531-ded58138bb1c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:43.708651 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a71d2-4a22-4554-986c-229246b4e460 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:43.711949 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ec217-3c26-421e-b531-ded58138bb1c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:43.718590 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced927f8-c7a8-49e9-a2de-f907808c2339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:43.719796 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced927f8-c7a8-49e9-a2de-f907808c2339 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:43.724428 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af573591-6644-47d0-9984-1f4f2ed16baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:43.725240 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced927f8-c7a8-49e9-a2de-f907808c2339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:43.725522 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced927f8-c7a8-49e9-a2de-f907808c2339 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:43.726360 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af573591-6644-47d0-9984-1f4f2ed16baa admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:43.726636 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af573591-6644-47d0-9984-1f4f2ed16baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:43.726906 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af573591-6644-47d0-9984-1f4f2ed16baa admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:43.727677 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced927f8-c7a8-49e9-a2de-f907808c2339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:43.728095 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af573591-6644-47d0-9984-1f4f2ed16baa admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:43.730170 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af573591-6644-47d0-9984-1f4f2ed16baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:43.731831 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af573591-6644-47d0-9984-1f4f2ed16baa admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:43.732401 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced927f8-c7a8-49e9-a2de-f907808c2339 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:43.757488 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 66/131] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:28:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:43.764762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af573591-6644-47d0-9984-1f4f2ed16baa admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:43.785554 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af573591-6644-47d0-9984-1f4f2ed16baa admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:43.798163 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 66/132] 10.222.0.35 () {60 vars in 1162 bytes} [Tue Feb 8 16:28:43 2022] POST /identity/v3/projects => generated 302 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:28:43.799434 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80292194-82af-4164-b1a8-c27aeeb76588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:43.800362 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80292194-82af-4164-b1a8-c27aeeb76588 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:43.800704 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80292194-82af-4164-b1a8-c27aeeb76588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:43.800989 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80292194-82af-4164-b1a8-c27aeeb76588 admin admin] PATH_INFO: `/v3/users/d7dd6c7bf40e4e50b79517e8b347696b` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:43.826714 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80292194-82af-4164-b1a8-c27aeeb76588 admin admin] RBAC: Authorizing `identity:get_user(user_id=d7dd6c7bf40e4e50b79517e8b347696b)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:43.829169 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80292194-82af-4164-b1a8-c27aeeb76588 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:43.831898 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 67/133] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:43 2022] GET /identity/v3/users/d7dd6c7bf40e4e50b79517e8b347696b => generated 289 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:43.837617 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced927f8-c7a8-49e9-a2de-f907808c2339 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:43.912411 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced927f8-c7a8-49e9-a2de-f907808c2339 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:43.917126 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc88ca0-f44a-4b7a-96db-f68794f8913e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:43.917777 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc88ca0-f44a-4b7a-96db-f68794f8913e admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:43.918062 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc88ca0-f44a-4b7a-96db-f68794f8913e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:43.918342 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc88ca0-f44a-4b7a-96db-f68794f8913e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:43.928476 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc88ca0-f44a-4b7a-96db-f68794f8913e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:43.930271 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc88ca0-f44a-4b7a-96db-f68794f8913e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:43.941121 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 67/134] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:28:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:28:43.946918 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80292194-82af-4164-b1a8-c27aeeb76588 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:43.958064 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80292194-82af-4164-b1a8-c27aeeb76588 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:43.962570 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85e651-125b-4760-8287-5d625a701840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:43.963567 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85e651-125b-4760-8287-5d625a701840 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:43.963927 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85e651-125b-4760-8287-5d625a701840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:43.964206 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85e651-125b-4760-8287-5d625a701840 admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:43.965387 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85e651-125b-4760-8287-5d625a701840 admin admin] RBAC: Authorizing `identity:get_project(project_id=67f1c5c4abff46008cee0510849c586e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:43.967514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85e651-125b-4760-8287-5d625a701840 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:43.969621 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 68/135] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:43 2022] GET /identity/v3/projects/67f1c5c4abff46008cee0510849c586e => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:43.976142 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc88ca0-f44a-4b7a-96db-f68794f8913e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:43.985385 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc88ca0-f44a-4b7a-96db-f68794f8913e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:43.990600 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e9226-e490-4b58-ad23-d63f0bed8dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:43.991252 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e9226-e490-4b58-ad23-d63f0bed8dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:43.991594 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e9226-e490-4b58-ad23-d63f0bed8dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:43.991917 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e9226-e490-4b58-ad23-d63f0bed8dc3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:43.992816 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e9226-e490-4b58-ad23-d63f0bed8dc3 admin admin] RBAC: Adding query filter params (role.id=0d13cea753d5416bb8e71bf1e19fe7d9, scope.project.id=67f1c5c4abff46008cee0510849c586e, user.id=d7dd6c7bf40e4e50b79517e8b347696b) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:43.993136 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e9226-e490-4b58-ad23-d63f0bed8dc3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:43.995025 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e9226-e490-4b58-ad23-d63f0bed8dc3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:44.001241 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 68/136] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:28:43 2022] GET /identity/v3/role_assignments?user.id=d7dd6c7bf40e4e50b79517e8b347696b&scope.project.id=67f1c5c4abff46008cee0510849c586e&role.id=0d13cea753d5416bb8e71bf1e19fe7d9 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:45.117796 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd7a67-26d0-4f54-91d4-8524ed6986e2 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.118315 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd7a67-26d0-4f54-91d4-8524ed6986e2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.118387 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd7a67-26d0-4f54-91d4-8524ed6986e2 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.120262 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 69/137] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:45.125880 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b70ea-4164-442a-812c-410628b02ac4 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.126307 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b70ea-4164-442a-812c-410628b02ac4 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.126524 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b70ea-4164-442a-812c-410628b02ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.148365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-c54b70ea-4164-442a-812c-410628b02ac4 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:45.149557 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-c54b70ea-4164-442a-812c-410628b02ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:45.157200 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 69/138] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:45.181948 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd7a67-26d0-4f54-91d4-8524ed6986e2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:45.196023 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd7a67-26d0-4f54-91d4-8524ed6986e2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:45.200963 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb6e2c-2d69-49d4-a080-54dded666be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:45.201781 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb6e2c-2d69-49d4-a080-54dded666be1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.202066 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb6e2c-2d69-49d4-a080-54dded666be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.202344 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb6e2c-2d69-49d4-a080-54dded666be1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.218620 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb6e2c-2d69-49d4-a080-54dded666be1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:45.230257 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-00bb6e2c-2d69-49d4-a080-54dded666be1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 08 16:28:45.231864 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 70/139] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:45.238539 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b70ea-4164-442a-812c-410628b02ac4 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:45.253441 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b70ea-4164-442a-812c-410628b02ac4 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:45.266919 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487bb0a-1021-4fb8-82d1-b316568ab98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:45.268479 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487bb0a-1021-4fb8-82d1-b316568ab98b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.268831 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487bb0a-1021-4fb8-82d1-b316568ab98b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.269114 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487bb0a-1021-4fb8-82d1-b316568ab98b admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.269899 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487bb0a-1021-4fb8-82d1-b316568ab98b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:45.270208 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487bb0a-1021-4fb8-82d1-b316568ab98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:45.271855 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487bb0a-1021-4fb8-82d1-b316568ab98b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:45.281078 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 70/140] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:28:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:45.287025 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb6e2c-2d69-49d4-a080-54dded666be1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:45.296963 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb6e2c-2d69-49d4-a080-54dded666be1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:45.302206 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60035ac5-f9ba-46c1-9e7f-4990109b3f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:45.303070 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60035ac5-f9ba-46c1-9e7f-4990109b3f53 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.303358 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60035ac5-f9ba-46c1-9e7f-4990109b3f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.303636 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60035ac5-f9ba-46c1-9e7f-4990109b3f53 admin admin] PATH_INFO: `/v3/users/0e4d9d73cebf4ad3a98486b7af465c46` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.304914 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60035ac5-f9ba-46c1-9e7f-4990109b3f53 admin admin] RBAC: Authorizing `identity:get_user(user_id=0e4d9d73cebf4ad3a98486b7af465c46)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:45.312082 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60035ac5-f9ba-46c1-9e7f-4990109b3f53 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:45.314025 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 71/141] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:45 2022] GET /identity/v3/users/0e4d9d73cebf4ad3a98486b7af465c46 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:45.319332 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48caa9-b26c-4e4b-bf60-b00b7bade07f None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.319631 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48caa9-b26c-4e4b-bf60-b00b7bade07f None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.319938 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48caa9-b26c-4e4b-bf60-b00b7bade07f None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.321740 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 71/142] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:45.323782 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60035ac5-f9ba-46c1-9e7f-4990109b3f53 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:45.326777 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3359d-efcd-47e0-8afb-bbf27f387d6c None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.327106 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3359d-efcd-47e0-8afb-bbf27f387d6c None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.327394 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3359d-efcd-47e0-8afb-bbf27f387d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.353104 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60035ac5-f9ba-46c1-9e7f-4990109b3f53 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:45.354627 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-63c3359d-efcd-47e0-8afb-bbf27f387d6c None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:45.356241 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-63c3359d-efcd-47e0-8afb-bbf27f387d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:45.362997 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d060e-fde2-42c0-842f-020450bfc5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:45.363671 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d060e-fde2-42c0-842f-020450bfc5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.363980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d060e-fde2-42c0-842f-020450bfc5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.364265 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d060e-fde2-42c0-842f-020450bfc5c1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.374709 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 72/143] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:28:45.377815 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d060e-fde2-42c0-842f-020450bfc5c1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:45.379697 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d060e-fde2-42c0-842f-020450bfc5c1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:45.394148 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 72/144] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:28:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:28:45.399912 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3359d-efcd-47e0-8afb-bbf27f387d6c None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:45.410379 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3359d-efcd-47e0-8afb-bbf27f387d6c None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:45.414952 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90e3f5-9f23-4f52-a9a7-fd7fc4c00daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:45.415897 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90e3f5-9f23-4f52-a9a7-fd7fc4c00daf admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.416184 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90e3f5-9f23-4f52-a9a7-fd7fc4c00daf admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.416465 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90e3f5-9f23-4f52-a9a7-fd7fc4c00daf admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.418836 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d060e-fde2-42c0-842f-020450bfc5c1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:45.423939 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90e3f5-9f23-4f52-a9a7-fd7fc4c00daf admin admin] RBAC: Authorizing `identity:get_project(project_id=67f1c5c4abff46008cee0510849c586e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:45.426052 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90e3f5-9f23-4f52-a9a7-fd7fc4c00daf admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:45.431423 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d060e-fde2-42c0-842f-020450bfc5c1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:45.434089 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 73/145] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:45 2022] GET /identity/v3/projects/67f1c5c4abff46008cee0510849c586e => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:45.437342 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e39d71-0702-40ae-80d3-42e69960789e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:45.438200 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39d71-0702-40ae-80d3-42e69960789e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.438485 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39d71-0702-40ae-80d3-42e69960789e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.439569 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90e3f5-9f23-4f52-a9a7-fd7fc4c00daf admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:45.440671 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39d71-0702-40ae-80d3-42e69960789e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.455481 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e39d71-0702-40ae-80d3-42e69960789e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:45.456188 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90e3f5-9f23-4f52-a9a7-fd7fc4c00daf admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:45.463444 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-69e39d71-0702-40ae-80d3-42e69960789e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 08 16:28:45.464936 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 73/146] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:28:45.469485 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bca04-0080-45d8-bcd7-16bf1864430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:45.470184 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bca04-0080-45d8-bcd7-16bf1864430d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.471105 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bca04-0080-45d8-bcd7-16bf1864430d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.471393 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bca04-0080-45d8-bcd7-16bf1864430d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.472089 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e39d71-0702-40ae-80d3-42e69960789e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:45.472361 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889bca04-0080-45d8-bcd7-16bf1864430d admin admin] RBAC: Adding query filter params (role.id=c5c492cc34274d1db36b946b78fa47d7, scope.project.id=67f1c5c4abff46008cee0510849c586e, user.id=0e4d9d73cebf4ad3a98486b7af465c46) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:45.472680 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889bca04-0080-45d8-bcd7-16bf1864430d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:45.474604 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889bca04-0080-45d8-bcd7-16bf1864430d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:45.484842 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 74/147] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:28:45 2022] GET /identity/v3/role_assignments?user.id=0e4d9d73cebf4ad3a98486b7af465c46&scope.project.id=67f1c5c4abff46008cee0510849c586e&role.id=c5c492cc34274d1db36b946b78fa47d7 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:45.491185 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e39d71-0702-40ae-80d3-42e69960789e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:45.505055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e460c-a00a-486c-8a3e-b93f7f1ebb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:45.506264 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e460c-a00a-486c-8a3e-b93f7f1ebb11 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.506781 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e460c-a00a-486c-8a3e-b93f7f1ebb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.507254 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e460c-a00a-486c-8a3e-b93f7f1ebb11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.508331 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e460c-a00a-486c-8a3e-b93f7f1ebb11 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:45.508853 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e460c-a00a-486c-8a3e-b93f7f1ebb11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:45.510780 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e460c-a00a-486c-8a3e-b93f7f1ebb11 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:45.528942 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 74/148] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:28:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:45.535157 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bca04-0080-45d8-bcd7-16bf1864430d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:45.553185 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bca04-0080-45d8-bcd7-16bf1864430d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:45.564876 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a33650-6046-4a27-9e37-4f0c720b01d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:45.565779 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a33650-6046-4a27-9e37-4f0c720b01d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.566068 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a33650-6046-4a27-9e37-4f0c720b01d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.566351 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a33650-6046-4a27-9e37-4f0c720b01d5 admin admin] PATH_INFO: `/v3/users/0e4d9d73cebf4ad3a98486b7af465c46` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.567725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a33650-6046-4a27-9e37-4f0c720b01d5 admin admin] RBAC: Authorizing `identity:get_user(user_id=0e4d9d73cebf4ad3a98486b7af465c46)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:45.569966 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a33650-6046-4a27-9e37-4f0c720b01d5 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:45.571680 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 75/149] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:45 2022] GET /identity/v3/users/0e4d9d73cebf4ad3a98486b7af465c46 => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:45.577196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e460c-a00a-486c-8a3e-b93f7f1ebb11 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:45.588794 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e460c-a00a-486c-8a3e-b93f7f1ebb11 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:45.600349 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24daa91-a0a6-44ba-8cd6-83814e2b9272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:45.601531 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24daa91-a0a6-44ba-8cd6-83814e2b9272 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.602027 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24daa91-a0a6-44ba-8cd6-83814e2b9272 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.602526 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24daa91-a0a6-44ba-8cd6-83814e2b9272 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.615310 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24daa91-a0a6-44ba-8cd6-83814e2b9272 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:45.620690 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24daa91-a0a6-44ba-8cd6-83814e2b9272 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:45.634166 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 75/150] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:28:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:28:45.639563 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a33650-6046-4a27-9e37-4f0c720b01d5 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:45.655532 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a33650-6046-4a27-9e37-4f0c720b01d5 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:45.668455 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55084659-0f89-4892-bf32-09f27ddc1279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:45.669400 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55084659-0f89-4892-bf32-09f27ddc1279 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.669691 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55084659-0f89-4892-bf32-09f27ddc1279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.669974 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55084659-0f89-4892-bf32-09f27ddc1279 admin admin] PATH_INFO: `/v3/projects/eda840bd939e480a9fe86cc56ce668b2` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.671348 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55084659-0f89-4892-bf32-09f27ddc1279 admin admin] RBAC: Authorizing `identity:get_project(project_id=eda840bd939e480a9fe86cc56ce668b2)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:45.673562 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55084659-0f89-4892-bf32-09f27ddc1279 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:45.675454 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 76/151] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:45 2022] GET /identity/v3/projects/eda840bd939e480a9fe86cc56ce668b2 => generated 312 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:45.681514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24daa91-a0a6-44ba-8cd6-83814e2b9272 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:45.697024 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24daa91-a0a6-44ba-8cd6-83814e2b9272 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:45.701561 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd0b27-60e6-41c3-a7bc-7a7f18d47273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:45.702231 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd0b27-60e6-41c3-a7bc-7a7f18d47273 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.702509 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd0b27-60e6-41c3-a7bc-7a7f18d47273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.702783 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd0b27-60e6-41c3-a7bc-7a7f18d47273 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.703626 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd0b27-60e6-41c3-a7bc-7a7f18d47273 admin admin] RBAC: Adding query filter params (role.id=c5c492cc34274d1db36b946b78fa47d7, scope.project.id=eda840bd939e480a9fe86cc56ce668b2, user.id=0e4d9d73cebf4ad3a98486b7af465c46) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:45.703961 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd0b27-60e6-41c3-a7bc-7a7f18d47273 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:45.706567 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389d6d3-54cc-4677-afad-75987a8a43cb None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.706858 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389d6d3-54cc-4677-afad-75987a8a43cb None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.707185 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389d6d3-54cc-4677-afad-75987a8a43cb None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.707284 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd0b27-60e6-41c3-a7bc-7a7f18d47273 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:45.708979 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 77/152] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:45.714398 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b45da-64e4-452b-80de-9a79a53fef62 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.714692 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b45da-64e4-452b-80de-9a79a53fef62 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.714978 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b45da-64e4-452b-80de-9a79a53fef62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.721771 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 76/153] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:28:45 2022] GET /identity/v3/role_assignments?user.id=0e4d9d73cebf4ad3a98486b7af465c46&scope.project.id=eda840bd939e480a9fe86cc56ce668b2&role.id=c5c492cc34274d1db36b946b78fa47d7 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:45.748875 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-5c3b45da-64e4-452b-80de-9a79a53fef62 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:45.750114 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5c3b45da-64e4-452b-80de-9a79a53fef62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:45.764649 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 78/154] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:28:45.793163 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd0b27-60e6-41c3-a7bc-7a7f18d47273 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:45.809715 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd0b27-60e6-41c3-a7bc-7a7f18d47273 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:45.815138 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544e25a-fb2a-4731-8058-3a4a48018436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:45.816090 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544e25a-fb2a-4731-8058-3a4a48018436 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.816378 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544e25a-fb2a-4731-8058-3a4a48018436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.816643 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544e25a-fb2a-4731-8058-3a4a48018436 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.840595 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544e25a-fb2a-4731-8058-3a4a48018436 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:45.849196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-c544e25a-fb2a-4731-8058-3a4a48018436 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 08 16:28:45.850463 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 77/155] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:28:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:45.856322 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b45da-64e4-452b-80de-9a79a53fef62 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:45.870272 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b45da-64e4-452b-80de-9a79a53fef62 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:45.881495 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c98a3b-9b41-4a74-bf8a-1c726561a721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:45.882260 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c98a3b-9b41-4a74-bf8a-1c726561a721 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.882559 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c98a3b-9b41-4a74-bf8a-1c726561a721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.882840 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c98a3b-9b41-4a74-bf8a-1c726561a721 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.883624 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c98a3b-9b41-4a74-bf8a-1c726561a721 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:45.883955 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c98a3b-9b41-4a74-bf8a-1c726561a721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:45.885641 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c98a3b-9b41-4a74-bf8a-1c726561a721 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:45.899237 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 79/156] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:28:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:45.904884 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544e25a-fb2a-4731-8058-3a4a48018436 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:45.918335 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544e25a-fb2a-4731-8058-3a4a48018436 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:45.922916 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24903fe8-69d7-4994-aaa0-d4b355ff7063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:45.924217 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24903fe8-69d7-4994-aaa0-d4b355ff7063 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.924600 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24903fe8-69d7-4994-aaa0-d4b355ff7063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.924881 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24903fe8-69d7-4994-aaa0-d4b355ff7063 admin admin] PATH_INFO: `/v3/users/0e4d9d73cebf4ad3a98486b7af465c46` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.926183 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24903fe8-69d7-4994-aaa0-d4b355ff7063 admin admin] RBAC: Authorizing `identity:get_user(user_id=0e4d9d73cebf4ad3a98486b7af465c46)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:45.928498 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24903fe8-69d7-4994-aaa0-d4b355ff7063 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:45.930238 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 78/157] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:45 2022] GET /identity/v3/users/0e4d9d73cebf4ad3a98486b7af465c46 => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:45.936017 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c98a3b-9b41-4a74-bf8a-1c726561a721 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:45.953216 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c98a3b-9b41-4a74-bf8a-1c726561a721 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:45.964255 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744616ef-dcfe-43e1-a527-19bbbe9d029c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:45.964934 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744616ef-dcfe-43e1-a527-19bbbe9d029c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:45.965214 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744616ef-dcfe-43e1-a527-19bbbe9d029c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:45.965488 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744616ef-dcfe-43e1-a527-19bbbe9d029c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:45.980876 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744616ef-dcfe-43e1-a527-19bbbe9d029c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:45.982672 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744616ef-dcfe-43e1-a527-19bbbe9d029c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:45.996291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 80/158] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:28:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:28:46.002173 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24903fe8-69d7-4994-aaa0-d4b355ff7063 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:46.018836 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24903fe8-69d7-4994-aaa0-d4b355ff7063 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:46.024719 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5052094-7ced-4601-816d-88115dab7beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:46.025615 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5052094-7ced-4601-816d-88115dab7beb admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:46.025900 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5052094-7ced-4601-816d-88115dab7beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:46.026171 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5052094-7ced-4601-816d-88115dab7beb admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:46.027366 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5052094-7ced-4601-816d-88115dab7beb admin admin] RBAC: Authorizing `identity:get_project(project_id=67f1c5c4abff46008cee0510849c586e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:46.033523 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5052094-7ced-4601-816d-88115dab7beb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:46.035615 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 79/159] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:46 2022] GET /identity/v3/projects/67f1c5c4abff46008cee0510849c586e => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:46.041702 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744616ef-dcfe-43e1-a527-19bbbe9d029c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:46.053465 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744616ef-dcfe-43e1-a527-19bbbe9d029c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:46.058150 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d299013-223a-4b74-a79d-87d0e7bf0b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:46.058712 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d299013-223a-4b74-a79d-87d0e7bf0b99 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:46.058990 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d299013-223a-4b74-a79d-87d0e7bf0b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:46.059264 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d299013-223a-4b74-a79d-87d0e7bf0b99 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:46.060210 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d299013-223a-4b74-a79d-87d0e7bf0b99 admin admin] RBAC: Adding query filter params (role.id=519f10f80fbd4e108392697b77c2178a, scope.project.id=67f1c5c4abff46008cee0510849c586e, user.id=0e4d9d73cebf4ad3a98486b7af465c46) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:46.060620 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d299013-223a-4b74-a79d-87d0e7bf0b99 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:46.062524 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d299013-223a-4b74-a79d-87d0e7bf0b99 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:46.069795 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 81/160] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:28:46 2022] GET /identity/v3/role_assignments?user.id=0e4d9d73cebf4ad3a98486b7af465c46&scope.project.id=67f1c5c4abff46008cee0510849c586e&role.id=519f10f80fbd4e108392697b77c2178a => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:46.310462 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62b3a6-6733-4bac-bedc-4fd5c8db1df8 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:46.310991 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62b3a6-6733-4bac-bedc-4fd5c8db1df8 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:46.310991 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62b3a6-6733-4bac-bedc-4fd5c8db1df8 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:46.312793 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 80/161] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:46.319043 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbd12f-efe3-43a9-a54f-9654b2de73b1 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:46.319486 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbd12f-efe3-43a9-a54f-9654b2de73b1 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:46.319665 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbd12f-efe3-43a9-a54f-9654b2de73b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:46.340976 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-98dbd12f-efe3-43a9-a54f-9654b2de73b1 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:46.342139 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-98dbd12f-efe3-43a9-a54f-9654b2de73b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:46.351470 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 82/162] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:46.374863 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62b3a6-6733-4bac-bedc-4fd5c8db1df8 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:46.386802 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62b3a6-6733-4bac-bedc-4fd5c8db1df8 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:46.390928 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ae0cb-5d9e-47f1-98d6-0ee3abb1f536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:46.391689 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ae0cb-5d9e-47f1-98d6-0ee3abb1f536 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:46.392496 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ae0cb-5d9e-47f1-98d6-0ee3abb1f536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:46.393003 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ae0cb-5d9e-47f1-98d6-0ee3abb1f536 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:46.402961 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ae0cb-5d9e-47f1-98d6-0ee3abb1f536 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:46.410346 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-962ae0cb-5d9e-47f1-98d6-0ee3abb1f536 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:28:46.411657 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 81/163] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:28:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:46.416994 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbd12f-efe3-43a9-a54f-9654b2de73b1 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:46.426058 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbd12f-efe3-43a9-a54f-9654b2de73b1 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:46.430289 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacafb98-ce9e-4db6-b6dc-2f193dfa9ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:46.430934 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacafb98-ce9e-4db6-b6dc-2f193dfa9ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:46.431211 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacafb98-ce9e-4db6-b6dc-2f193dfa9ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:46.431482 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacafb98-ce9e-4db6-b6dc-2f193dfa9ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:46.432269 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacafb98-ce9e-4db6-b6dc-2f193dfa9ff6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:46.432615 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacafb98-ce9e-4db6-b6dc-2f193dfa9ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:46.434195 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacafb98-ce9e-4db6-b6dc-2f193dfa9ff6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:46.443007 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 83/164] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:46.448370 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ae0cb-5d9e-47f1-98d6-0ee3abb1f536 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:46.459169 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ae0cb-5d9e-47f1-98d6-0ee3abb1f536 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:46.463652 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51618a2-8f50-4a5d-bbb4-dc37c313a365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:46.464723 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51618a2-8f50-4a5d-bbb4-dc37c313a365 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:46.465104 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51618a2-8f50-4a5d-bbb4-dc37c313a365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:46.465479 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51618a2-8f50-4a5d-bbb4-dc37c313a365 admin admin] PATH_INFO: `/v3/users/3e3abf5e1906480a9a6c24bfbb2057a5` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:46.466774 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51618a2-8f50-4a5d-bbb4-dc37c313a365 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e3abf5e1906480a9a6c24bfbb2057a5)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:46.468733 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51618a2-8f50-4a5d-bbb4-dc37c313a365 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:46.470736 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 82/165] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:46 2022] GET /identity/v3/users/3e3abf5e1906480a9a6c24bfbb2057a5 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:46.475935 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacafb98-ce9e-4db6-b6dc-2f193dfa9ff6 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:46.485472 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacafb98-ce9e-4db6-b6dc-2f193dfa9ff6 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:46.489932 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4eb12-88a7-4162-8fca-eabaf87b32f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:46.490568 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4eb12-88a7-4162-8fca-eabaf87b32f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:46.490850 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4eb12-88a7-4162-8fca-eabaf87b32f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:46.491123 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4eb12-88a7-4162-8fca-eabaf87b32f2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:46.498943 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4eb12-88a7-4162-8fca-eabaf87b32f2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:46.500812 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4eb12-88a7-4162-8fca-eabaf87b32f2 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:46.510110 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 84/166] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:28:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:28:46.515419 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51618a2-8f50-4a5d-bbb4-dc37c313a365 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:46.526910 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51618a2-8f50-4a5d-bbb4-dc37c313a365 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:46.531411 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840b88c-01a0-4a1b-b986-660343f8d6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:46.532331 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840b88c-01a0-4a1b-b986-660343f8d6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:46.532683 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840b88c-01a0-4a1b-b986-660343f8d6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:46.533163 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840b88c-01a0-4a1b-b986-660343f8d6f9 admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:46.534779 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840b88c-01a0-4a1b-b986-660343f8d6f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=67f1c5c4abff46008cee0510849c586e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:46.537319 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840b88c-01a0-4a1b-b986-660343f8d6f9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:46.539465 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 83/167] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:46 2022] GET /identity/v3/projects/67f1c5c4abff46008cee0510849c586e => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:46.545695 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4eb12-88a7-4162-8fca-eabaf87b32f2 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:46.555409 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4eb12-88a7-4162-8fca-eabaf87b32f2 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:46.560000 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1f5b4-a02b-4009-ac6c-57e7b41839bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:46.560593 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1f5b4-a02b-4009-ac6c-57e7b41839bf admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:46.560863 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1f5b4-a02b-4009-ac6c-57e7b41839bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:46.561140 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1f5b4-a02b-4009-ac6c-57e7b41839bf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:46.561984 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1f5b4-a02b-4009-ac6c-57e7b41839bf admin admin] RBAC: Adding query filter params (role.id=e6d18df5c4e74dfd8ebd9c636f45936e, scope.project.id=67f1c5c4abff46008cee0510849c586e, user.id=3e3abf5e1906480a9a6c24bfbb2057a5) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:46.562298 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1f5b4-a02b-4009-ac6c-57e7b41839bf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:46.564719 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1f5b4-a02b-4009-ac6c-57e7b41839bf admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:46.571186 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 85/168] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:28:46 2022] GET /identity/v3/role_assignments?user.id=3e3abf5e1906480a9a6c24bfbb2057a5&scope.project.id=67f1c5c4abff46008cee0510849c586e&role.id=e6d18df5c4e74dfd8ebd9c636f45936e => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:46.809093 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efe9d5-8f9f-4533-9318-41eddba80f01 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:46.809375 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efe9d5-8f9f-4533-9318-41eddba80f01 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:46.809647 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efe9d5-8f9f-4533-9318-41eddba80f01 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:46.811462 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 84/169] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:46.816981 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb20fa-d52c-4977-b928-a27b159e8096 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:46.817288 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb20fa-d52c-4977-b928-a27b159e8096 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:46.817569 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb20fa-d52c-4977-b928-a27b159e8096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:46.835583 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-62bb20fa-d52c-4977-b928-a27b159e8096 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:46.836805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-62bb20fa-d52c-4977-b928-a27b159e8096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:46.844242 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 86/170] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:46.868552 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efe9d5-8f9f-4533-9318-41eddba80f01 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:46.880910 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efe9d5-8f9f-4533-9318-41eddba80f01 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:46.885102 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5b3cc-2c9a-4319-9d59-a78aa1c925df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:46.885873 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5b3cc-2c9a-4319-9d59-a78aa1c925df admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:46.886151 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5b3cc-2c9a-4319-9d59-a78aa1c925df admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:46.886424 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5b3cc-2c9a-4319-9d59-a78aa1c925df admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:46.897331 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5b3cc-2c9a-4319-9d59-a78aa1c925df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:46.904158 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-54f5b3cc-2c9a-4319-9d59-a78aa1c925df admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 08 16:28:46.905374 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 85/171] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:46.912164 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb20fa-d52c-4977-b928-a27b159e8096 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:46.921172 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb20fa-d52c-4977-b928-a27b159e8096 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:46.926305 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dd569-cd0d-441e-93b7-883b58564064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:46.927043 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dd569-cd0d-441e-93b7-883b58564064 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:46.927323 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dd569-cd0d-441e-93b7-883b58564064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:46.927597 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dd569-cd0d-441e-93b7-883b58564064 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:46.928397 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864dd569-cd0d-441e-93b7-883b58564064 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:46.928704 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864dd569-cd0d-441e-93b7-883b58564064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:46.930301 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864dd569-cd0d-441e-93b7-883b58564064 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:46.939558 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 87/172] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:28:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:46.945041 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5b3cc-2c9a-4319-9d59-a78aa1c925df admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:46.955214 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5b3cc-2c9a-4319-9d59-a78aa1c925df admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:46.959439 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78514f1b-48f2-42cb-933a-d873673e26aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:46.960308 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78514f1b-48f2-42cb-933a-d873673e26aa admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:46.960591 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78514f1b-48f2-42cb-933a-d873673e26aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:46.960865 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78514f1b-48f2-42cb-933a-d873673e26aa admin admin] PATH_INFO: `/v3/users/d7dd6c7bf40e4e50b79517e8b347696b` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:46.962053 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78514f1b-48f2-42cb-933a-d873673e26aa admin admin] RBAC: Authorizing `identity:get_user(user_id=d7dd6c7bf40e4e50b79517e8b347696b)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:46.964208 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78514f1b-48f2-42cb-933a-d873673e26aa admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:46.965762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 86/173] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:46 2022] GET /identity/v3/users/d7dd6c7bf40e4e50b79517e8b347696b => generated 289 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:46.971881 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dd569-cd0d-441e-93b7-883b58564064 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:46.981415 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dd569-cd0d-441e-93b7-883b58564064 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:46.985668 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0f6f2-c596-430b-a761-b28fa22a9edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:46.986889 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0f6f2-c596-430b-a761-b28fa22a9edf admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:46.987171 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0f6f2-c596-430b-a761-b28fa22a9edf admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:46.987447 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0f6f2-c596-430b-a761-b28fa22a9edf admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:46.988675 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0f6f2-c596-430b-a761-b28fa22a9edf admin admin] RBAC: Authorizing `identity:get_project(project_id=67f1c5c4abff46008cee0510849c586e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:46.990750 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0f6f2-c596-430b-a761-b28fa22a9edf admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:46.992585 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 88/174] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:46 2022] GET /identity/v3/projects/67f1c5c4abff46008cee0510849c586e => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:46.998333 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78514f1b-48f2-42cb-933a-d873673e26aa admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:47.009034 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78514f1b-48f2-42cb-933a-d873673e26aa admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:47.013682 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281e17a-6b5f-48a0-8271-b43d11ee3a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:47.014584 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281e17a-6b5f-48a0-8271-b43d11ee3a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:47.014864 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281e17a-6b5f-48a0-8271-b43d11ee3a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:47.015137 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281e17a-6b5f-48a0-8271-b43d11ee3a4d admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e/users/d7dd6c7bf40e4e50b79517e8b347696b/roles/0d13cea753d5416bb8e71bf1e19fe7d9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:47.018091 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281e17a-6b5f-48a0-8271-b43d11ee3a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f1c5c4abff46008cee0510849c586e, user_id=d7dd6c7bf40e4e50b79517e8b347696b, role_id=0d13cea753d5416bb8e71bf1e19fe7d9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:47.020757 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281e17a-6b5f-48a0-8271-b43d11ee3a4d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:47.035015 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 87/175] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:28:46 2022] PUT /identity/v3/projects/67f1c5c4abff46008cee0510849c586e/users/d7dd6c7bf40e4e50b79517e8b347696b/roles/0d13cea753d5416bb8e71bf1e19fe7d9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:28:47.286870 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0bc9f-0837-44de-a917-66b44b14aa26 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:47.287084 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0bc9f-0837-44de-a917-66b44b14aa26 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:47.287363 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0bc9f-0837-44de-a917-66b44b14aa26 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:47.289231 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 89/176] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:47.294498 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56777f-8ff6-4a01-9825-1032f7c48552 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:47.294788 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56777f-8ff6-4a01-9825-1032f7c48552 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:47.295067 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56777f-8ff6-4a01-9825-1032f7c48552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:47.313418 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-dd56777f-8ff6-4a01-9825-1032f7c48552 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:47.315254 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-dd56777f-8ff6-4a01-9825-1032f7c48552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:47.371287 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 88/177] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:47.398023 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0bc9f-0837-44de-a917-66b44b14aa26 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:47.410182 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0bc9f-0837-44de-a917-66b44b14aa26 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:47.414462 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647506da-c6b5-413a-9252-dbfc6616c64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:47.415229 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647506da-c6b5-413a-9252-dbfc6616c64f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:47.415512 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647506da-c6b5-413a-9252-dbfc6616c64f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:47.415813 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647506da-c6b5-413a-9252-dbfc6616c64f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:47.417059 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647506da-c6b5-413a-9252-dbfc6616c64f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:47.418719 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647506da-c6b5-413a-9252-dbfc6616c64f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:47.420317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 90/178] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:28:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:47.425806 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56777f-8ff6-4a01-9825-1032f7c48552 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:47.434617 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56777f-8ff6-4a01-9825-1032f7c48552 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:47.439486 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67d229-e912-422a-9bec-2becef4c3b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:47.440207 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67d229-e912-422a-9bec-2becef4c3b4e admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:47.440485 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67d229-e912-422a-9bec-2becef4c3b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:47.440757 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67d229-e912-422a-9bec-2becef4c3b4e admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:47.441481 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67d229-e912-422a-9bec-2becef4c3b4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:47.443410 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67d229-e912-422a-9bec-2becef4c3b4e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:47.463984 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 89/179] 10.222.0.35 () {60 vars in 1153 bytes} [Tue Feb 8 16:28:47 2022] POST /identity/v3/users => generated 283 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:28:49.290935 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f1a0e-c237-4b59-b17e-f9861a611b57 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:49.291465 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f1a0e-c237-4b59-b17e-f9861a611b57 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:49.291465 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f1a0e-c237-4b59-b17e-f9861a611b57 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:49.293293 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 91/180] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:49.299217 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed6ded-991c-4578-852a-3b4134aac296 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:49.299837 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed6ded-991c-4578-852a-3b4134aac296 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:49.299837 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed6ded-991c-4578-852a-3b4134aac296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:49.318154 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-4bed6ded-991c-4578-852a-3b4134aac296 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:49.319350 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4bed6ded-991c-4578-852a-3b4134aac296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:49.327046 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 90/181] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:49.351654 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f1a0e-c237-4b59-b17e-f9861a611b57 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:49.364813 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f1a0e-c237-4b59-b17e-f9861a611b57 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:49.369278 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718aa334-fab4-4c25-a08e-50be26ee0988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:49.370169 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718aa334-fab4-4c25-a08e-50be26ee0988 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:49.370548 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718aa334-fab4-4c25-a08e-50be26ee0988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:49.370920 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718aa334-fab4-4c25-a08e-50be26ee0988 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:49.382929 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718aa334-fab4-4c25-a08e-50be26ee0988 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:49.389793 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-718aa334-fab4-4c25-a08e-50be26ee0988 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 08 16:28:49.391303 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 92/182] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:49.396915 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed6ded-991c-4578-852a-3b4134aac296 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:49.405859 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed6ded-991c-4578-852a-3b4134aac296 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:49.410448 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a81a3-8740-4281-be5c-67ccd83bd59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:49.411102 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a81a3-8740-4281-be5c-67ccd83bd59b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:49.411381 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a81a3-8740-4281-be5c-67ccd83bd59b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:49.411653 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a81a3-8740-4281-be5c-67ccd83bd59b admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:49.412448 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a81a3-8740-4281-be5c-67ccd83bd59b admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:49.412749 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a81a3-8740-4281-be5c-67ccd83bd59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:49.414357 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a81a3-8740-4281-be5c-67ccd83bd59b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:49.423553 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 91/183] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:28:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:49.429368 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718aa334-fab4-4c25-a08e-50be26ee0988 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:49.440537 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718aa334-fab4-4c25-a08e-50be26ee0988 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:49.445079 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd27559-9ad8-4533-86aa-8ec8553d18fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:49.445934 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd27559-9ad8-4533-86aa-8ec8553d18fc admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:49.446213 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd27559-9ad8-4533-86aa-8ec8553d18fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:49.446487 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd27559-9ad8-4533-86aa-8ec8553d18fc admin admin] PATH_INFO: `/v3/users/d7dd6c7bf40e4e50b79517e8b347696b` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:49.447699 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd27559-9ad8-4533-86aa-8ec8553d18fc admin admin] RBAC: Authorizing `identity:get_user(user_id=d7dd6c7bf40e4e50b79517e8b347696b)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:49.449847 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd27559-9ad8-4533-86aa-8ec8553d18fc admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:49.451453 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 93/184] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:49 2022] GET /identity/v3/users/d7dd6c7bf40e4e50b79517e8b347696b => generated 289 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:49.456932 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a81a3-8740-4281-be5c-67ccd83bd59b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:49.466667 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a81a3-8740-4281-be5c-67ccd83bd59b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:49.472510 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87fef0-7b15-46de-aff6-a1878464c721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:49.473630 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87fef0-7b15-46de-aff6-a1878464c721 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:49.474025 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87fef0-7b15-46de-aff6-a1878464c721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:49.474304 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87fef0-7b15-46de-aff6-a1878464c721 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:49.482700 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87fef0-7b15-46de-aff6-a1878464c721 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:49.484490 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87fef0-7b15-46de-aff6-a1878464c721 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:49.494292 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 92/185] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:28:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:28:49.499602 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd27559-9ad8-4533-86aa-8ec8553d18fc admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:49.509972 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd27559-9ad8-4533-86aa-8ec8553d18fc admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:49.514444 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e079fb5-a126-4577-a5bd-91dae5da042c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:49.515281 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e079fb5-a126-4577-a5bd-91dae5da042c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:49.515560 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e079fb5-a126-4577-a5bd-91dae5da042c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:49.515868 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e079fb5-a126-4577-a5bd-91dae5da042c admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:49.518143 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e079fb5-a126-4577-a5bd-91dae5da042c admin admin] RBAC: Authorizing `identity:get_project(project_id=67f1c5c4abff46008cee0510849c586e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:49.520250 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e079fb5-a126-4577-a5bd-91dae5da042c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:49.522100 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 94/186] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:49 2022] GET /identity/v3/projects/67f1c5c4abff46008cee0510849c586e => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:49.527783 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87fef0-7b15-46de-aff6-a1878464c721 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:49.537973 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87fef0-7b15-46de-aff6-a1878464c721 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:49.548312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1819ca-eaa2-4fed-891d-a08df242c7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:49.548312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1819ca-eaa2-4fed-891d-a08df242c7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:49.548312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1819ca-eaa2-4fed-891d-a08df242c7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:49.548312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1819ca-eaa2-4fed-891d-a08df242c7c3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:49.548725 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1819ca-eaa2-4fed-891d-a08df242c7c3 admin admin] RBAC: Adding query filter params (role.id=0d13cea753d5416bb8e71bf1e19fe7d9, scope.project.id=67f1c5c4abff46008cee0510849c586e, user.id=d7dd6c7bf40e4e50b79517e8b347696b) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:49.548725 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1819ca-eaa2-4fed-891d-a08df242c7c3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:49.548725 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1819ca-eaa2-4fed-891d-a08df242c7c3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:49.555051 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 93/187] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:28:49 2022] GET /identity/v3/role_assignments?user.id=d7dd6c7bf40e4e50b79517e8b347696b&scope.project.id=67f1c5c4abff46008cee0510849c586e&role.id=0d13cea753d5416bb8e71bf1e19fe7d9 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:49.902228 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74872eb2-a068-47fa-be19-7b55783a0f99 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:49.902526 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74872eb2-a068-47fa-be19-7b55783a0f99 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:49.902941 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74872eb2-a068-47fa-be19-7b55783a0f99 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:49.904925 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 95/188] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:49.911062 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef66cc3-d581-4a5f-9c37-100b6191b46a None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:49.911352 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef66cc3-d581-4a5f-9c37-100b6191b46a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:49.911955 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef66cc3-d581-4a5f-9c37-100b6191b46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:49.930544 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-8ef66cc3-d581-4a5f-9c37-100b6191b46a None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:49.931727 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-8ef66cc3-d581-4a5f-9c37-100b6191b46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:49.940230 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 94/189] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:49.964169 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74872eb2-a068-47fa-be19-7b55783a0f99 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:49.976346 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74872eb2-a068-47fa-be19-7b55783a0f99 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:49.980582 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb6b77-7132-4b1d-a8e0-4444e07612e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:49.981356 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb6b77-7132-4b1d-a8e0-4444e07612e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:49.981636 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb6b77-7132-4b1d-a8e0-4444e07612e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:49.981909 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb6b77-7132-4b1d-a8e0-4444e07612e8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:49.990676 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d5bd1-93d0-43dd-9c1b-8503e3ddfeb0 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:49.990961 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d5bd1-93d0-43dd-9c1b-8503e3ddfeb0 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:49.991230 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d5bd1-93d0-43dd-9c1b-8503e3ddfeb0 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:49.993124 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 95/190] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:28:49.993286 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb6b77-7132-4b1d-a8e0-4444e07612e8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:49.997771 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e680bfc-423a-4a4d-8f3c-56f9c062b336 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:49.998053 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e680bfc-423a-4a4d-8f3c-56f9c062b336 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:49.998324 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e680bfc-423a-4a4d-8f3c-56f9c062b336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:50.000188 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-81cb6b77-7132-4b1d-a8e0-4444e07612e8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:28:50.002187 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 96/191] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:28:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:28:50.007780 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb6b77-7132-4b1d-a8e0-4444e07612e8 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:50.017446 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-7e680bfc-423a-4a4d-8f3c-56f9c062b336 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:50.018723 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb6b77-7132-4b1d-a8e0-4444e07612e8 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:50.018914 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7e680bfc-423a-4a4d-8f3c-56f9c062b336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:50.023024 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d4c08-45a2-4cd1-b2af-84fe13d164ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:50.023671 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d4c08-45a2-4cd1-b2af-84fe13d164ba admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:50.023992 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d4c08-45a2-4cd1-b2af-84fe13d164ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:50.024268 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d4c08-45a2-4cd1-b2af-84fe13d164ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:50.025032 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d4c08-45a2-4cd1-b2af-84fe13d164ba admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:50.025337 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d4c08-45a2-4cd1-b2af-84fe13d164ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:50.026425 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 96/192] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:28:50.026950 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d4c08-45a2-4cd1-b2af-84fe13d164ba admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:50.029753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4801ed-93fb-4782-a262-c2808e3a9f2b None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:50.030225 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4801ed-93fb-4782-a262-c2808e3a9f2b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:50.030675 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4801ed-93fb-4782-a262-c2808e3a9f2b None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:50.034009 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 97/193] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:50.038938 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02e39a-1777-4242-9f2b-b885811f8040 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:50.039834 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 97/194] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:50.040130 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02e39a-1777-4242-9f2b-b885811f8040 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:50.040415 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02e39a-1777-4242-9f2b-b885811f8040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:50.044768 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d4c08-45a2-4cd1-b2af-84fe13d164ba admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:50.056144 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d4c08-45a2-4cd1-b2af-84fe13d164ba admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:50.059523 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-1d02e39a-1777-4242-9f2b-b885811f8040 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:50.060434 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57620ca2-7170-48c5-8cd5-46cfe48161c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:50.060730 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1d02e39a-1777-4242-9f2b-b885811f8040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:50.061275 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57620ca2-7170-48c5-8cd5-46cfe48161c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:50.061555 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57620ca2-7170-48c5-8cd5-46cfe48161c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:50.061826 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57620ca2-7170-48c5-8cd5-46cfe48161c8 admin admin] PATH_INFO: `/v3/users/25ca34e926e4486b8549ba14bc68a2df` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:50.068296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 98/195] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:28:50.069052 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02e39a-1777-4242-9f2b-b885811f8040 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:50.075603 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57620ca2-7170-48c5-8cd5-46cfe48161c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=25ca34e926e4486b8549ba14bc68a2df)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:50.077770 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57620ca2-7170-48c5-8cd5-46cfe48161c8 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:50.078255 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02e39a-1777-4242-9f2b-b885811f8040 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:50.080104 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 98/196] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:50 2022] GET /identity/v3/users/25ca34e926e4486b8549ba14bc68a2df => generated 283 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:50.083107 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53ad26-ade4-45a3-9dfa-8633f0a7fce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:50.083919 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53ad26-ade4-45a3-9dfa-8633f0a7fce3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:50.084200 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53ad26-ade4-45a3-9dfa-8633f0a7fce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:50.084470 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53ad26-ade4-45a3-9dfa-8633f0a7fce3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:50.085725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57620ca2-7170-48c5-8cd5-46cfe48161c8 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:50.095839 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53ad26-ade4-45a3-9dfa-8633f0a7fce3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:50.096317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57620ca2-7170-48c5-8cd5-46cfe48161c8 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:50.100553 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5700a5-7948-4671-88af-a184437a6662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:50.101168 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5700a5-7948-4671-88af-a184437a6662 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:50.101444 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5700a5-7948-4671-88af-a184437a6662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:50.101712 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5700a5-7948-4671-88af-a184437a6662 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:50.103270 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-2d53ad26-ade4-45a3-9dfa-8633f0a7fce3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 08 16:28:50.104589 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 99/197] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:28:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:50.105347 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53ad26-ade4-45a3-9dfa-8633f0a7fce3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:50.109900 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5700a5-7948-4671-88af-a184437a6662 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:50.111995 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5700a5-7948-4671-88af-a184437a6662 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:50.114728 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53ad26-ade4-45a3-9dfa-8633f0a7fce3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:50.118984 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91407f-f0d9-4189-a25a-5eeb57eadb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:50.119806 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91407f-f0d9-4189-a25a-5eeb57eadb38 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:50.120093 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91407f-f0d9-4189-a25a-5eeb57eadb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:50.120369 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91407f-f0d9-4189-a25a-5eeb57eadb38 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:50.120605 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 99/198] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:28:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 08 16:28:50.121355 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5700a5-7948-4671-88af-a184437a6662 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:50.124790 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91407f-f0d9-4189-a25a-5eeb57eadb38 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:50.126627 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91407f-f0d9-4189-a25a-5eeb57eadb38 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:50.128264 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 100/199] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:28:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:50.129922 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5700a5-7948-4671-88af-a184437a6662 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:50.132649 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91407f-f0d9-4189-a25a-5eeb57eadb38 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:50.134527 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3651cd1-bb66-436f-932f-95be885b18b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:50.135157 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3651cd1-bb66-436f-932f-95be885b18b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:50.135435 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3651cd1-bb66-436f-932f-95be885b18b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:50.135704 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3651cd1-bb66-436f-932f-95be885b18b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:50.136496 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3651cd1-bb66-436f-932f-95be885b18b8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:50.136804 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3651cd1-bb66-436f-932f-95be885b18b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:50.138772 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3651cd1-bb66-436f-932f-95be885b18b8 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:50.143986 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91407f-f0d9-4189-a25a-5eeb57eadb38 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:50.147336 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 100/200] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:28:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:50.147896 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3651cd1-bb66-436f-932f-95be885b18b8 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:50.148399 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f292e-a145-4a32-a036-fee069b98fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:50.149384 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f292e-a145-4a32-a036-fee069b98fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:50.149660 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f292e-a145-4a32-a036-fee069b98fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:50.149928 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f292e-a145-4a32-a036-fee069b98fa0 admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:50.151128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f292e-a145-4a32-a036-fee069b98fa0 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5fd242268f0468aa4fc52ba184ac9a6)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:50.153338 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f292e-a145-4a32-a036-fee069b98fa0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:50.155069 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 101/201] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:50 2022] GET /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:50.158249 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3651cd1-bb66-436f-932f-95be885b18b8 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:50.160873 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f292e-a145-4a32-a036-fee069b98fa0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:50.163342 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56decd-a403-4340-abcd-02eee739e702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:50.164023 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56decd-a403-4340-abcd-02eee739e702 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:50.164337 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56decd-a403-4340-abcd-02eee739e702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:50.164710 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56decd-a403-4340-abcd-02eee739e702 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:50.165298 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56decd-a403-4340-abcd-02eee739e702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:50.167203 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56decd-a403-4340-abcd-02eee739e702 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:50.171652 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f292e-a145-4a32-a036-fee069b98fa0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:50.177600 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06f1b6-a03e-4296-86a7-7abc550752fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:50.178965 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06f1b6-a03e-4296-86a7-7abc550752fa admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:50.179543 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06f1b6-a03e-4296-86a7-7abc550752fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:50.179954 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06f1b6-a03e-4296-86a7-7abc550752fa admin admin] PATH_INFO: `/v3/users/25ca34e926e4486b8549ba14bc68a2df` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:50.181675 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06f1b6-a03e-4296-86a7-7abc550752fa admin admin] RBAC: Authorizing `identity:get_user(user_id=25ca34e926e4486b8549ba14bc68a2df)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:50.184316 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06f1b6-a03e-4296-86a7-7abc550752fa admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:50.185938 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 102/202] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:50 2022] GET /identity/v3/users/25ca34e926e4486b8549ba14bc68a2df => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:50.185938 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06f1b6-a03e-4296-86a7-7abc550752fa admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:50.191317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 101/203] 10.222.0.35 () {60 vars in 1153 bytes} [Tue Feb 8 16:28:50 2022] POST /identity/v3/users => generated 297 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:28:50.192788 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56decd-a403-4340-abcd-02eee739e702 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:50.197204 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06f1b6-a03e-4296-86a7-7abc550752fa admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:50.202654 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35e4ec-601c-43ac-9994-cb5c4b6dddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:50.203326 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35e4ec-601c-43ac-9994-cb5c4b6dddc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:50.203519 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56decd-a403-4340-abcd-02eee739e702 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:50.203633 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35e4ec-601c-43ac-9994-cb5c4b6dddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:50.203902 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35e4ec-601c-43ac-9994-cb5c4b6dddc4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:50.205343 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35e4ec-601c-43ac-9994-cb5c4b6dddc4 admin admin] RBAC: Adding query filter params (role.id=e6d18df5c4e74dfd8ebd9c636f45936e, scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6, user.id=25ca34e926e4486b8549ba14bc68a2df) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:50.205686 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35e4ec-601c-43ac-9994-cb5c4b6dddc4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:50.207555 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35e4ec-601c-43ac-9994-cb5c4b6dddc4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:50.208920 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d109cf1-633a-4ab8-9db7-bdf0d1257e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:50.209589 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d109cf1-633a-4ab8-9db7-bdf0d1257e05 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:50.209862 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d109cf1-633a-4ab8-9db7-bdf0d1257e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:50.210139 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d109cf1-633a-4ab8-9db7-bdf0d1257e05 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:50.214407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 103/204] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:28:50 2022] GET /identity/v3/role_assignments?user.id=25ca34e926e4486b8549ba14bc68a2df&scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6&role.id=e6d18df5c4e74dfd8ebd9c636f45936e => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:50.219523 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d109cf1-633a-4ab8-9db7-bdf0d1257e05 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:50.221726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d109cf1-633a-4ab8-9db7-bdf0d1257e05 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:50.232305 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 102/205] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:28:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 08 16:28:50.238223 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35e4ec-601c-43ac-9994-cb5c4b6dddc4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:50.248912 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35e4ec-601c-43ac-9994-cb5c4b6dddc4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:50.254773 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab79f27-a95e-49f4-b851-725d311ffd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:50.255805 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab79f27-a95e-49f4-b851-725d311ffd62 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:50.256196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab79f27-a95e-49f4-b851-725d311ffd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:50.256683 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab79f27-a95e-49f4-b851-725d311ffd62 admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:50.258183 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab79f27-a95e-49f4-b851-725d311ffd62 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5fd242268f0468aa4fc52ba184ac9a6)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:50.260525 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab79f27-a95e-49f4-b851-725d311ffd62 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:50.262650 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 104/206] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:50 2022] GET /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:50.273374 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d109cf1-633a-4ab8-9db7-bdf0d1257e05 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:50.283446 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d109cf1-633a-4ab8-9db7-bdf0d1257e05 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:50.288277 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d11e2-77c0-403f-8f8c-2c881cfac87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:50.288943 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d11e2-77c0-403f-8f8c-2c881cfac87f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:50.289225 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d11e2-77c0-403f-8f8c-2c881cfac87f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:50.289498 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d11e2-77c0-403f-8f8c-2c881cfac87f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:50.290370 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d11e2-77c0-403f-8f8c-2c881cfac87f admin admin] RBAC: Adding query filter params (role.id=519f10f80fbd4e108392697b77c2178a, scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6, user.id=25ca34e926e4486b8549ba14bc68a2df) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:50.290681 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d11e2-77c0-403f-8f8c-2c881cfac87f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:50.292629 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d11e2-77c0-403f-8f8c-2c881cfac87f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:50.299651 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 103/207] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:28:50 2022] GET /identity/v3/role_assignments?user.id=25ca34e926e4486b8549ba14bc68a2df&scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6&role.id=519f10f80fbd4e108392697b77c2178a => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:52.548494 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608879e-174d-461e-b539-67551b6f2479 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.549540 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608879e-174d-461e-b539-67551b6f2479 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.550399 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608879e-174d-461e-b539-67551b6f2479 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.552421 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 105/208] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:52.558034 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aea022-0678-4c4c-a1ba-6416a9bf8a6d None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.558526 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aea022-0678-4c4c-a1ba-6416a9bf8a6d None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.558805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aea022-0678-4c4c-a1ba-6416a9bf8a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.579940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-28aea022-0678-4c4c-a1ba-6416a9bf8a6d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:52.581480 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-28aea022-0678-4c4c-a1ba-6416a9bf8a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:52.589857 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 104/209] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:52.617407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608879e-174d-461e-b539-67551b6f2479 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:52.631959 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608879e-174d-461e-b539-67551b6f2479 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:52.632621 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a140f7-cdeb-43d8-8868-c4679401710e None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.632907 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a140f7-cdeb-43d8-8868-c4679401710e None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.633183 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a140f7-cdeb-43d8-8868-c4679401710e None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.634959 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 105/210] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:28:52.637097 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21163cd-0375-4515-9bbb-04ba64893b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:52.637878 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21163cd-0375-4515-9bbb-04ba64893b84 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.638157 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21163cd-0375-4515-9bbb-04ba64893b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.638430 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21163cd-0375-4515-9bbb-04ba64893b84 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.640076 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3b269-26d5-4b0e-91c8-e4ef3717b6e9 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.640551 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3b269-26d5-4b0e-91c8-e4ef3717b6e9 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.640655 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3b269-26d5-4b0e-91c8-e4ef3717b6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.651041 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21163cd-0375-4515-9bbb-04ba64893b84 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:52.657943 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-d21163cd-0375-4515-9bbb-04ba64893b84 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:28:52.659328 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 106/211] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:28:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:52.659435 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-f6f3b269-26d5-4b0e-91c8-e4ef3717b6e9 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:52.660791 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-f6f3b269-26d5-4b0e-91c8-e4ef3717b6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:52.664766 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21163cd-0375-4515-9bbb-04ba64893b84 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:52.668764 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 106/212] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:28:52.674847 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21163cd-0375-4515-9bbb-04ba64893b84 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:52.679418 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff14486-4631-4cca-8ebd-f496069fb653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:52.679947 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff14486-4631-4cca-8ebd-f496069fb653 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.680226 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff14486-4631-4cca-8ebd-f496069fb653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.680502 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff14486-4631-4cca-8ebd-f496069fb653 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.680896 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c4bbe-774d-4de7-9099-58f773ce8c3c None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.681189 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c4bbe-774d-4de7-9099-58f773ce8c3c None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.681296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff14486-4631-4cca-8ebd-f496069fb653 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:52.681472 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c4bbe-774d-4de7-9099-58f773ce8c3c None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.681565 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff14486-4631-4cca-8ebd-f496069fb653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:52.683117 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff14486-4631-4cca-8ebd-f496069fb653 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:52.683216 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 107/213] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:28:52.689233 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0a85c-ca17-4bf7-85ac-f82e48101b34 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.689668 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0a85c-ca17-4bf7-85ac-f82e48101b34 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.690171 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0a85c-ca17-4bf7-85ac-f82e48101b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.692991 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 107/214] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:52.698746 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abeb0a-6ac0-48af-8c41-adb88fa8642e None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.699030 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abeb0a-6ac0-48af-8c41-adb88fa8642e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.699307 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abeb0a-6ac0-48af-8c41-adb88fa8642e None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.701083 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 108/215] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:52.701772 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abeb0a-6ac0-48af-8c41-adb88fa8642e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:52.709377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-66f0a85c-ca17-4bf7-85ac-f82e48101b34 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:52.710564 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-66f0a85c-ca17-4bf7-85ac-f82e48101b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:52.714082 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abeb0a-6ac0-48af-8c41-adb88fa8642e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:52.718051 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 108/216] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:28:52.718387 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2827f54-0ae3-4dd6-9fe3-2796e7609653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:52.718859 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0a85c-ca17-4bf7-85ac-f82e48101b34 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:52.719198 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2827f54-0ae3-4dd6-9fe3-2796e7609653 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.719479 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2827f54-0ae3-4dd6-9fe3-2796e7609653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.719784 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2827f54-0ae3-4dd6-9fe3-2796e7609653 admin admin] PATH_INFO: `/v3/users/25ca34e926e4486b8549ba14bc68a2df` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.721484 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2827f54-0ae3-4dd6-9fe3-2796e7609653 admin admin] RBAC: Authorizing `identity:get_user(user_id=25ca34e926e4486b8549ba14bc68a2df)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:52.723580 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2827f54-0ae3-4dd6-9fe3-2796e7609653 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:52.729526 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 109/217] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:52 2022] GET /identity/v3/users/25ca34e926e4486b8549ba14bc68a2df => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:52.729526 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceddce0-a69f-48d9-8cd0-4438169db3c6 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.729526 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceddce0-a69f-48d9-8cd0-4438169db3c6 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.729526 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceddce0-a69f-48d9-8cd0-4438169db3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.735037 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0a85c-ca17-4bf7-85ac-f82e48101b34 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:52.739737 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab4681-804b-45ef-92b9-41d239d8d95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:52.740544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab4681-804b-45ef-92b9-41d239d8d95c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.741056 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab4681-804b-45ef-92b9-41d239d8d95c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.741167 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab4681-804b-45ef-92b9-41d239d8d95c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.744770 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-3ceddce0-a69f-48d9-8cd0-4438169db3c6 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:52.745945 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3ceddce0-a69f-48d9-8cd0-4438169db3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:52.752228 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab4681-804b-45ef-92b9-41d239d8d95c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:52.754233 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 110/218] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:52.754844 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceddce0-a69f-48d9-8cd0-4438169db3c6 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:52.759148 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-85ab4681-804b-45ef-92b9-41d239d8d95c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 08 16:28:52.760615 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 109/219] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:52.763904 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab4681-804b-45ef-92b9-41d239d8d95c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:52.766208 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceddce0-a69f-48d9-8cd0-4438169db3c6 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:52.771548 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ed57f-ee12-4d5a-aee0-24a9477c7cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:52.771674 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab4681-804b-45ef-92b9-41d239d8d95c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:52.772411 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ed57f-ee12-4d5a-aee0-24a9477c7cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.772688 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ed57f-ee12-4d5a-aee0-24a9477c7cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.772957 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ed57f-ee12-4d5a-aee0-24a9477c7cb0 admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.774121 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ed57f-ee12-4d5a-aee0-24a9477c7cb0 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5fd242268f0468aa4fc52ba184ac9a6)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:52.776135 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7957f-6efb-4f76-9d56-2433b3eea367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:52.776248 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ed57f-ee12-4d5a-aee0-24a9477c7cb0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:52.776876 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7957f-6efb-4f76-9d56-2433b3eea367 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.777155 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7957f-6efb-4f76-9d56-2433b3eea367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.777428 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7957f-6efb-4f76-9d56-2433b3eea367 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.777946 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 111/220] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:52 2022] GET /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:52.780689 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ed57f-ee12-4d5a-aee0-24a9477c7cb0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:52.789042 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7957f-6efb-4f76-9d56-2433b3eea367 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:52.790719 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ed57f-ee12-4d5a-aee0-24a9477c7cb0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:52.794937 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae2d04-2b36-4524-b89b-0114a6e2145e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:52.795565 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae2d04-2b36-4524-b89b-0114a6e2145e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.795942 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae2d04-2b36-4524-b89b-0114a6e2145e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.796218 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae2d04-2b36-4524-b89b-0114a6e2145e admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.796337 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-3af7957f-6efb-4f76-9d56-2433b3eea367 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 08 16:28:52.796965 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae2d04-2b36-4524-b89b-0114a6e2145e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:52.797266 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae2d04-2b36-4524-b89b-0114a6e2145e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:52.797513 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 110/221] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:28:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:52.798916 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7957f-6efb-4f76-9d56-2433b3eea367 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:52.799795 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae2d04-2b36-4524-b89b-0114a6e2145e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:52.808037 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 112/222] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:28:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:52.808316 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7957f-6efb-4f76-9d56-2433b3eea367 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:52.809897 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae2d04-2b36-4524-b89b-0114a6e2145e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:52.812944 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d34a2-9940-46d2-8181-e57ab82cb6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:52.814474 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d34a2-9940-46d2-8181-e57ab82cb6ed admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.814852 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d34a2-9940-46d2-8181-e57ab82cb6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.815135 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d34a2-9940-46d2-8181-e57ab82cb6ed admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.816346 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d34a2-9940-46d2-8181-e57ab82cb6ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:52.818019 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d34a2-9940-46d2-8181-e57ab82cb6ed admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:52.819714 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 111/223] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:28:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:52.819844 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae2d04-2b36-4524-b89b-0114a6e2145e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:52.820409 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d34a2-9940-46d2-8181-e57ab82cb6ed admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:52.824139 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b98f2-a50b-42b1-848a-c1583c00b10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:52.824990 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b98f2-a50b-42b1-848a-c1583c00b10c admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.825271 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b98f2-a50b-42b1-848a-c1583c00b10c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.825541 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b98f2-a50b-42b1-848a-c1583c00b10c admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6/users/25ca34e926e4486b8549ba14bc68a2df/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.827503 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b98f2-a50b-42b1-848a-c1583c00b10c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5fd242268f0468aa4fc52ba184ac9a6, user_id=25ca34e926e4486b8549ba14bc68a2df, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:52.830362 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d34a2-9940-46d2-8181-e57ab82cb6ed admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:52.830761 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b98f2-a50b-42b1-848a-c1583c00b10c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:52.834631 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c80637-aaae-4aca-8475-6ce6c362d65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:52.835321 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c80637-aaae-4aca-8475-6ce6c362d65a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.835679 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c80637-aaae-4aca-8475-6ce6c362d65a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.836039 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c80637-aaae-4aca-8475-6ce6c362d65a admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.836898 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c80637-aaae-4aca-8475-6ce6c362d65a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:52.837235 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c80637-aaae-4aca-8475-6ce6c362d65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:52.838927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c80637-aaae-4aca-8475-6ce6c362d65a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:52.843358 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 113/224] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:28:52 2022] PUT /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6/users/25ca34e926e4486b8549ba14bc68a2df/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:28:52.846269 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b98f2-a50b-42b1-848a-c1583c00b10c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:52.848364 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 112/225] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:28:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:52.849173 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c80637-aaae-4aca-8475-6ce6c362d65a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:52.859081 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c80637-aaae-4aca-8475-6ce6c362d65a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:52.917169 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b98f2-a50b-42b1-848a-c1583c00b10c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:52.921867 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e6af5-3d6f-4788-9872-4f7c3917d583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:52.922753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e6af5-3d6f-4788-9872-4f7c3917d583 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.923615 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e6af5-3d6f-4788-9872-4f7c3917d583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.923963 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e6af5-3d6f-4788-9872-4f7c3917d583 admin admin] PATH_INFO: `/v3/users/46e60f873d08454fab0f7068710cc450` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.932583 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23034d-c69b-438b-9888-65538fec2caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:52.932975 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23034d-c69b-438b-9888-65538fec2caf admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.933259 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23034d-c69b-438b-9888-65538fec2caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.933536 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23034d-c69b-438b-9888-65538fec2caf admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.934358 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23034d-c69b-438b-9888-65538fec2caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:52.936330 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23034d-c69b-438b-9888-65538fec2caf admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:52.940139 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e6af5-3d6f-4788-9872-4f7c3917d583 admin admin] RBAC: Authorizing `identity:get_user(user_id=46e60f873d08454fab0f7068710cc450)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:52.942306 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e6af5-3d6f-4788-9872-4f7c3917d583 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:52.944084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 114/226] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:52 2022] GET /identity/v3/users/46e60f873d08454fab0f7068710cc450 => generated 297 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:52.949713 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e6af5-3d6f-4788-9872-4f7c3917d583 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:52.958961 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 113/227] 10.222.0.35 () {60 vars in 1153 bytes} [Tue Feb 8 16:28:52 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:28:52.960176 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23034d-c69b-438b-9888-65538fec2caf admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:52.960820 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e6af5-3d6f-4788-9872-4f7c3917d583 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:52.971863 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23034d-c69b-438b-9888-65538fec2caf admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:52.973841 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19042cd-fcca-4422-bf19-e5053f2abd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:52.974832 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19042cd-fcca-4422-bf19-e5053f2abd35 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.975237 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19042cd-fcca-4422-bf19-e5053f2abd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.975593 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19042cd-fcca-4422-bf19-e5053f2abd35 admin admin] PATH_INFO: `/v3/users/25ca34e926e4486b8549ba14bc68a2df` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.977241 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19042cd-fcca-4422-bf19-e5053f2abd35 admin admin] RBAC: Authorizing `identity:get_user(user_id=25ca34e926e4486b8549ba14bc68a2df)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:52.977853 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa941885-a403-42ab-8def-c91cf8ca3854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:52.978771 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa941885-a403-42ab-8def-c91cf8ca3854 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:52.979315 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa941885-a403-42ab-8def-c91cf8ca3854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:52.979847 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa941885-a403-42ab-8def-c91cf8ca3854 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:52.979958 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19042cd-fcca-4422-bf19-e5053f2abd35 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:52.988354 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 115/228] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:52 2022] GET /identity/v3/users/25ca34e926e4486b8549ba14bc68a2df => generated 283 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:52.990140 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19042cd-fcca-4422-bf19-e5053f2abd35 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:52.992415 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa941885-a403-42ab-8def-c91cf8ca3854 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:52.994589 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa941885-a403-42ab-8def-c91cf8ca3854 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:53.003366 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19042cd-fcca-4422-bf19-e5053f2abd35 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:53.006596 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 114/229] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:28:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:28:53.008429 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db494a2b-63b9-4c32-9ebe-0d0bb5dce6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:53.009330 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db494a2b-63b9-4c32-9ebe-0d0bb5dce6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:53.009615 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db494a2b-63b9-4c32-9ebe-0d0bb5dce6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:53.009889 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db494a2b-63b9-4c32-9ebe-0d0bb5dce6f5 admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:53.011196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db494a2b-63b9-4c32-9ebe-0d0bb5dce6f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5fd242268f0468aa4fc52ba184ac9a6)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:53.012297 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa941885-a403-42ab-8def-c91cf8ca3854 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:53.013310 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db494a2b-63b9-4c32-9ebe-0d0bb5dce6f5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:53.019782 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 116/230] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:52 2022] GET /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:53.023368 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db494a2b-63b9-4c32-9ebe-0d0bb5dce6f5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:53.033198 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa941885-a403-42ab-8def-c91cf8ca3854 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:53.037696 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db494a2b-63b9-4c32-9ebe-0d0bb5dce6f5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:53.039060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d550d-3f2c-405a-bdf4-d2692078d69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:53.040076 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d550d-3f2c-405a-bdf4-d2692078d69a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:53.040466 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d550d-3f2c-405a-bdf4-d2692078d69a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:53.040849 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d550d-3f2c-405a-bdf4-d2692078d69a admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:53.042411 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d550d-3f2c-405a-bdf4-d2692078d69a admin admin] RBAC: Authorizing `identity:get_project(project_id=d5fd242268f0468aa4fc52ba184ac9a6)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:53.042661 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205ad91-6776-4ff2-9738-aacd570190e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:53.043685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205ad91-6776-4ff2-9738-aacd570190e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:53.044013 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205ad91-6776-4ff2-9738-aacd570190e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:53.044291 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205ad91-6776-4ff2-9738-aacd570190e8 admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6/users/25ca34e926e4486b8549ba14bc68a2df/roles/519f10f80fbd4e108392697b77c2178a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:53.044522 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d550d-3f2c-405a-bdf4-d2692078d69a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:53.046769 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 115/231] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:53 2022] GET /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:53.046884 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205ad91-6776-4ff2-9738-aacd570190e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5fd242268f0468aa4fc52ba184ac9a6, user_id=25ca34e926e4486b8549ba14bc68a2df, role_id=519f10f80fbd4e108392697b77c2178a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:53.050533 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205ad91-6776-4ff2-9738-aacd570190e8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:53.053826 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d550d-3f2c-405a-bdf4-d2692078d69a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:53.067382 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d550d-3f2c-405a-bdf4-d2692078d69a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:53.070445 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 117/232] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:28:53 2022] PUT /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6/users/25ca34e926e4486b8549ba14bc68a2df/roles/519f10f80fbd4e108392697b77c2178a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:28:53.146613 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de0ac4-da0c-465a-a1f2-b13ea043e92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:53.147249 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de0ac4-da0c-465a-a1f2-b13ea043e92f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:53.147532 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de0ac4-da0c-465a-a1f2-b13ea043e92f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:53.147879 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de0ac4-da0c-465a-a1f2-b13ea043e92f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:53.148832 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de0ac4-da0c-465a-a1f2-b13ea043e92f admin admin] RBAC: Adding query filter params (role.id=c5c492cc34274d1db36b946b78fa47d7, scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6, user.id=46e60f873d08454fab0f7068710cc450) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:53.149146 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de0ac4-da0c-465a-a1f2-b13ea043e92f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:53.151138 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de0ac4-da0c-465a-a1f2-b13ea043e92f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:53.158029 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 116/233] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:28:53 2022] GET /identity/v3/role_assignments?user.id=46e60f873d08454fab0f7068710cc450&scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6&role.id=c5c492cc34274d1db36b946b78fa47d7 => generated 259 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:55.366854 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b07306-c64b-4899-a061-e307a46c8cd8 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:55.367501 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b07306-c64b-4899-a061-e307a46c8cd8 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:55.367501 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b07306-c64b-4899-a061-e307a46c8cd8 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:55.370417 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 118/234] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:55.375165 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee14d65-f9ca-4c0b-8ae0-e6e63a8a0087 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:55.375683 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee14d65-f9ca-4c0b-8ae0-e6e63a8a0087 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:55.375858 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee14d65-f9ca-4c0b-8ae0-e6e63a8a0087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:55.401029 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-9ee14d65-f9ca-4c0b-8ae0-e6e63a8a0087 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:55.402558 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-9ee14d65-f9ca-4c0b-8ae0-e6e63a8a0087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:55.417102 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 117/235] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:55.456677 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b07306-c64b-4899-a061-e307a46c8cd8 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:55.474320 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b07306-c64b-4899-a061-e307a46c8cd8 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:55.485114 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607620c3-8dee-4ff4-a27c-3a32f3621199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:55.486074 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607620c3-8dee-4ff4-a27c-3a32f3621199 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:55.486410 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607620c3-8dee-4ff4-a27c-3a32f3621199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:55.486704 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607620c3-8dee-4ff4-a27c-3a32f3621199 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:55.500283 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607620c3-8dee-4ff4-a27c-3a32f3621199 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:55.508756 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-607620c3-8dee-4ff4-a27c-3a32f3621199 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:28:55.510204 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 119/236] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:28:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:55.516413 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee14d65-f9ca-4c0b-8ae0-e6e63a8a0087 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:55.527709 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee14d65-f9ca-4c0b-8ae0-e6e63a8a0087 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:55.538382 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfca3d-c6d7-409a-8780-841eb7428a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:55.539435 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfca3d-c6d7-409a-8780-841eb7428a7f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:55.539435 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfca3d-c6d7-409a-8780-841eb7428a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:55.539729 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfca3d-c6d7-409a-8780-841eb7428a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:55.540502 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfca3d-c6d7-409a-8780-841eb7428a7f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:55.540809 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfca3d-c6d7-409a-8780-841eb7428a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:55.542860 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfca3d-c6d7-409a-8780-841eb7428a7f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:55.560331 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 118/237] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:55.566476 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607620c3-8dee-4ff4-a27c-3a32f3621199 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:55.586883 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607620c3-8dee-4ff4-a27c-3a32f3621199 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:55.597044 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43cff4-4b3c-4f48-83e6-47c4fa16e2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:55.597928 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43cff4-4b3c-4f48-83e6-47c4fa16e2bd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:55.598208 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43cff4-4b3c-4f48-83e6-47c4fa16e2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:55.598488 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43cff4-4b3c-4f48-83e6-47c4fa16e2bd admin admin] PATH_INFO: `/v3/users/25ca34e926e4486b8549ba14bc68a2df` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:55.599822 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43cff4-4b3c-4f48-83e6-47c4fa16e2bd admin admin] RBAC: Authorizing `identity:get_user(user_id=25ca34e926e4486b8549ba14bc68a2df)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:55.602027 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43cff4-4b3c-4f48-83e6-47c4fa16e2bd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:55.604175 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 120/238] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:55 2022] GET /identity/v3/users/25ca34e926e4486b8549ba14bc68a2df => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:55.611331 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfca3d-c6d7-409a-8780-841eb7428a7f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:55.627176 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfca3d-c6d7-409a-8780-841eb7428a7f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:55.640620 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66056b-e6f9-46e2-93a4-e4878cda4de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:55.642442 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66056b-e6f9-46e2-93a4-e4878cda4de4 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:55.643430 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66056b-e6f9-46e2-93a4-e4878cda4de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:55.643849 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66056b-e6f9-46e2-93a4-e4878cda4de4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:55.654751 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66056b-e6f9-46e2-93a4-e4878cda4de4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:55.656544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66056b-e6f9-46e2-93a4-e4878cda4de4 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:55.666397 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 119/239] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:28:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 08 16:28:55.672423 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43cff4-4b3c-4f48-83e6-47c4fa16e2bd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:55.689303 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43cff4-4b3c-4f48-83e6-47c4fa16e2bd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:55.699894 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f206da-f512-41a6-a0d1-a4035248db67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:55.700771 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f206da-f512-41a6-a0d1-a4035248db67 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:55.701050 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f206da-f512-41a6-a0d1-a4035248db67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:55.701322 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f206da-f512-41a6-a0d1-a4035248db67 admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:55.702553 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f206da-f512-41a6-a0d1-a4035248db67 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5fd242268f0468aa4fc52ba184ac9a6)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:55.705675 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f206da-f512-41a6-a0d1-a4035248db67 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:55.707415 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 121/240] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:55 2022] GET /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6 => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:55.713805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66056b-e6f9-46e2-93a4-e4878cda4de4 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:55.728313 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66056b-e6f9-46e2-93a4-e4878cda4de4 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:55.743805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efcd88-fe85-4b61-bd33-95510c4ce221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:55.743805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efcd88-fe85-4b61-bd33-95510c4ce221 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:55.743805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efcd88-fe85-4b61-bd33-95510c4ce221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:55.743805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efcd88-fe85-4b61-bd33-95510c4ce221 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:55.744572 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34efcd88-fe85-4b61-bd33-95510c4ce221 admin admin] RBAC: Adding query filter params (role.id=e6d18df5c4e74dfd8ebd9c636f45936e, scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6, user.id=25ca34e926e4486b8549ba14bc68a2df) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:55.744572 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34efcd88-fe85-4b61-bd33-95510c4ce221 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:55.744572 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34efcd88-fe85-4b61-bd33-95510c4ce221 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:55.752011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 120/241] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:28:55 2022] GET /identity/v3/role_assignments?user.id=25ca34e926e4486b8549ba14bc68a2df&scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6&role.id=e6d18df5c4e74dfd8ebd9c636f45936e => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:56.038960 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080e2c6-0b26-418a-8ebd-3378e4faada1 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.039297 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080e2c6-0b26-418a-8ebd-3378e4faada1 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.039469 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080e2c6-0b26-418a-8ebd-3378e4faada1 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.041685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 122/242] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:56.057680 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92774f-bb18-4ba5-932d-4e554a843460 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.058309 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92774f-bb18-4ba5-932d-4e554a843460 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.058783 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92774f-bb18-4ba5-932d-4e554a843460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.080344 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-5b92774f-bb18-4ba5-932d-4e554a843460 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:56.081859 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5b92774f-bb18-4ba5-932d-4e554a843460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:56.083874 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5787da-5d61-43b6-8b31-233be90bec3b None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.084168 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5787da-5d61-43b6-8b31-233be90bec3b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.084449 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5787da-5d61-43b6-8b31-233be90bec3b None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.086224 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 123/243] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:28:56.092401 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad30228-1f0c-4624-bb91-be7e5212bd3c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.092690 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad30228-1f0c-4624-bb91-be7e5212bd3c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.092960 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad30228-1f0c-4624-bb91-be7e5212bd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.097260 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 121/244] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:56.097764 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0798f-59fc-45ad-a9c4-3b28dfd92db0 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.098052 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0798f-59fc-45ad-a9c4-3b28dfd92db0 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.098331 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0798f-59fc-45ad-a9c4-3b28dfd92db0 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.100218 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 122/245] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:56.105067 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb57812-5378-4639-9f1f-d45d875e755d None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.105350 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb57812-5378-4639-9f1f-d45d875e755d None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.105628 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb57812-5378-4639-9f1f-d45d875e755d None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.107628 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 123/246] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:56.114061 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730c9b3-adc3-4db6-8513-e04ad9f88eb3 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.114542 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730c9b3-adc3-4db6-8513-e04ad9f88eb3 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.114761 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730c9b3-adc3-4db6-8513-e04ad9f88eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.115412 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-1ad30228-1f0c-4624-bb91-be7e5212bd3c None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:56.116660 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1ad30228-1f0c-4624-bb91-be7e5212bd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:56.126794 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 124/247] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:28:56.128393 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc576df1-5e87-466f-a642-0e3b36c997ac None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.128684 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc576df1-5e87-466f-a642-0e3b36c997ac None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.128965 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc576df1-5e87-466f-a642-0e3b36c997ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.135793 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-9730c9b3-adc3-4db6-8513-e04ad9f88eb3 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:56.136976 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-9730c9b3-adc3-4db6-8513-e04ad9f88eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:56.145023 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 124/248] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:28:56.145848 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730c9b3-adc3-4db6-8513-e04ad9f88eb3 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:56.148092 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-cc576df1-5e87-466f-a642-0e3b36c997ac None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:56.149512 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cc576df1-5e87-466f-a642-0e3b36c997ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:56.156487 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730c9b3-adc3-4db6-8513-e04ad9f88eb3 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:56.158159 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 125/249] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:56.159042 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc576df1-5e87-466f-a642-0e3b36c997ac None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:56.168554 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055a5ef-80b7-46d8-a0ca-e68210b79080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:56.169601 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc576df1-5e87-466f-a642-0e3b36c997ac None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:56.170054 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055a5ef-80b7-46d8-a0ca-e68210b79080 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.170705 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055a5ef-80b7-46d8-a0ca-e68210b79080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.171275 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055a5ef-80b7-46d8-a0ca-e68210b79080 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.175839 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668dea3-1c6b-4370-b467-ccac45de42ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:56.177035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668dea3-1c6b-4370-b467-ccac45de42ed admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.177503 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668dea3-1c6b-4370-b467-ccac45de42ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.178021 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668dea3-1c6b-4370-b467-ccac45de42ed admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.185465 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055a5ef-80b7-46d8-a0ca-e68210b79080 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:56.194209 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-d055a5ef-80b7-46d8-a0ca-e68210b79080 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 08 16:28:56.194969 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668dea3-1c6b-4370-b467-ccac45de42ed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:56.195596 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 125/250] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:56.196403 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055a5ef-80b7-46d8-a0ca-e68210b79080 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:56.202553 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-9668dea3-1c6b-4370-b467-ccac45de42ed admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 08 16:28:56.203497 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 126/251] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:56.204233 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668dea3-1c6b-4370-b467-ccac45de42ed admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:56.210190 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055a5ef-80b7-46d8-a0ca-e68210b79080 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:56.215489 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54127454-0066-459b-9569-ea38ab27ca2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:56.216260 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668dea3-1c6b-4370-b467-ccac45de42ed admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:56.216766 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54127454-0066-459b-9569-ea38ab27ca2c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.217051 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54127454-0066-459b-9569-ea38ab27ca2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.217813 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54127454-0066-459b-9569-ea38ab27ca2c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.218804 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54127454-0066-459b-9569-ea38ab27ca2c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:56.221016 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54127454-0066-459b-9569-ea38ab27ca2c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:56.221787 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a73955-a4a3-4378-b226-ae2e9fab379a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:56.223192 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 126/252] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:28:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:56.223299 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a73955-a4a3-4378-b226-ae2e9fab379a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.223299 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a73955-a4a3-4378-b226-ae2e9fab379a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.223299 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a73955-a4a3-4378-b226-ae2e9fab379a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.223485 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54127454-0066-459b-9569-ea38ab27ca2c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:56.234858 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54127454-0066-459b-9569-ea38ab27ca2c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:56.240501 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfba57a-7e96-4e7f-b926-54465e740335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:56.241145 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfba57a-7e96-4e7f-b926-54465e740335 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.241427 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfba57a-7e96-4e7f-b926-54465e740335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.241697 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfba57a-7e96-4e7f-b926-54465e740335 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.241853 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a73955-a4a3-4378-b226-ae2e9fab379a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:56.242446 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfba57a-7e96-4e7f-b926-54465e740335 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:56.242747 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfba57a-7e96-4e7f-b926-54465e740335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:56.244342 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfba57a-7e96-4e7f-b926-54465e740335 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:56.249135 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-f6a73955-a4a3-4378-b226-ae2e9fab379a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 08 16:28:56.250343 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 127/253] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:28:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:56.251669 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a73955-a4a3-4378-b226-ae2e9fab379a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:56.254723 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 127/254] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:28:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:56.255382 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfba57a-7e96-4e7f-b926-54465e740335 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:56.261069 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a73955-a4a3-4378-b226-ae2e9fab379a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:56.265503 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c609e-07e8-41a2-b9d2-cad3bb0431ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:56.266151 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c609e-07e8-41a2-b9d2-cad3bb0431ce admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.266430 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c609e-07e8-41a2-b9d2-cad3bb0431ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.267342 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c609e-07e8-41a2-b9d2-cad3bb0431ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.268333 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c609e-07e8-41a2-b9d2-cad3bb0431ce admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:56.268633 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c609e-07e8-41a2-b9d2-cad3bb0431ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:56.270226 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c609e-07e8-41a2-b9d2-cad3bb0431ce admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:56.270533 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfba57a-7e96-4e7f-b926-54465e740335 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:56.275326 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa392a33-e48c-4698-98f7-24dc44d2dcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:56.276334 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa392a33-e48c-4698-98f7-24dc44d2dcf8 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.276684 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa392a33-e48c-4698-98f7-24dc44d2dcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.277036 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa392a33-e48c-4698-98f7-24dc44d2dcf8 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.277960 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa392a33-e48c-4698-98f7-24dc44d2dcf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:56.279203 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 128/255] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:28:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:56.280020 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c609e-07e8-41a2-b9d2-cad3bb0431ce admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:56.280373 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa392a33-e48c-4698-98f7-24dc44d2dcf8 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:56.289891 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c609e-07e8-41a2-b9d2-cad3bb0431ce admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:56.294588 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bacc73-32bd-4e93-a3e3-2992c6217d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:56.295317 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bacc73-32bd-4e93-a3e3-2992c6217d06 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.295598 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bacc73-32bd-4e93-a3e3-2992c6217d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.295944 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bacc73-32bd-4e93-a3e3-2992c6217d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.296717 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bacc73-32bd-4e93-a3e3-2992c6217d06 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:56.297022 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bacc73-32bd-4e93-a3e3-2992c6217d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:56.299169 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bacc73-32bd-4e93-a3e3-2992c6217d06 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:56.312026 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 128/256] 10.222.0.35 () {60 vars in 1153 bytes} [Tue Feb 8 16:28:56 2022] POST /identity/v3/users => generated 293 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:28:56.312026 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa392a33-e48c-4698-98f7-24dc44d2dcf8 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:56.312835 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 129/257] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:28:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:56.312835 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bacc73-32bd-4e93-a3e3-2992c6217d06 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:56.322593 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bacc73-32bd-4e93-a3e3-2992c6217d06 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:56.323839 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa392a33-e48c-4698-98f7-24dc44d2dcf8 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:56.331446 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7c83a-2097-47fc-957f-a454e78e28a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:56.332389 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7c83a-2097-47fc-957f-a454e78e28a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.332623 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1186e-e979-4576-a452-3ea92ecfa580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:56.332738 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7c83a-2097-47fc-957f-a454e78e28a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.332923 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7c83a-2097-47fc-957f-a454e78e28a1 admin admin] PATH_INFO: `/v3/users/46e60f873d08454fab0f7068710cc450` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.333585 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1186e-e979-4576-a452-3ea92ecfa580 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.334056 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1186e-e979-4576-a452-3ea92ecfa580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.334400 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1186e-e979-4576-a452-3ea92ecfa580 admin admin] PATH_INFO: `/v3/users/8c968f9e13da49508fde374292fa9ec6` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.334495 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7c83a-2097-47fc-957f-a454e78e28a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=46e60f873d08454fab0f7068710cc450)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:56.336651 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7c83a-2097-47fc-957f-a454e78e28a1 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:56.338439 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 129/258] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:56 2022] GET /identity/v3/users/46e60f873d08454fab0f7068710cc450 => generated 297 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:56.343438 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7c83a-2097-47fc-957f-a454e78e28a1 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:56.353667 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1186e-e979-4576-a452-3ea92ecfa580 admin admin] RBAC: Authorizing `identity:get_user(user_id=8c968f9e13da49508fde374292fa9ec6)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:56.353905 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7c83a-2097-47fc-957f-a454e78e28a1 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:56.356093 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1186e-e979-4576-a452-3ea92ecfa580 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:56.358291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d5ea7-2627-4fd7-8f46-064f62fd0d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:56.359177 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d5ea7-2627-4fd7-8f46-064f62fd0d63 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.359461 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d5ea7-2627-4fd7-8f46-064f62fd0d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.359736 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d5ea7-2627-4fd7-8f46-064f62fd0d63 admin admin] PATH_INFO: `/v3/users/25ca34e926e4486b8549ba14bc68a2df` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.361540 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d5ea7-2627-4fd7-8f46-064f62fd0d63 admin admin] RBAC: Authorizing `identity:get_user(user_id=25ca34e926e4486b8549ba14bc68a2df)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:56.363412 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 130/259] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:56 2022] GET /identity/v3/users/8c968f9e13da49508fde374292fa9ec6 => generated 297 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:56.363741 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d5ea7-2627-4fd7-8f46-064f62fd0d63 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:56.364348 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1186e-e979-4576-a452-3ea92ecfa580 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:56.365695 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 130/260] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:56 2022] GET /identity/v3/users/25ca34e926e4486b8549ba14bc68a2df => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:56.370971 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d5ea7-2627-4fd7-8f46-064f62fd0d63 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:56.375569 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1186e-e979-4576-a452-3ea92ecfa580 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:56.382058 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d5ea7-2627-4fd7-8f46-064f62fd0d63 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:56.382800 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb66bca-fefe-4504-904f-b60fef5eaff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:56.383324 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb66bca-fefe-4504-904f-b60fef5eaff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.383662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb66bca-fefe-4504-904f-b60fef5eaff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.383976 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb66bca-fefe-4504-904f-b60fef5eaff5 admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.385288 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb66bca-fefe-4504-904f-b60fef5eaff5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5fd242268f0468aa4fc52ba184ac9a6)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:56.387472 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bae84-a332-4d7d-8384-ee288dc77ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:56.387782 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb66bca-fefe-4504-904f-b60fef5eaff5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:56.388171 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bae84-a332-4d7d-8384-ee288dc77ead admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.388643 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bae84-a332-4d7d-8384-ee288dc77ead admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.388828 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bae84-a332-4d7d-8384-ee288dc77ead admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.397418 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 131/261] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:56 2022] GET /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:56.397418 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb66bca-fefe-4504-904f-b60fef5eaff5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:56.407844 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bae84-a332-4d7d-8384-ee288dc77ead admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:56.409286 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb66bca-fefe-4504-904f-b60fef5eaff5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:56.410016 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bae84-a332-4d7d-8384-ee288dc77ead admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:56.414424 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad07a1a-64bb-468d-8aab-51c8d7bd8329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:56.415486 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad07a1a-64bb-468d-8aab-51c8d7bd8329 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.415869 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad07a1a-64bb-468d-8aab-51c8d7bd8329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.416153 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad07a1a-64bb-468d-8aab-51c8d7bd8329 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.420408 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 131/262] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:28:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:28:56.425910 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad07a1a-64bb-468d-8aab-51c8d7bd8329 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:56.426665 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bae84-a332-4d7d-8384-ee288dc77ead admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:56.427713 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad07a1a-64bb-468d-8aab-51c8d7bd8329 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:56.436696 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bae84-a332-4d7d-8384-ee288dc77ead admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:56.438013 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 132/263] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:28:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:28:56.439732 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad07a1a-64bb-468d-8aab-51c8d7bd8329 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:56.448182 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044f968-b8bb-4059-82ca-a8a5d69ea0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:56.449089 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044f968-b8bb-4059-82ca-a8a5d69ea0d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.449363 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044f968-b8bb-4059-82ca-a8a5d69ea0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.449640 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044f968-b8bb-4059-82ca-a8a5d69ea0d1 admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6/users/46e60f873d08454fab0f7068710cc450/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.450566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad07a1a-64bb-468d-8aab-51c8d7bd8329 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:56.451816 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044f968-b8bb-4059-82ca-a8a5d69ea0d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5fd242268f0468aa4fc52ba184ac9a6, user_id=46e60f873d08454fab0f7068710cc450, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:56.455087 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044f968-b8bb-4059-82ca-a8a5d69ea0d1 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:56.457134 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c4a88-203f-4c4f-a136-f1c7c36308d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:56.458118 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c4a88-203f-4c4f-a136-f1c7c36308d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.458500 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c4a88-203f-4c4f-a136-f1c7c36308d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.458986 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c4a88-203f-4c4f-a136-f1c7c36308d2 admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.460448 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c4a88-203f-4c4f-a136-f1c7c36308d2 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5fd242268f0468aa4fc52ba184ac9a6)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:56.462572 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c4a88-203f-4c4f-a136-f1c7c36308d2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:56.469930 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 133/264] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:56 2022] GET /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:56.469930 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c4a88-203f-4c4f-a136-f1c7c36308d2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:56.476048 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c4a88-203f-4c4f-a136-f1c7c36308d2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:56.476948 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 132/265] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:28:56 2022] PUT /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6/users/46e60f873d08454fab0f7068710cc450/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:28:56.477793 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044f968-b8bb-4059-82ca-a8a5d69ea0d1 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:56.557265 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8a154-3e79-4bd3-939d-a14ae8e47015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:56.558119 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8a154-3e79-4bd3-939d-a14ae8e47015 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.558399 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8a154-3e79-4bd3-939d-a14ae8e47015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.558673 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8a154-3e79-4bd3-939d-a14ae8e47015 admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.559978 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8a154-3e79-4bd3-939d-a14ae8e47015 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5fd242268f0468aa4fc52ba184ac9a6)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:56.562092 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8a154-3e79-4bd3-939d-a14ae8e47015 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:56.563491 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044f968-b8bb-4059-82ca-a8a5d69ea0d1 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:56.565583 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 134/266] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:56 2022] GET /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6 => generated 302 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:56.572168 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8a154-3e79-4bd3-939d-a14ae8e47015 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:56.574181 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2383c6-7031-4799-bf22-942064076137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:56.574856 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2383c6-7031-4799-bf22-942064076137 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.575133 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2383c6-7031-4799-bf22-942064076137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.575409 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2383c6-7031-4799-bf22-942064076137 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.576310 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2383c6-7031-4799-bf22-942064076137 admin admin] RBAC: Adding query filter params (role.id=0d13cea753d5416bb8e71bf1e19fe7d9, scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6, user.id=8c968f9e13da49508fde374292fa9ec6) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:56.576622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2383c6-7031-4799-bf22-942064076137 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:56.578547 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2383c6-7031-4799-bf22-942064076137 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:56.585956 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8a154-3e79-4bd3-939d-a14ae8e47015 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:56.586375 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 133/267] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:28:56 2022] GET /identity/v3/role_assignments?user.id=8c968f9e13da49508fde374292fa9ec6&scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6&role.id=0d13cea753d5416bb8e71bf1e19fe7d9 => generated 259 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:56.591247 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fe632-611e-4dd6-af21-ec1f5aaf9288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:56.592307 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fe632-611e-4dd6-af21-ec1f5aaf9288 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:56.592751 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fe632-611e-4dd6-af21-ec1f5aaf9288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:56.593173 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fe632-611e-4dd6-af21-ec1f5aaf9288 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:56.594191 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3fe632-611e-4dd6-af21-ec1f5aaf9288 admin admin] RBAC: Adding query filter params (role.id=519f10f80fbd4e108392697b77c2178a, scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6, user.id=25ca34e926e4486b8549ba14bc68a2df) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:56.595596 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3fe632-611e-4dd6-af21-ec1f5aaf9288 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:56.597871 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3fe632-611e-4dd6-af21-ec1f5aaf9288 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:56.605253 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 135/268] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:28:56 2022] GET /identity/v3/role_assignments?user.id=25ca34e926e4486b8549ba14bc68a2df&scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6&role.id=519f10f80fbd4e108392697b77c2178a => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:58.993704 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089af368-23e9-4f6e-9b7f-68235f07a3f8 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:58.994262 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089af368-23e9-4f6e-9b7f-68235f07a3f8 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:58.994262 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089af368-23e9-4f6e-9b7f-68235f07a3f8 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:58.996059 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 134/269] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:59.001482 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56105dc-8cf2-4d57-83d0-99b2cd1e3b1c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.001902 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56105dc-8cf2-4d57-83d0-99b2cd1e3b1c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.002125 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56105dc-8cf2-4d57-83d0-99b2cd1e3b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.020965 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-a56105dc-8cf2-4d57-83d0-99b2cd1e3b1c None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:59.022208 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a56105dc-8cf2-4d57-83d0-99b2cd1e3b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:59.029198 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac749c-e7dc-4ff5-86e9-68925b4dd4b0 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.029481 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac749c-e7dc-4ff5-86e9-68925b4dd4b0 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.029754 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac749c-e7dc-4ff5-86e9-68925b4dd4b0 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.031678 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 135/270] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:59.033055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 136/271] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:59.037275 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2592fae-5caf-4298-bfba-a5b4f739dc1f None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.037561 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2592fae-5caf-4298-bfba-a5b4f739dc1f None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.037839 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2592fae-5caf-4298-bfba-a5b4f739dc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.055860 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-b2592fae-5caf-4298-bfba-a5b4f739dc1f None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:59.057052 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-b2592fae-5caf-4298-bfba-a5b4f739dc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:59.058706 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56105dc-8cf2-4d57-83d0-99b2cd1e3b1c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:59.065731 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 136/272] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:59.070226 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56105dc-8cf2-4d57-83d0-99b2cd1e3b1c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:59.074874 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e748e0b-4819-469f-a72b-30ab76b3db73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:59.075826 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e748e0b-4819-469f-a72b-30ab76b3db73 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.076239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e748e0b-4819-469f-a72b-30ab76b3db73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.076641 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e748e0b-4819-469f-a72b-30ab76b3db73 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.088194 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e748e0b-4819-469f-a72b-30ab76b3db73 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:59.090903 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2592fae-5caf-4298-bfba-a5b4f739dc1f None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:59.096572 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-6e748e0b-4819-469f-a72b-30ab76b3db73 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 08 16:28:59.102516 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2592fae-5caf-4298-bfba-a5b4f739dc1f None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:59.102735 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 137/273] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:28:59.104056 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e748e0b-4819-469f-a72b-30ab76b3db73 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:59.105244 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cce08-a6ee-4146-94b7-3f75af7b837a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:59.106027 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cce08-a6ee-4146-94b7-3f75af7b837a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.106305 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cce08-a6ee-4146-94b7-3f75af7b837a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.106578 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cce08-a6ee-4146-94b7-3f75af7b837a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.107836 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92cce08-a6ee-4146-94b7-3f75af7b837a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:59.109523 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92cce08-a6ee-4146-94b7-3f75af7b837a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:59.112416 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 137/274] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:28:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:59.115914 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e748e0b-4819-469f-a72b-30ab76b3db73 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:59.117575 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cce08-a6ee-4146-94b7-3f75af7b837a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:59.120716 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3ae81-bc2f-447f-b81e-6643becdd64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:59.121538 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3ae81-bc2f-447f-b81e-6643becdd64a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.121954 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3ae81-bc2f-447f-b81e-6643becdd64a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.122360 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3ae81-bc2f-447f-b81e-6643becdd64a admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.123247 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3ae81-bc2f-447f-b81e-6643becdd64a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:59.123697 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3ae81-bc2f-447f-b81e-6643becdd64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:59.127287 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3ae81-bc2f-447f-b81e-6643becdd64a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:59.128110 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cce08-a6ee-4146-94b7-3f75af7b837a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:59.135445 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafd705-f4cc-406d-9080-8aaf2f234d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:59.136655 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafd705-f4cc-406d-9080-8aaf2f234d4d admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.143673 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 138/275] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:28:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:59.143867 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafd705-f4cc-406d-9080-8aaf2f234d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.143867 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafd705-f4cc-406d-9080-8aaf2f234d4d admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.143867 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafd705-f4cc-406d-9080-8aaf2f234d4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:59.143867 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafd705-f4cc-406d-9080-8aaf2f234d4d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:59.145995 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3ae81-bc2f-447f-b81e-6643becdd64a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:59.162092 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3ae81-bc2f-447f-b81e-6643becdd64a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:59.167807 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 138/276] 10.222.0.35 () {60 vars in 1153 bytes} [Tue Feb 8 16:28:59 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:28:59.170790 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f448dda-188a-41c1-b41b-ee90a30f16da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:59.171792 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f448dda-188a-41c1-b41b-ee90a30f16da admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.172082 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f448dda-188a-41c1-b41b-ee90a30f16da admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.172380 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f448dda-188a-41c1-b41b-ee90a30f16da admin admin] PATH_INFO: `/v3/users/5ce148ef42db4f07b8895046b58f51ea` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.189799 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f448dda-188a-41c1-b41b-ee90a30f16da admin admin] RBAC: Authorizing `identity:get_user(user_id=5ce148ef42db4f07b8895046b58f51ea)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:59.192408 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f448dda-188a-41c1-b41b-ee90a30f16da admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:59.194793 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 139/277] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:59 2022] GET /identity/v3/users/5ce148ef42db4f07b8895046b58f51ea => generated 293 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:59.201124 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafd705-f4cc-406d-9080-8aaf2f234d4d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:59.208772 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40710fbd-c62f-423d-bcb2-ad8982d4aa4b None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.209059 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40710fbd-c62f-423d-bcb2-ad8982d4aa4b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.209336 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40710fbd-c62f-423d-bcb2-ad8982d4aa4b None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.211368 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 140/278] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:28:59.212459 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafd705-f4cc-406d-9080-8aaf2f234d4d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:59.212987 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cf6b4-2200-4e40-bbdb-fc502eff4a27 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.213273 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cf6b4-2200-4e40-bbdb-fc502eff4a27 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.213551 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cf6b4-2200-4e40-bbdb-fc502eff4a27 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.217287 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 141/279] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:28:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:28:59.217595 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6418b79-7078-4c2c-969a-64021df8c981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:59.218253 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6418b79-7078-4c2c-969a-64021df8c981 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.218494 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260621cb-9cbf-4761-b4f9-fc1bc8a52d4f None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.218605 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6418b79-7078-4c2c-969a-64021df8c981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.218775 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260621cb-9cbf-4761-b4f9-fc1bc8a52d4f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.218891 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6418b79-7078-4c2c-969a-64021df8c981 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.219046 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260621cb-9cbf-4761-b4f9-fc1bc8a52d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.220200 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6418b79-7078-4c2c-969a-64021df8c981 admin admin] RBAC: Adding query filter params (role.id=c5c492cc34274d1db36b946b78fa47d7, user.id=5ce148ef42db4f07b8895046b58f51ea, scope.system=all) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:59.220515 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6418b79-7078-4c2c-969a-64021df8c981 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:59.222401 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6418b79-7078-4c2c-969a-64021df8c981 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:59.230618 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 139/280] 10.222.0.35 () {56 vars in 1329 bytes} [Tue Feb 8 16:28:59 2022] GET /identity/v3/role_assignments?user.id=5ce148ef42db4f07b8895046b58f51ea&scope.system=all&role.id=c5c492cc34274d1db36b946b78fa47d7 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:59.234048 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0026a0a-8cde-4fe4-8602-edb7bf70171b None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.234465 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0026a0a-8cde-4fe4-8602-edb7bf70171b None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.234818 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0026a0a-8cde-4fe4-8602-edb7bf70171b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.243112 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-260621cb-9cbf-4761-b4f9-fc1bc8a52d4f None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:59.244491 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-260621cb-9cbf-4761-b4f9-fc1bc8a52d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:59.253437 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 142/281] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:59.256957 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-b0026a0a-8cde-4fe4-8602-edb7bf70171b None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:28:59.258564 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-b0026a0a-8cde-4fe4-8602-edb7bf70171b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:28:59.268608 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 140/282] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:28:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:28:59.282865 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260621cb-9cbf-4761-b4f9-fc1bc8a52d4f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:59.292071 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0026a0a-8cde-4fe4-8602-edb7bf70171b None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:59.293632 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260621cb-9cbf-4761-b4f9-fc1bc8a52d4f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:59.298991 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4c0c2-200a-407a-8751-2d11c5780995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:59.300225 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4c0c2-200a-407a-8751-2d11c5780995 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.300762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4c0c2-200a-407a-8751-2d11c5780995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.301238 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4c0c2-200a-407a-8751-2d11c5780995 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.302346 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0026a0a-8cde-4fe4-8602-edb7bf70171b None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:59.307544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b16cb2-170d-45ed-9853-55357bf910c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:59.310647 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b16cb2-170d-45ed-9853-55357bf910c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.310734 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b16cb2-170d-45ed-9853-55357bf910c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.310985 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b16cb2-170d-45ed-9853-55357bf910c0 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.317410 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4c0c2-200a-407a-8751-2d11c5780995 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:59.324114 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b16cb2-170d-45ed-9853-55357bf910c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:28:59.326669 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-c2b4c0c2-200a-407a-8751-2d11c5780995 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 08 16:28:59.328273 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 143/283] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:28:59.333587 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-08b16cb2-170d-45ed-9853-55357bf910c0 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 08 16:28:59.333587 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 141/284] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:28:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:28:59.336041 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4c0c2-200a-407a-8751-2d11c5780995 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:59.339399 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b16cb2-170d-45ed-9853-55357bf910c0 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:59.349868 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b16cb2-170d-45ed-9853-55357bf910c0 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:59.351971 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4c0c2-200a-407a-8751-2d11c5780995 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:59.354656 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7d782-9329-451f-be10-943eec8c8311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:59.355336 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7d782-9329-451f-be10-943eec8c8311 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.355619 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7d782-9329-451f-be10-943eec8c8311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.356011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7d782-9329-451f-be10-943eec8c8311 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.358026 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7d782-9329-451f-be10-943eec8c8311 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:59.358026 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7d782-9329-451f-be10-943eec8c8311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:59.358993 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7d782-9329-451f-be10-943eec8c8311 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:59.360137 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cae5e-cc9e-49ea-9ad2-e0e4037f5f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:59.361510 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cae5e-cc9e-49ea-9ad2-e0e4037f5f44 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.362448 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cae5e-cc9e-49ea-9ad2-e0e4037f5f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.362932 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cae5e-cc9e-49ea-9ad2-e0e4037f5f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.363962 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6cae5e-cc9e-49ea-9ad2-e0e4037f5f44 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:59.364499 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6cae5e-cc9e-49ea-9ad2-e0e4037f5f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:59.367137 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6cae5e-cc9e-49ea-9ad2-e0e4037f5f44 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:59.369771 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 142/285] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:28:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:59.375575 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7d782-9329-451f-be10-943eec8c8311 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:59.382913 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 144/286] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:28:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:59.387784 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7d782-9329-451f-be10-943eec8c8311 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:59.389266 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cae5e-cc9e-49ea-9ad2-e0e4037f5f44 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:59.393893 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b85df-bd24-44d3-8449-8d3459e70b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:59.394775 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b85df-bd24-44d3-8449-8d3459e70b00 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.395057 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b85df-bd24-44d3-8449-8d3459e70b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.395904 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b85df-bd24-44d3-8449-8d3459e70b00 admin admin] PATH_INFO: `/v3/users/8c968f9e13da49508fde374292fa9ec6` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.397327 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b85df-bd24-44d3-8449-8d3459e70b00 admin admin] RBAC: Authorizing `identity:get_user(user_id=8c968f9e13da49508fde374292fa9ec6)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:59.399546 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b85df-bd24-44d3-8449-8d3459e70b00 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:59.402126 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 143/287] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:59 2022] GET /identity/v3/users/8c968f9e13da49508fde374292fa9ec6 => generated 297 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:59.402519 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cae5e-cc9e-49ea-9ad2-e0e4037f5f44 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:59.408789 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b85df-bd24-44d3-8449-8d3459e70b00 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:59.410089 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e3af7-1a18-4c63-a944-fb3bcfec6471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:59.410089 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e3af7-1a18-4c63-a944-fb3bcfec6471 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.410089 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e3af7-1a18-4c63-a944-fb3bcfec6471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.410484 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e3af7-1a18-4c63-a944-fb3bcfec6471 admin admin] PATH_INFO: `/v3/users/46e60f873d08454fab0f7068710cc450` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.413083 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e3af7-1a18-4c63-a944-fb3bcfec6471 admin admin] RBAC: Authorizing `identity:get_user(user_id=46e60f873d08454fab0f7068710cc450)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:59.414076 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e3af7-1a18-4c63-a944-fb3bcfec6471 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:59.415846 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 145/288] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:28:59 2022] GET /identity/v3/users/46e60f873d08454fab0f7068710cc450 => generated 297 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:28:59.422555 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b85df-bd24-44d3-8449-8d3459e70b00 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:59.422833 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e3af7-1a18-4c63-a944-fb3bcfec6471 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:59.432792 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60701770-f076-4b58-9206-1e9d1b6324b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:59.433669 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60701770-f076-4b58-9206-1e9d1b6324b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.434143 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60701770-f076-4b58-9206-1e9d1b6324b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.434585 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60701770-f076-4b58-9206-1e9d1b6324b5 admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.435717 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e3af7-1a18-4c63-a944-fb3bcfec6471 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:59.436854 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60701770-f076-4b58-9206-1e9d1b6324b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5fd242268f0468aa4fc52ba184ac9a6)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:59.439282 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60701770-f076-4b58-9206-1e9d1b6324b5 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:59.441434 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 144/289] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:59 2022] GET /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:59.444552 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1f5f1-d27b-4ecb-b080-b122ae93dd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:59.445224 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1f5f1-d27b-4ecb-b080-b122ae93dd67 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.445511 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1f5f1-d27b-4ecb-b080-b122ae93dd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.445790 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1f5f1-d27b-4ecb-b080-b122ae93dd67 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.449814 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60701770-f076-4b58-9206-1e9d1b6324b5 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:59.456809 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1f5f1-d27b-4ecb-b080-b122ae93dd67 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:59.458577 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1f5f1-d27b-4ecb-b080-b122ae93dd67 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:59.460708 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60701770-f076-4b58-9206-1e9d1b6324b5 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:59.471154 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 146/290] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:28:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 08 16:28:59.477422 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1f5f1-d27b-4ecb-b080-b122ae93dd67 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:59.480489 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0a115-4d15-466d-8f4f-939e5f1ed796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:59.481687 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0a115-4d15-466d-8f4f-939e5f1ed796 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.482154 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0a115-4d15-466d-8f4f-939e5f1ed796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.482434 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0a115-4d15-466d-8f4f-939e5f1ed796 admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6/users/8c968f9e13da49508fde374292fa9ec6/roles/0d13cea753d5416bb8e71bf1e19fe7d9` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.487572 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0a115-4d15-466d-8f4f-939e5f1ed796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5fd242268f0468aa4fc52ba184ac9a6, user_id=8c968f9e13da49508fde374292fa9ec6, role_id=0d13cea753d5416bb8e71bf1e19fe7d9)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:59.489002 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0a115-4d15-466d-8f4f-939e5f1ed796 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:59.499621 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1f5f1-d27b-4ecb-b080-b122ae93dd67 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:59.513944 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 145/291] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:28:59 2022] PUT /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6/users/8c968f9e13da49508fde374292fa9ec6/roles/0d13cea753d5416bb8e71bf1e19fe7d9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:28:59.514131 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6d270-ff3d-4252-80c2-08a0822847b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:59.514998 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6d270-ff3d-4252-80c2-08a0822847b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.515295 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6d270-ff3d-4252-80c2-08a0822847b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.515626 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6d270-ff3d-4252-80c2-08a0822847b9 admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.518116 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6d270-ff3d-4252-80c2-08a0822847b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5fd242268f0468aa4fc52ba184ac9a6)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:59.520463 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6d270-ff3d-4252-80c2-08a0822847b9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:59.522458 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 147/292] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:28:59 2022] GET /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6 => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:28:59.528925 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0a115-4d15-466d-8f4f-939e5f1ed796 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:28:59.609166 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0a115-4d15-466d-8f4f-939e5f1ed796 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:28:59.616091 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae686cd3-edd8-4c82-89f9-54455df9dd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:28:59.616826 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae686cd3-edd8-4c82-89f9-54455df9dd31 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:28:59.617104 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae686cd3-edd8-4c82-89f9-54455df9dd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:28:59.617375 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae686cd3-edd8-4c82-89f9-54455df9dd31 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:28:59.618248 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae686cd3-edd8-4c82-89f9-54455df9dd31 admin admin] RBAC: Adding query filter params (role.id=c5c492cc34274d1db36b946b78fa47d7, scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6, user.id=46e60f873d08454fab0f7068710cc450) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:28:59.618554 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae686cd3-edd8-4c82-89f9-54455df9dd31 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:28:59.620839 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae686cd3-edd8-4c82-89f9-54455df9dd31 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:28:59.631369 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 146/293] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:28:59 2022] GET /identity/v3/role_assignments?user.id=46e60f873d08454fab0f7068710cc450&scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6&role.id=c5c492cc34274d1db36b946b78fa47d7 => generated 608 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:01.619266 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b166728-c3fa-4eba-98d8-70c67e65e9d2 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:01.620245 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b166728-c3fa-4eba-98d8-70c67e65e9d2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:01.620735 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b166728-c3fa-4eba-98d8-70c67e65e9d2 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:01.623088 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 148/294] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:01.629492 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84716971-8bad-4043-97f8-2dabd33f7a79 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:01.630404 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84716971-8bad-4043-97f8-2dabd33f7a79 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:01.630921 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84716971-8bad-4043-97f8-2dabd33f7a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:01.650317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-84716971-8bad-4043-97f8-2dabd33f7a79 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:01.651867 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-84716971-8bad-4043-97f8-2dabd33f7a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:01.660894 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 147/295] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:01.684965 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b166728-c3fa-4eba-98d8-70c67e65e9d2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:01.698351 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b166728-c3fa-4eba-98d8-70c67e65e9d2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:01.703325 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841ec51-5983-4fe0-b7bf-c1c0b6ac7662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:01.704418 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841ec51-5983-4fe0-b7bf-c1c0b6ac7662 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:01.704944 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841ec51-5983-4fe0-b7bf-c1c0b6ac7662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:01.705415 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841ec51-5983-4fe0-b7bf-c1c0b6ac7662 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:01.716343 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841ec51-5983-4fe0-b7bf-c1c0b6ac7662 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:01.724022 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-8841ec51-5983-4fe0-b7bf-c1c0b6ac7662 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 08 16:29:01.725787 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 149/296] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:01.732201 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84716971-8bad-4043-97f8-2dabd33f7a79 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:01.743230 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84716971-8bad-4043-97f8-2dabd33f7a79 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:01.748404 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73992a8-b552-493b-aa99-8595e8c1e9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:01.749459 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73992a8-b552-493b-aa99-8595e8c1e9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:01.749944 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73992a8-b552-493b-aa99-8595e8c1e9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:01.750445 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73992a8-b552-493b-aa99-8595e8c1e9b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:01.752046 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73992a8-b552-493b-aa99-8595e8c1e9b1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:01.752591 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73992a8-b552-493b-aa99-8595e8c1e9b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:01.754426 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73992a8-b552-493b-aa99-8595e8c1e9b1 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:01.764558 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 148/297] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:29:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:01.771697 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841ec51-5983-4fe0-b7bf-c1c0b6ac7662 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:01.782677 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841ec51-5983-4fe0-b7bf-c1c0b6ac7662 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:01.787483 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072727ec-90bc-4cdf-acf8-61a2400ae795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:01.788629 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072727ec-90bc-4cdf-acf8-61a2400ae795 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:01.789110 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072727ec-90bc-4cdf-acf8-61a2400ae795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:01.789598 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072727ec-90bc-4cdf-acf8-61a2400ae795 admin admin] PATH_INFO: `/v3/users/5ce148ef42db4f07b8895046b58f51ea` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:01.791123 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072727ec-90bc-4cdf-acf8-61a2400ae795 admin admin] RBAC: Authorizing `identity:get_user(user_id=5ce148ef42db4f07b8895046b58f51ea)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:01.793718 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072727ec-90bc-4cdf-acf8-61a2400ae795 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:01.795843 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 150/298] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:29:01 2022] GET /identity/v3/users/5ce148ef42db4f07b8895046b58f51ea => generated 293 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:01.802443 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73992a8-b552-493b-aa99-8595e8c1e9b1 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:01.812722 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73992a8-b552-493b-aa99-8595e8c1e9b1 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:01.818140 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59ac63-c13d-4d80-bf31-f3eb7a28ff30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:01.819227 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59ac63-c13d-4d80-bf31-f3eb7a28ff30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:01.819707 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59ac63-c13d-4d80-bf31-f3eb7a28ff30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:01.820313 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59ac63-c13d-4d80-bf31-f3eb7a28ff30 admin admin] PATH_INFO: `/v3/system/users/5ce148ef42db4f07b8895046b58f51ea/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:01.822028 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59ac63-c13d-4d80-bf31-f3eb7a28ff30 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5ce148ef42db4f07b8895046b58f51ea, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:01.823252 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING py.warnings [None req-be59ac63-c13d-4d80-bf31-f3eb7a28ff30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:29:01.823252 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: warnings.warn(msg) Feb 08 16:29:01.823252 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: Feb 08 16:29:01.824538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59ac63-c13d-4d80-bf31-f3eb7a28ff30 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:01.836039 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 149/299] 10.222.0.35 () {58 vars in 1355 bytes} [Tue Feb 8 16:29:01 2022] PUT /identity/v3/system/users/5ce148ef42db4f07b8895046b58f51ea/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:29:01.890344 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310ebc8-338a-4b12-b5b6-fa4aa0a073c7 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:01.891122 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310ebc8-338a-4b12-b5b6-fa4aa0a073c7 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:01.892143 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310ebc8-338a-4b12-b5b6-fa4aa0a073c7 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:01.894326 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 151/300] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:01.900613 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a5684-f884-4e20-8a27-97a8f649efed None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:01.901235 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a5684-f884-4e20-8a27-97a8f649efed None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:01.901753 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a5684-f884-4e20-8a27-97a8f649efed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:01.923549 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-795a5684-f884-4e20-8a27-97a8f649efed None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:01.925307 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-795a5684-f884-4e20-8a27-97a8f649efed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:01.933530 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 150/301] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:01.942200 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4a376-b5ea-4f2d-b14f-7ea72ec0b12d None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:01.942832 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4a376-b5ea-4f2d-b14f-7ea72ec0b12d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:01.943305 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4a376-b5ea-4f2d-b14f-7ea72ec0b12d None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:01.945387 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 152/302] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:01.958716 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc33aa-3f49-4123-b9df-908c2fff8bac None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:01.959333 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc33aa-3f49-4123-b9df-908c2fff8bac None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:01.959875 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc33aa-3f49-4123-b9df-908c2fff8bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:01.962816 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4a376-b5ea-4f2d-b14f-7ea72ec0b12d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:01.977949 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4a376-b5ea-4f2d-b14f-7ea72ec0b12d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:01.981188 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-c6fc33aa-3f49-4123-b9df-908c2fff8bac None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:01.982379 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-c6fc33aa-3f49-4123-b9df-908c2fff8bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:01.983337 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1225f49-0a8e-429b-b13c-4bd59fabf0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:01.984288 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1225f49-0a8e-429b-b13c-4bd59fabf0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:01.984677 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1225f49-0a8e-429b-b13c-4bd59fabf0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:01.985662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1225f49-0a8e-429b-b13c-4bd59fabf0d1 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:01.992455 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 151/303] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:02.001960 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1225f49-0a8e-429b-b13c-4bd59fabf0d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:02.009163 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-a1225f49-0a8e-429b-b13c-4bd59fabf0d1 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 08 16:29:02.010878 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 153/304] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:02.017799 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc33aa-3f49-4123-b9df-908c2fff8bac None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:02.020983 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1225f49-0a8e-429b-b13c-4bd59fabf0d1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:02.029862 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc33aa-3f49-4123-b9df-908c2fff8bac None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:02.030611 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1225f49-0a8e-429b-b13c-4bd59fabf0d1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:02.036886 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5d322-40f8-47c1-8787-6a2a22784f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:02.037548 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5d322-40f8-47c1-8787-6a2a22784f21 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:02.037930 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5d322-40f8-47c1-8787-6a2a22784f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:02.038200 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5d322-40f8-47c1-8787-6a2a22784f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:02.038298 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80657ba8-a7f8-4945-8cf7-2a78986e7730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:02.038969 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5d322-40f8-47c1-8787-6a2a22784f21 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:02.039104 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80657ba8-a7f8-4945-8cf7-2a78986e7730 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:02.039274 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5d322-40f8-47c1-8787-6a2a22784f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:02.039371 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80657ba8-a7f8-4945-8cf7-2a78986e7730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:02.039545 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80657ba8-a7f8-4945-8cf7-2a78986e7730 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:02.040886 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5d322-40f8-47c1-8787-6a2a22784f21 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:02.051828 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 152/305] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:29:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:02.052705 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7860f-364c-403d-b50c-a743c53f5e11 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:02.052964 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80657ba8-a7f8-4945-8cf7-2a78986e7730 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:02.053067 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7860f-364c-403d-b50c-a743c53f5e11 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:02.053248 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7860f-364c-403d-b50c-a743c53f5e11 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:02.055017 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 153/306] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:02.056902 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7860f-364c-403d-b50c-a743c53f5e11 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:02.061384 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-80657ba8-a7f8-4945-8cf7-2a78986e7730 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 08 16:29:02.062685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 154/307] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:02.069229 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee558b-4f90-4525-b23f-7422e393df85 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:02.069525 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee558b-4f90-4525-b23f-7422e393df85 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:02.069802 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee558b-4f90-4525-b23f-7422e393df85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:02.074478 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7860f-364c-403d-b50c-a743c53f5e11 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:02.080084 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d6d6c-e846-4661-a025-80a13cb0589d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:02.080969 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d6d6c-e846-4661-a025-80a13cb0589d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:02.081291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d6d6c-e846-4661-a025-80a13cb0589d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:02.081542 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d6d6c-e846-4661-a025-80a13cb0589d admin admin] PATH_INFO: `/v3/users/bc9e9d72bf704f749414b7316e74ad3a` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:02.090335 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-63ee558b-4f90-4525-b23f-7422e393df85 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:02.091816 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-63ee558b-4f90-4525-b23f-7422e393df85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:02.096272 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d6d6c-e846-4661-a025-80a13cb0589d admin admin] RBAC: Authorizing `identity:get_user(user_id=bc9e9d72bf704f749414b7316e74ad3a)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:02.098975 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d6d6c-e846-4661-a025-80a13cb0589d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:02.108485 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 154/309] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:29:02 2022] GET /identity/v3/users/bc9e9d72bf704f749414b7316e74ad3a => generated 293 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:02.108634 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 155/308] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:02.108726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d6d6c-e846-4661-a025-80a13cb0589d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:02.110975 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee558b-4f90-4525-b23f-7422e393df85 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:02.112689 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d6d6c-e846-4661-a025-80a13cb0589d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:02.118060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87bc19-9656-4ecc-8827-7663183b4f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:02.119149 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87bc19-9656-4ecc-8827-7663183b4f11 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:02.119576 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87bc19-9656-4ecc-8827-7663183b4f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:02.120024 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87bc19-9656-4ecc-8827-7663183b4f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:02.120571 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee558b-4f90-4525-b23f-7422e393df85 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:02.121174 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87bc19-9656-4ecc-8827-7663183b4f11 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:02.121485 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87bc19-9656-4ecc-8827-7663183b4f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:02.123059 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87bc19-9656-4ecc-8827-7663183b4f11 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:02.125879 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4920ed-6929-4c18-a11b-578b36c6d630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:02.126699 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4920ed-6929-4c18-a11b-578b36c6d630 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:02.127113 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4920ed-6929-4c18-a11b-578b36c6d630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:02.127519 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4920ed-6929-4c18-a11b-578b36c6d630 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:02.128389 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4920ed-6929-4c18-a11b-578b36c6d630 admin admin] RBAC: Adding query filter params (role.id=0d13cea753d5416bb8e71bf1e19fe7d9, user.id=bc9e9d72bf704f749414b7316e74ad3a, scope.system=all) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:02.128700 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4920ed-6929-4c18-a11b-578b36c6d630 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:02.130529 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4920ed-6929-4c18-a11b-578b36c6d630 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:02.132174 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 155/310] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:29:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:02.132818 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87bc19-9656-4ecc-8827-7663183b4f11 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:02.143606 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 156/311] 10.222.0.35 () {56 vars in 1329 bytes} [Tue Feb 8 16:29:02 2022] GET /identity/v3/role_assignments?user.id=bc9e9d72bf704f749414b7316e74ad3a&scope.system=all&role.id=0d13cea753d5416bb8e71bf1e19fe7d9 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:02.143744 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87bc19-9656-4ecc-8827-7663183b4f11 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:02.147856 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbb9f9-dc2d-4028-995c-576d0484de3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:02.148711 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbb9f9-dc2d-4028-995c-576d0484de3c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:02.148997 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbb9f9-dc2d-4028-995c-576d0484de3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:02.149271 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbb9f9-dc2d-4028-995c-576d0484de3c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:02.149684 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4920ed-6929-4c18-a11b-578b36c6d630 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:02.150697 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbb9f9-dc2d-4028-995c-576d0484de3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:02.152736 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbb9f9-dc2d-4028-995c-576d0484de3c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:02.154725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 156/312] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:02.165092 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbb9f9-dc2d-4028-995c-576d0484de3c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:02.165486 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4920ed-6929-4c18-a11b-578b36c6d630 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:02.170127 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766e18c-f36b-454c-b9d6-1bd4eb7bbbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:02.171015 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766e18c-f36b-454c-b9d6-1bd4eb7bbbc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:02.171293 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766e18c-f36b-454c-b9d6-1bd4eb7bbbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:02.171565 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766e18c-f36b-454c-b9d6-1bd4eb7bbbc4 admin admin] PATH_INFO: `/v3/users/8c968f9e13da49508fde374292fa9ec6` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:02.173126 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766e18c-f36b-454c-b9d6-1bd4eb7bbbc4 admin admin] RBAC: Authorizing `identity:get_user(user_id=8c968f9e13da49508fde374292fa9ec6)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:02.175604 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766e18c-f36b-454c-b9d6-1bd4eb7bbbc4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:02.177694 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 157/313] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:29:02 2022] GET /identity/v3/users/8c968f9e13da49508fde374292fa9ec6 => generated 297 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:02.179316 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbb9f9-dc2d-4028-995c-576d0484de3c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:02.185091 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766e18c-f36b-454c-b9d6-1bd4eb7bbbc4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:02.185308 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2949b2-baa2-4eb3-94ab-97adeabfe61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:02.185308 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2949b2-baa2-4eb3-94ab-97adeabfe61a admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:02.185308 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2949b2-baa2-4eb3-94ab-97adeabfe61a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:02.185521 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2949b2-baa2-4eb3-94ab-97adeabfe61a admin admin] PATH_INFO: `/v3/groups` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:02.191820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2949b2-baa2-4eb3-94ab-97adeabfe61a admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:02.191820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING py.warnings [None req-7e2949b2-baa2-4eb3-94ab-97adeabfe61a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:29:02.191820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: warnings.warn(msg) Feb 08 16:29:02.191820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: Feb 08 16:29:02.191820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2949b2-baa2-4eb3-94ab-97adeabfe61a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:02.193201 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766e18c-f36b-454c-b9d6-1bd4eb7bbbc4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:02.197704 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef8f21-2393-44f5-8fcf-980331d222b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:02.198527 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef8f21-2393-44f5-8fcf-980331d222b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:02.198770 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef8f21-2393-44f5-8fcf-980331d222b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:02.199045 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef8f21-2393-44f5-8fcf-980331d222b8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:02.208655 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef8f21-2393-44f5-8fcf-980331d222b8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:02.210547 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef8f21-2393-44f5-8fcf-980331d222b8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:02.210971 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 157/314] 10.222.0.35 () {60 vars in 1155 bytes} [Tue Feb 8 16:29:02 2022] POST /identity/v3/groups => generated 229 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:29:02.227043 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 158/315] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:29:02.228770 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2949b2-baa2-4eb3-94ab-97adeabfe61a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:02.240155 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2949b2-baa2-4eb3-94ab-97adeabfe61a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:02.246605 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464283e5-10bc-4fa2-bbb1-9085fc75f6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:02.248121 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464283e5-10bc-4fa2-bbb1-9085fc75f6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:02.248585 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464283e5-10bc-4fa2-bbb1-9085fc75f6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:02.249033 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464283e5-10bc-4fa2-bbb1-9085fc75f6f7 admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:02.250923 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464283e5-10bc-4fa2-bbb1-9085fc75f6f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5fd242268f0468aa4fc52ba184ac9a6)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:02.253336 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464283e5-10bc-4fa2-bbb1-9085fc75f6f7 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:02.255565 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 158/316] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:29:02 2022] GET /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:02.261929 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef8f21-2393-44f5-8fcf-980331d222b8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:02.272447 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef8f21-2393-44f5-8fcf-980331d222b8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:02.277407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06171b66-9e52-42d4-8fb8-5cf4c09bec5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:02.278380 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06171b66-9e52-42d4-8fb8-5cf4c09bec5b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:02.278846 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06171b66-9e52-42d4-8fb8-5cf4c09bec5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:02.279307 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06171b66-9e52-42d4-8fb8-5cf4c09bec5b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:02.280351 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06171b66-9e52-42d4-8fb8-5cf4c09bec5b admin admin] RBAC: Adding query filter params (role.id=0d13cea753d5416bb8e71bf1e19fe7d9, scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6, user.id=8c968f9e13da49508fde374292fa9ec6) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:02.280895 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06171b66-9e52-42d4-8fb8-5cf4c09bec5b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:02.284130 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06171b66-9e52-42d4-8fb8-5cf4c09bec5b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:02.291261 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 159/317] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:29:02 2022] GET /identity/v3/role_assignments?user.id=8c968f9e13da49508fde374292fa9ec6&scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6&role.id=0d13cea753d5416bb8e71bf1e19fe7d9 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:04.119206 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10fc5d-219a-448a-81f6-4fffee706907 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:04.119727 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10fc5d-219a-448a-81f6-4fffee706907 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:04.119859 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10fc5d-219a-448a-81f6-4fffee706907 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:04.121596 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 159/318] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:04.130048 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc30453-9912-4d90-b4fe-3ce4e3c441a6 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:04.130517 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc30453-9912-4d90-b4fe-3ce4e3c441a6 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:04.130617 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc30453-9912-4d90-b4fe-3ce4e3c441a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:04.156291 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-3dc30453-9912-4d90-b4fe-3ce4e3c441a6 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:04.157680 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3dc30453-9912-4d90-b4fe-3ce4e3c441a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:04.166651 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 160/319] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:04.191731 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10fc5d-219a-448a-81f6-4fffee706907 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:04.204056 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10fc5d-219a-448a-81f6-4fffee706907 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:04.208253 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a78e5-af35-439b-978c-3524a23ff96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:04.209023 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a78e5-af35-439b-978c-3524a23ff96f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:04.209325 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a78e5-af35-439b-978c-3524a23ff96f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:04.209623 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a78e5-af35-439b-978c-3524a23ff96f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:04.220473 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a78e5-af35-439b-978c-3524a23ff96f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:04.227583 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-243a78e5-af35-439b-978c-3524a23ff96f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 08 16:29:04.228938 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 160/320] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:04.234539 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc30453-9912-4d90-b4fe-3ce4e3c441a6 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:04.244185 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc30453-9912-4d90-b4fe-3ce4e3c441a6 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:04.248670 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df334c-696a-4a93-903a-c1e467b765e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:04.249356 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df334c-696a-4a93-903a-c1e467b765e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:04.249637 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df334c-696a-4a93-903a-c1e467b765e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:04.249914 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df334c-696a-4a93-903a-c1e467b765e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:04.251476 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df334c-696a-4a93-903a-c1e467b765e7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:04.251925 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df334c-696a-4a93-903a-c1e467b765e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:04.253590 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df334c-696a-4a93-903a-c1e467b765e7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:04.277033 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 161/321] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:29:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:04.278557 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a78e5-af35-439b-978c-3524a23ff96f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:04.296625 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a78e5-af35-439b-978c-3524a23ff96f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:04.301847 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a60e4-39b3-48a2-947c-28f54cf2f3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:04.302791 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a60e4-39b3-48a2-947c-28f54cf2f3da admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:04.303147 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a60e4-39b3-48a2-947c-28f54cf2f3da admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:04.303495 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a60e4-39b3-48a2-947c-28f54cf2f3da admin admin] PATH_INFO: `/v3/users/5ce148ef42db4f07b8895046b58f51ea` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:04.304814 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a60e4-39b3-48a2-947c-28f54cf2f3da admin admin] RBAC: Authorizing `identity:get_user(user_id=5ce148ef42db4f07b8895046b58f51ea)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:04.308280 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a60e4-39b3-48a2-947c-28f54cf2f3da admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:04.314836 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 161/322] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:29:04 2022] GET /identity/v3/users/5ce148ef42db4f07b8895046b58f51ea => generated 293 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:04.315932 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df334c-696a-4a93-903a-c1e467b765e7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:04.325606 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df334c-696a-4a93-903a-c1e467b765e7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:04.330433 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92130e13-8440-4d63-bfab-1ce4c2358f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:04.331069 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92130e13-8440-4d63-bfab-1ce4c2358f3f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:04.331350 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92130e13-8440-4d63-bfab-1ce4c2358f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:04.331626 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92130e13-8440-4d63-bfab-1ce4c2358f3f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:04.332501 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92130e13-8440-4d63-bfab-1ce4c2358f3f admin admin] RBAC: Adding query filter params (role.id=c5c492cc34274d1db36b946b78fa47d7, user.id=5ce148ef42db4f07b8895046b58f51ea, scope.system=all) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:04.332812 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92130e13-8440-4d63-bfab-1ce4c2358f3f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:04.334648 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92130e13-8440-4d63-bfab-1ce4c2358f3f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:04.357371 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 162/323] 10.222.0.35 () {56 vars in 1329 bytes} [Tue Feb 8 16:29:04 2022] GET /identity/v3/role_assignments?user.id=5ce148ef42db4f07b8895046b58f51ea&scope.system=all&role.id=c5c492cc34274d1db36b946b78fa47d7 => generated 510 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:04.443137 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50223470-1039-4a50-8b73-52ce7affa623 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:04.443426 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50223470-1039-4a50-8b73-52ce7affa623 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:04.443602 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50223470-1039-4a50-8b73-52ce7affa623 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:04.445602 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 162/324] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:04.451153 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace9870-aae7-44d6-8ccd-295764c73893 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:04.451443 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace9870-aae7-44d6-8ccd-295764c73893 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:04.451699 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace9870-aae7-44d6-8ccd-295764c73893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:04.471048 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2ace9870-aae7-44d6-8ccd-295764c73893 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:04.472279 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2ace9870-aae7-44d6-8ccd-295764c73893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:04.480272 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 163/325] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:29:04.504125 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50223470-1039-4a50-8b73-52ce7affa623 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:04.518339 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50223470-1039-4a50-8b73-52ce7affa623 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:04.523508 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd06cc-d00e-45fb-a121-822e4b97f16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:04.524522 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd06cc-d00e-45fb-a121-822e4b97f16d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:04.524951 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd06cc-d00e-45fb-a121-822e4b97f16d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:04.525509 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd06cc-d00e-45fb-a121-822e4b97f16d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:04.537359 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd06cc-d00e-45fb-a121-822e4b97f16d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:04.537822 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1468c44-460e-4a79-8874-49b8446e249e None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:04.538073 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1468c44-460e-4a79-8874-49b8446e249e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:04.538744 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1468c44-460e-4a79-8874-49b8446e249e None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:04.540520 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 164/326] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:29:04.545827 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-9abd06cc-d00e-45fb-a121-822e4b97f16d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 08 16:29:04.546267 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58f03b-8c57-4a62-a71b-6ea86bc0ea45 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:04.546554 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58f03b-8c57-4a62-a71b-6ea86bc0ea45 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:04.546828 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58f03b-8c57-4a62-a71b-6ea86bc0ea45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:04.547042 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 163/327] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:04.552544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd06cc-d00e-45fb-a121-822e4b97f16d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:04.565404 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd06cc-d00e-45fb-a121-822e4b97f16d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:04.566271 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-7c58f03b-8c57-4a62-a71b-6ea86bc0ea45 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:04.567459 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7c58f03b-8c57-4a62-a71b-6ea86bc0ea45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:04.569972 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427a799-a74d-4e43-86d2-e439d0b691a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:04.570593 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427a799-a74d-4e43-86d2-e439d0b691a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:04.570877 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427a799-a74d-4e43-86d2-e439d0b691a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:04.571151 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427a799-a74d-4e43-86d2-e439d0b691a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:04.572087 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427a799-a74d-4e43-86d2-e439d0b691a4 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:04.572450 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427a799-a74d-4e43-86d2-e439d0b691a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:04.574150 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427a799-a74d-4e43-86d2-e439d0b691a4 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:04.575570 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 165/328] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:29:04.583624 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 164/329] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:29:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:04.589036 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58f03b-8c57-4a62-a71b-6ea86bc0ea45 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:04.599072 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58f03b-8c57-4a62-a71b-6ea86bc0ea45 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:04.603362 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e7d91-04df-4a53-91cc-c5c12e7451f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:04.604290 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e7d91-04df-4a53-91cc-c5c12e7451f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:04.604417 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427a799-a74d-4e43-86d2-e439d0b691a4 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:04.604571 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e7d91-04df-4a53-91cc-c5c12e7451f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:04.604841 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e7d91-04df-4a53-91cc-c5c12e7451f1 admin admin] PATH_INFO: `/v3/users/bc9e9d72bf704f749414b7316e74ad3a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:04.606027 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e7d91-04df-4a53-91cc-c5c12e7451f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=bc9e9d72bf704f749414b7316e74ad3a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:04.608188 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e7d91-04df-4a53-91cc-c5c12e7451f1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:04.609786 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 166/330] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:29:04 2022] GET /identity/v3/users/bc9e9d72bf704f749414b7316e74ad3a => generated 293 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:04.614510 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427a799-a74d-4e43-86d2-e439d0b691a4 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:04.615813 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e7d91-04df-4a53-91cc-c5c12e7451f1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:04.618944 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261dd86-801d-417d-baf1-3d932abb9a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:04.619810 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261dd86-801d-417d-baf1-3d932abb9a27 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:04.620098 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261dd86-801d-417d-baf1-3d932abb9a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:04.620374 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261dd86-801d-417d-baf1-3d932abb9a27 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:04.621558 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261dd86-801d-417d-baf1-3d932abb9a27 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:04.623232 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261dd86-801d-417d-baf1-3d932abb9a27 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:04.624834 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 165/331] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:04.624980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e7d91-04df-4a53-91cc-c5c12e7451f1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:04.629857 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a9c83-1442-4b03-9896-1bf15abf819b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:04.630669 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a9c83-1442-4b03-9896-1bf15abf819b admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:04.630784 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261dd86-801d-417d-baf1-3d932abb9a27 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:04.630946 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a9c83-1442-4b03-9896-1bf15abf819b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:04.631219 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a9c83-1442-4b03-9896-1bf15abf819b admin admin] PATH_INFO: `/v3/system/users/bc9e9d72bf704f749414b7316e74ad3a/roles/0d13cea753d5416bb8e71bf1e19fe7d9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:04.632708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a9c83-1442-4b03-9896-1bf15abf819b admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bc9e9d72bf704f749414b7316e74ad3a, role_id=0d13cea753d5416bb8e71bf1e19fe7d9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:04.633712 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-943a9c83-1442-4b03-9896-1bf15abf819b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:29:04.633712 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Feb 08 16:29:04.633712 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: Feb 08 16:29:04.634565 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a9c83-1442-4b03-9896-1bf15abf819b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:04.640099 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261dd86-801d-417d-baf1-3d932abb9a27 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:04.643884 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 167/332] 10.222.0.35 () {58 vars in 1355 bytes} [Tue Feb 8 16:29:04 2022] PUT /identity/v3/system/users/bc9e9d72bf704f749414b7316e74ad3a/roles/0d13cea753d5416bb8e71bf1e19fe7d9 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:29:04.645785 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f5e90-288c-4e90-b488-eb962dae7cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:04.646416 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f5e90-288c-4e90-b488-eb962dae7cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:04.646694 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f5e90-288c-4e90-b488-eb962dae7cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:04.646963 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f5e90-288c-4e90-b488-eb962dae7cb8 admin admin] PATH_INFO: `/v3/groups` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:04.647659 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f5e90-288c-4e90-b488-eb962dae7cb8 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:04.649594 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f5e90-288c-4e90-b488-eb962dae7cb8 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:04.665011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 166/333] 10.222.0.35 () {60 vars in 1155 bytes} [Tue Feb 8 16:29:04 2022] POST /identity/v3/groups => generated 226 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:29:07.093364 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4700592-bee3-4ecb-80c2-5223f51e4fce None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:07.095164 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4700592-bee3-4ecb-80c2-5223f51e4fce None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:07.095655 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4700592-bee3-4ecb-80c2-5223f51e4fce None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:07.097948 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 168/334] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:07.103265 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d383c4-2431-435a-8257-484f49d59b5e None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:07.103723 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d383c4-2431-435a-8257-484f49d59b5e None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:07.103723 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d383c4-2431-435a-8257-484f49d59b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:07.131978 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-01d383c4-2431-435a-8257-484f49d59b5e None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:07.133173 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-01d383c4-2431-435a-8257-484f49d59b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:07.148357 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 167/335] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:29:07.193129 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4700592-bee3-4ecb-80c2-5223f51e4fce None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:07.209104 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4700592-bee3-4ecb-80c2-5223f51e4fce None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:07.220089 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb3146-3ab5-42d0-95fe-c6057dea0487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:07.221205 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb3146-3ab5-42d0-95fe-c6057dea0487 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:07.221791 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb3146-3ab5-42d0-95fe-c6057dea0487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:07.222264 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb3146-3ab5-42d0-95fe-c6057dea0487 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:07.234660 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb3146-3ab5-42d0-95fe-c6057dea0487 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:07.242145 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-a2eb3146-3ab5-42d0-95fe-c6057dea0487 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 08 16:29:07.244347 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 169/336] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:07.250009 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d383c4-2431-435a-8257-484f49d59b5e None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:07.278502 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d383c4-2431-435a-8257-484f49d59b5e None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:07.287061 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92b922-89c5-4575-8775-e5e735dc1b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:07.287727 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b922-89c5-4575-8775-e5e735dc1b95 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:07.288040 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b922-89c5-4575-8775-e5e735dc1b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:07.288314 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b922-89c5-4575-8775-e5e735dc1b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:07.289084 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92b922-89c5-4575-8775-e5e735dc1b95 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:07.289388 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92b922-89c5-4575-8775-e5e735dc1b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:07.290972 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92b922-89c5-4575-8775-e5e735dc1b95 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:07.303781 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 168/337] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:29:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:07.314238 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb3146-3ab5-42d0-95fe-c6057dea0487 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:07.330513 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb3146-3ab5-42d0-95fe-c6057dea0487 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:07.339536 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0311e-a652-47f4-ae5a-a29066c5695a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:07.340674 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0311e-a652-47f4-ae5a-a29066c5695a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:07.341183 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0311e-a652-47f4-ae5a-a29066c5695a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:07.341659 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0311e-a652-47f4-ae5a-a29066c5695a admin admin] PATH_INFO: `/v3/users/bc9e9d72bf704f749414b7316e74ad3a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:07.343083 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0311e-a652-47f4-ae5a-a29066c5695a admin admin] RBAC: Authorizing `identity:get_user(user_id=bc9e9d72bf704f749414b7316e74ad3a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:07.346115 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0311e-a652-47f4-ae5a-a29066c5695a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:07.352053 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 170/338] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:29:07 2022] GET /identity/v3/users/bc9e9d72bf704f749414b7316e74ad3a => generated 293 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:07.358163 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92b922-89c5-4575-8775-e5e735dc1b95 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:07.371360 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92b922-89c5-4575-8775-e5e735dc1b95 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:07.380091 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274904e8-3844-488d-a7b0-9a5ea769f6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:07.380744 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274904e8-3844-488d-a7b0-9a5ea769f6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:07.381027 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274904e8-3844-488d-a7b0-9a5ea769f6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:07.381304 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274904e8-3844-488d-a7b0-9a5ea769f6b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:07.382159 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274904e8-3844-488d-a7b0-9a5ea769f6b0 admin admin] RBAC: Adding query filter params (role.id=0d13cea753d5416bb8e71bf1e19fe7d9, user.id=bc9e9d72bf704f749414b7316e74ad3a, scope.system=all) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:07.382473 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274904e8-3844-488d-a7b0-9a5ea769f6b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:07.384472 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274904e8-3844-488d-a7b0-9a5ea769f6b0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:07.388570 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b1036-968b-45f9-ace3-01a75666d0a2 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:07.389130 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b1036-968b-45f9-ace3-01a75666d0a2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:07.389604 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b1036-968b-45f9-ace3-01a75666d0a2 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:07.392619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 171/339] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:29:07.407582 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d4f7c-5383-4f28-805c-6ed17d6e43c3 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:07.408211 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d4f7c-5383-4f28-805c-6ed17d6e43c3 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:07.408721 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d4f7c-5383-4f28-805c-6ed17d6e43c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:07.410025 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 169/340] 10.222.0.35 () {56 vars in 1329 bytes} [Tue Feb 8 16:29:07 2022] GET /identity/v3/role_assignments?user.id=bc9e9d72bf704f749414b7316e74ad3a&scope.system=all&role.id=0d13cea753d5416bb8e71bf1e19fe7d9 => generated 510 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:07.442779 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-541d4f7c-5383-4f28-805c-6ed17d6e43c3 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:07.444416 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-541d4f7c-5383-4f28-805c-6ed17d6e43c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:07.459156 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 172/341] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:29:07.501895 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274904e8-3844-488d-a7b0-9a5ea769f6b0 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:07.517800 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274904e8-3844-488d-a7b0-9a5ea769f6b0 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:07.528159 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078813d0-ccf7-4ac6-a5f2-735380b48289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:07.528958 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078813d0-ccf7-4ac6-a5f2-735380b48289 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:07.529234 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078813d0-ccf7-4ac6-a5f2-735380b48289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:07.529501 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078813d0-ccf7-4ac6-a5f2-735380b48289 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:07.549266 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078813d0-ccf7-4ac6-a5f2-735380b48289 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:07.556534 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-078813d0-ccf7-4ac6-a5f2-735380b48289 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 08 16:29:07.557958 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 170/342] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:07.564942 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d4f7c-5383-4f28-805c-6ed17d6e43c3 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:07.586487 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d4f7c-5383-4f28-805c-6ed17d6e43c3 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:07.596701 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106cb50-606e-47c4-83f8-7715d51f900e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:07.597736 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106cb50-606e-47c4-83f8-7715d51f900e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:07.598226 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106cb50-606e-47c4-83f8-7715d51f900e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:07.598728 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106cb50-606e-47c4-83f8-7715d51f900e admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:07.599729 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106cb50-606e-47c4-83f8-7715d51f900e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:07.600281 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106cb50-606e-47c4-83f8-7715d51f900e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:07.602189 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106cb50-606e-47c4-83f8-7715d51f900e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:07.619400 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 173/343] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:29:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:07.625414 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078813d0-ccf7-4ac6-a5f2-735380b48289 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:07.645609 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078813d0-ccf7-4ac6-a5f2-735380b48289 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:07.656162 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19058e-5c00-4346-8229-92b83510a8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:07.657228 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f3ae2-dbde-4634-a5ae-3f0b898c885b None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:07.657507 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19058e-5c00-4346-8229-92b83510a8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:07.657956 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19058e-5c00-4346-8229-92b83510a8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:07.658149 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f3ae2-dbde-4634-a5ae-3f0b898c885b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:07.658420 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19058e-5c00-4346-8229-92b83510a8c7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:07.658830 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f3ae2-dbde-4634-a5ae-3f0b898c885b None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:07.661370 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 174/344] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:29:07.667049 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11123a3e-95c6-44f4-be59-ff9791febe0a None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:07.667636 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11123a3e-95c6-44f4-be59-ff9791febe0a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:07.668151 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11123a3e-95c6-44f4-be59-ff9791febe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:07.673002 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19058e-5c00-4346-8229-92b83510a8c7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:07.679795 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19058e-5c00-4346-8229-92b83510a8c7 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:07.690480 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 171/345] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:29:07.699850 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-11123a3e-95c6-44f4-be59-ff9791febe0a None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:07.701413 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-11123a3e-95c6-44f4-be59-ff9791febe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:07.707537 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19058e-5c00-4346-8229-92b83510a8c7 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:07.715405 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 175/346] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:29:07.721236 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19058e-5c00-4346-8229-92b83510a8c7 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:07.728887 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fa1e0-6ed9-480d-a5f1-d6fe4629c393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:07.729803 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fa1e0-6ed9-480d-a5f1-d6fe4629c393 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:07.730085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fa1e0-6ed9-480d-a5f1-d6fe4629c393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:07.730417 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fa1e0-6ed9-480d-a5f1-d6fe4629c393 admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:07.731688 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920fa1e0-6ed9-480d-a5f1-d6fe4629c393 admin admin] RBAC: Authorizing `identity:get_project(project_id=67f1c5c4abff46008cee0510849c586e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:07.733840 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920fa1e0-6ed9-480d-a5f1-d6fe4629c393 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:07.737044 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 172/347] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:29:07 2022] GET /identity/v3/projects/67f1c5c4abff46008cee0510849c586e => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:07.742405 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11123a3e-95c6-44f4-be59-ff9791febe0a None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:07.753150 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fa1e0-6ed9-480d-a5f1-d6fe4629c393 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:07.757080 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11123a3e-95c6-44f4-be59-ff9791febe0a None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:07.764856 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fa1e0-6ed9-480d-a5f1-d6fe4629c393 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:07.768939 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a2671-d43a-4f78-ae99-91ddb80f7d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:07.770034 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a2671-d43a-4f78-ae99-91ddb80f7d92 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:07.770539 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a2671-d43a-4f78-ae99-91ddb80f7d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:07.771042 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a2671-d43a-4f78-ae99-91ddb80f7d92 admin admin] PATH_INFO: `/v3/groups/5aa905faf66f4afaa4ae22a3b3700772` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:07.779313 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa9d16-a259-4fc6-bb6a-42443b13e7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:07.780540 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa9d16-a259-4fc6-bb6a-42443b13e7cb admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:07.781024 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa9d16-a259-4fc6-bb6a-42443b13e7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:07.782290 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa9d16-a259-4fc6-bb6a-42443b13e7cb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:07.784361 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a2671-d43a-4f78-ae99-91ddb80f7d92 admin admin] RBAC: Authorizing `identity:get_group(group_id=5aa905faf66f4afaa4ae22a3b3700772)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:07.785619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-043a2671-d43a-4f78-ae99-91ddb80f7d92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:29:07.785619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Feb 08 16:29:07.785619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: Feb 08 16:29:07.788699 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a2671-d43a-4f78-ae99-91ddb80f7d92 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:07.791609 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 176/348] 10.222.0.35 () {56 vars in 1201 bytes} [Tue Feb 8 16:29:07 2022] GET /identity/v3/groups/5aa905faf66f4afaa4ae22a3b3700772 => generated 226 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:07.798190 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a2671-d43a-4f78-ae99-91ddb80f7d92 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:07.810795 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa9d16-a259-4fc6-bb6a-42443b13e7cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:07.813579 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a2671-d43a-4f78-ae99-91ddb80f7d92 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:07.821179 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-72fa9d16-a259-4fc6-bb6a-42443b13e7cb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 08 16:29:07.826828 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 173/349] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:29:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:07.827741 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e828d79-7850-4120-8092-fdb7032a632c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:07.829209 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e828d79-7850-4120-8092-fdb7032a632c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:07.829689 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e828d79-7850-4120-8092-fdb7032a632c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:07.830156 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e828d79-7850-4120-8092-fdb7032a632c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:07.831192 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e828d79-7850-4120-8092-fdb7032a632c admin admin] RBAC: Adding query filter params (group.id=5aa905faf66f4afaa4ae22a3b3700772, role.id=c5c492cc34274d1db36b946b78fa47d7, scope.project.id=67f1c5c4abff46008cee0510849c586e) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:07.831718 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e828d79-7850-4120-8092-fdb7032a632c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:07.834083 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e828d79-7850-4120-8092-fdb7032a632c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:07.834193 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa9d16-a259-4fc6-bb6a-42443b13e7cb admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:07.847826 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa9d16-a259-4fc6-bb6a-42443b13e7cb admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:07.850919 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 177/350] 10.222.0.35 () {56 vars in 1397 bytes} [Tue Feb 8 16:29:07 2022] GET /identity/v3/role_assignments?group.id=5aa905faf66f4afaa4ae22a3b3700772&scope.project.id=67f1c5c4abff46008cee0510849c586e&role.id=c5c492cc34274d1db36b946b78fa47d7 => generated 260 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:07.859086 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d73e8-29d1-42a5-8f9f-44f53264fc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:07.859914 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d73e8-29d1-42a5-8f9f-44f53264fc1b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:07.860201 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d73e8-29d1-42a5-8f9f-44f53264fc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:07.860480 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d73e8-29d1-42a5-8f9f-44f53264fc1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:07.861322 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d73e8-29d1-42a5-8f9f-44f53264fc1b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:07.861634 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d73e8-29d1-42a5-8f9f-44f53264fc1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:07.863394 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d73e8-29d1-42a5-8f9f-44f53264fc1b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:07.877321 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 174/351] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:07.883276 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e828d79-7850-4120-8092-fdb7032a632c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:07.897349 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e828d79-7850-4120-8092-fdb7032a632c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:07.902441 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f04ede-5b04-4879-b3ea-00f17e290bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:07.903232 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f04ede-5b04-4879-b3ea-00f17e290bee admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:07.903504 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f04ede-5b04-4879-b3ea-00f17e290bee admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:07.903808 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f04ede-5b04-4879-b3ea-00f17e290bee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:07.914503 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f04ede-5b04-4879-b3ea-00f17e290bee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:07.916460 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f04ede-5b04-4879-b3ea-00f17e290bee admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:07.928316 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 178/352] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:29:07.934347 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d73e8-29d1-42a5-8f9f-44f53264fc1b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:07.946067 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d73e8-29d1-42a5-8f9f-44f53264fc1b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:07.955929 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af1f28-fff5-48c9-a8b1-a7bae90a389e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:07.956814 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af1f28-fff5-48c9-a8b1-a7bae90a389e admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:07.957096 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af1f28-fff5-48c9-a8b1-a7bae90a389e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:07.957374 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af1f28-fff5-48c9-a8b1-a7bae90a389e admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:07.958954 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af1f28-fff5-48c9-a8b1-a7bae90a389e admin admin] RBAC: Authorizing `identity:get_project(project_id=67f1c5c4abff46008cee0510849c586e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:07.961126 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af1f28-fff5-48c9-a8b1-a7bae90a389e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:07.963294 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 175/353] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:29:07 2022] GET /identity/v3/projects/67f1c5c4abff46008cee0510849c586e => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:07.970123 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f04ede-5b04-4879-b3ea-00f17e290bee admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:07.980203 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f04ede-5b04-4879-b3ea-00f17e290bee admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:07.988131 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd86892-6861-482c-a8b4-29a29fba2e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:07.989051 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd86892-6861-482c-a8b4-29a29fba2e0c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:07.989335 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd86892-6861-482c-a8b4-29a29fba2e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:07.989613 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd86892-6861-482c-a8b4-29a29fba2e0c admin admin] PATH_INFO: `/v3/groups/5aa905faf66f4afaa4ae22a3b3700772` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:07.991046 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd86892-6861-482c-a8b4-29a29fba2e0c admin admin] RBAC: Authorizing `identity:get_group(group_id=5aa905faf66f4afaa4ae22a3b3700772)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:07.993196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd86892-6861-482c-a8b4-29a29fba2e0c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:07.996536 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 179/354] 10.222.0.35 () {56 vars in 1201 bytes} [Tue Feb 8 16:29:07 2022] GET /identity/v3/groups/5aa905faf66f4afaa4ae22a3b3700772 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:08.002184 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af1f28-fff5-48c9-a8b1-a7bae90a389e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:08.013441 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af1f28-fff5-48c9-a8b1-a7bae90a389e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:08.020548 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e499b-8090-462c-a9c6-588af1ceaa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:08.021265 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e499b-8090-462c-a9c6-588af1ceaa14 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:08.021554 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e499b-8090-462c-a9c6-588af1ceaa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:08.021933 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e499b-8090-462c-a9c6-588af1ceaa14 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:08.022797 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e499b-8090-462c-a9c6-588af1ceaa14 admin admin] RBAC: Adding query filter params (group.id=5aa905faf66f4afaa4ae22a3b3700772, role.id=519f10f80fbd4e108392697b77c2178a, scope.project.id=67f1c5c4abff46008cee0510849c586e) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:08.023164 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e499b-8090-462c-a9c6-588af1ceaa14 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:08.025161 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e499b-8090-462c-a9c6-588af1ceaa14 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:08.035925 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 176/355] 10.222.0.35 () {56 vars in 1397 bytes} [Tue Feb 8 16:29:08 2022] GET /identity/v3/role_assignments?group.id=5aa905faf66f4afaa4ae22a3b3700772&scope.project.id=67f1c5c4abff46008cee0510849c586e&role.id=519f10f80fbd4e108392697b77c2178a => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:08.248915 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72e301-2b7e-4ece-ba57-4c68000165cb None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:08.249581 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72e301-2b7e-4ece-ba57-4c68000165cb None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:08.249581 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72e301-2b7e-4ece-ba57-4c68000165cb None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:08.252488 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 180/356] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:08.263783 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44866afd-6f05-4023-a4fa-6efd13d12e79 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:08.263783 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44866afd-6f05-4023-a4fa-6efd13d12e79 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:08.263783 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44866afd-6f05-4023-a4fa-6efd13d12e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:08.299239 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-44866afd-6f05-4023-a4fa-6efd13d12e79 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:08.300542 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-44866afd-6f05-4023-a4fa-6efd13d12e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:08.313363 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 177/357] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:08.353933 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72e301-2b7e-4ece-ba57-4c68000165cb None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:08.370086 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72e301-2b7e-4ece-ba57-4c68000165cb None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:08.377322 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef865474-726a-400e-842f-d51ed4fda0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:08.378115 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef865474-726a-400e-842f-d51ed4fda0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:08.378392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef865474-726a-400e-842f-d51ed4fda0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:08.378662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef865474-726a-400e-842f-d51ed4fda0c9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:08.403269 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef865474-726a-400e-842f-d51ed4fda0c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:08.410332 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-ef865474-726a-400e-842f-d51ed4fda0c9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 08 16:29:08.411858 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 181/358] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:08.417498 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44866afd-6f05-4023-a4fa-6efd13d12e79 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:08.431331 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44866afd-6f05-4023-a4fa-6efd13d12e79 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:08.439546 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1027f7a-cee5-4efc-8e59-ca4c0e32c252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:08.440472 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1027f7a-cee5-4efc-8e59-ca4c0e32c252 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:08.440924 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1027f7a-cee5-4efc-8e59-ca4c0e32c252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:08.441396 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1027f7a-cee5-4efc-8e59-ca4c0e32c252 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:08.442304 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1027f7a-cee5-4efc-8e59-ca4c0e32c252 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:08.442757 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1027f7a-cee5-4efc-8e59-ca4c0e32c252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:08.444609 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1027f7a-cee5-4efc-8e59-ca4c0e32c252 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:08.462943 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 178/359] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:29:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:08.468708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef865474-726a-400e-842f-d51ed4fda0c9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:08.485342 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef865474-726a-400e-842f-d51ed4fda0c9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:08.496365 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecbde1-f05c-45a5-909c-a8c98c01efbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:08.497176 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecbde1-f05c-45a5-909c-a8c98c01efbf admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:08.497621 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecbde1-f05c-45a5-909c-a8c98c01efbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:08.498032 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecbde1-f05c-45a5-909c-a8c98c01efbf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:08.508946 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecbde1-f05c-45a5-909c-a8c98c01efbf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:08.510664 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecbde1-f05c-45a5-909c-a8c98c01efbf admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:08.522841 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 182/360] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:29:08.528128 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1027f7a-cee5-4efc-8e59-ca4c0e32c252 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:08.541008 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1027f7a-cee5-4efc-8e59-ca4c0e32c252 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:08.548379 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9390cb5-f363-4bf3-81bc-960405f89840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:08.549544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9390cb5-f363-4bf3-81bc-960405f89840 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:08.550086 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9390cb5-f363-4bf3-81bc-960405f89840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:08.550572 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9390cb5-f363-4bf3-81bc-960405f89840 admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:08.552681 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9390cb5-f363-4bf3-81bc-960405f89840 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5fd242268f0468aa4fc52ba184ac9a6)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:08.555076 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9390cb5-f363-4bf3-81bc-960405f89840 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:08.557109 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 179/361] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:29:08 2022] GET /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:08.562523 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecbde1-f05c-45a5-909c-a8c98c01efbf admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:08.575708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecbde1-f05c-45a5-909c-a8c98c01efbf admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:08.582239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8a736-ba7e-49d1-a389-55d6ce89d23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:08.583487 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8a736-ba7e-49d1-a389-55d6ce89d23d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:08.584053 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8a736-ba7e-49d1-a389-55d6ce89d23d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:08.584549 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8a736-ba7e-49d1-a389-55d6ce89d23d admin admin] PATH_INFO: `/v3/groups/5aa905faf66f4afaa4ae22a3b3700772` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:08.585992 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8a736-ba7e-49d1-a389-55d6ce89d23d admin admin] RBAC: Authorizing `identity:get_group(group_id=5aa905faf66f4afaa4ae22a3b3700772)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:08.588235 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8a736-ba7e-49d1-a389-55d6ce89d23d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:08.590464 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 183/362] 10.222.0.35 () {56 vars in 1201 bytes} [Tue Feb 8 16:29:08 2022] GET /identity/v3/groups/5aa905faf66f4afaa4ae22a3b3700772 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:08.597037 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9390cb5-f363-4bf3-81bc-960405f89840 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:08.614007 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9390cb5-f363-4bf3-81bc-960405f89840 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:08.620922 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770c0e6-30bc-4387-8d4c-b454dac6b771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:08.622030 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770c0e6-30bc-4387-8d4c-b454dac6b771 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:08.622666 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770c0e6-30bc-4387-8d4c-b454dac6b771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:08.623176 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770c0e6-30bc-4387-8d4c-b454dac6b771 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:08.624382 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770c0e6-30bc-4387-8d4c-b454dac6b771 admin admin] RBAC: Adding query filter params (group.id=5aa905faf66f4afaa4ae22a3b3700772, role.id=c5c492cc34274d1db36b946b78fa47d7, scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:08.624898 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770c0e6-30bc-4387-8d4c-b454dac6b771 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:08.627633 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770c0e6-30bc-4387-8d4c-b454dac6b771 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:08.640409 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 180/363] 10.222.0.35 () {56 vars in 1397 bytes} [Tue Feb 8 16:29:08 2022] GET /identity/v3/role_assignments?group.id=5aa905faf66f4afaa4ae22a3b3700772&scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6&role.id=c5c492cc34274d1db36b946b78fa47d7 => generated 260 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:09.673681 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd829e-f98d-4f40-b5d5-c55563c7a761 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:09.674238 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd829e-f98d-4f40-b5d5-c55563c7a761 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:09.674238 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd829e-f98d-4f40-b5d5-c55563c7a761 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:09.676528 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 184/364] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:09.693740 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fd6c0-9134-4850-a725-04aa2c23d243 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:09.694247 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fd6c0-9134-4850-a725-04aa2c23d243 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:09.694324 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fd6c0-9134-4850-a725-04aa2c23d243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:09.717435 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e48e59-118d-4797-aa28-53aa179b314a None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:09.717729 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e48e59-118d-4797-aa28-53aa179b314a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:09.717989 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e48e59-118d-4797-aa28-53aa179b314a None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:09.720332 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 185/365] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:09.721239 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-b24fd6c0-9134-4850-a725-04aa2c23d243 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:09.722556 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-b24fd6c0-9134-4850-a725-04aa2c23d243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:09.725969 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b860d-f266-4628-a6fc-6327abf6de00 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:09.726348 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b860d-f266-4628-a6fc-6327abf6de00 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:09.726631 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b860d-f266-4628-a6fc-6327abf6de00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:09.732217 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 181/366] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:09.747790 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-910b860d-f266-4628-a6fc-6327abf6de00 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:09.753033 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-910b860d-f266-4628-a6fc-6327abf6de00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:09.766523 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 186/367] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:29:09.783471 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fd6c0-9134-4850-a725-04aa2c23d243 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:09.796726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fd6c0-9134-4850-a725-04aa2c23d243 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:09.796880 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b860d-f266-4628-a6fc-6327abf6de00 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:09.806345 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b860d-f266-4628-a6fc-6327abf6de00 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:09.808315 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713a577-0606-4219-a9f0-42b216e2ece6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:09.809372 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713a577-0606-4219-a9f0-42b216e2ece6 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:09.809850 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713a577-0606-4219-a9f0-42b216e2ece6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:09.810317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713a577-0606-4219-a9f0-42b216e2ece6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:09.815778 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a28f3d-19aa-42ac-9828-ec893cd8d9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:09.815778 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a28f3d-19aa-42ac-9828-ec893cd8d9cf admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:09.815778 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a28f3d-19aa-42ac-9828-ec893cd8d9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:09.815778 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a28f3d-19aa-42ac-9828-ec893cd8d9cf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:09.824523 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a28f3d-19aa-42ac-9828-ec893cd8d9cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:09.832115 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-15a28f3d-19aa-42ac-9828-ec893cd8d9cf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:29:09.833212 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713a577-0606-4219-a9f0-42b216e2ece6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:09.835865 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 187/368] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:29:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:09.839271 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a28f3d-19aa-42ac-9828-ec893cd8d9cf admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:09.841182 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-f713a577-0606-4219-a9f0-42b216e2ece6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 08 16:29:09.842850 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 182/369] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:29:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:09.849512 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a28f3d-19aa-42ac-9828-ec893cd8d9cf admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:09.856618 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713a577-0606-4219-a9f0-42b216e2ece6 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:09.858996 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b2e3b-3216-42e4-9871-c7feb8a4e73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:09.859887 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b2e3b-3216-42e4-9871-c7feb8a4e73e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:09.860179 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b2e3b-3216-42e4-9871-c7feb8a4e73e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:09.860456 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b2e3b-3216-42e4-9871-c7feb8a4e73e admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:09.861226 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b2e3b-3216-42e4-9871-c7feb8a4e73e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:09.861533 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b2e3b-3216-42e4-9871-c7feb8a4e73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:09.863134 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b2e3b-3216-42e4-9871-c7feb8a4e73e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:09.872964 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 188/370] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:09.874909 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713a577-0606-4219-a9f0-42b216e2ece6 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:09.883534 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b2e3b-3216-42e4-9871-c7feb8a4e73e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:09.885045 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5aa356-df81-4fe2-8379-f1fee68ff158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:09.885709 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5aa356-df81-4fe2-8379-f1fee68ff158 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:09.885995 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5aa356-df81-4fe2-8379-f1fee68ff158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:09.886272 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5aa356-df81-4fe2-8379-f1fee68ff158 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:09.887038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5aa356-df81-4fe2-8379-f1fee68ff158 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:09.887342 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5aa356-df81-4fe2-8379-f1fee68ff158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:09.888964 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5aa356-df81-4fe2-8379-f1fee68ff158 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:09.896904 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b2e3b-3216-42e4-9871-c7feb8a4e73e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:09.906270 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7505a0-2796-4f94-b0e3-3c8b01d1ba24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:09.909941 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7505a0-2796-4f94-b0e3-3c8b01d1ba24 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:09.910661 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7505a0-2796-4f94-b0e3-3c8b01d1ba24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:09.912168 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7505a0-2796-4f94-b0e3-3c8b01d1ba24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:09.919893 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 183/371] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:09.924073 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5aa356-df81-4fe2-8379-f1fee68ff158 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:09.935406 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7505a0-2796-4f94-b0e3-3c8b01d1ba24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:09.940853 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7505a0-2796-4f94-b0e3-3c8b01d1ba24 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:09.945974 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5aa356-df81-4fe2-8379-f1fee68ff158 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:09.956623 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404b968-9eea-4d55-ab5d-5f89eb70ba8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:09.959158 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404b968-9eea-4d55-ab5d-5f89eb70ba8b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:09.959712 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404b968-9eea-4d55-ab5d-5f89eb70ba8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:09.960242 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404b968-9eea-4d55-ab5d-5f89eb70ba8b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:09.963594 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 189/372] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 08 16:29:09.967415 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7505a0-2796-4f94-b0e3-3c8b01d1ba24 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:09.979933 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404b968-9eea-4d55-ab5d-5f89eb70ba8b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:09.982068 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404b968-9eea-4d55-ab5d-5f89eb70ba8b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:09.985093 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7505a0-2796-4f94-b0e3-3c8b01d1ba24 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:09.997444 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92419329-bd23-424e-befc-94c176f4cff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:09.999044 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92419329-bd23-424e-befc-94c176f4cff0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:10.001055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92419329-bd23-424e-befc-94c176f4cff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:10.001968 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92419329-bd23-424e-befc-94c176f4cff0 admin admin] PATH_INFO: `/v3/projects/2b5e4fc6dd694372b7f8775a6f881cca` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:10.005811 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92419329-bd23-424e-befc-94c176f4cff0 admin admin] RBAC: Authorizing `identity:get_project(project_id=2b5e4fc6dd694372b7f8775a6f881cca)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:10.007200 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 184/373] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:29:10.011110 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92419329-bd23-424e-befc-94c176f4cff0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:10.014084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 190/374] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:29:09 2022] GET /identity/v3/projects/2b5e4fc6dd694372b7f8775a6f881cca => generated 344 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:10.019042 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404b968-9eea-4d55-ab5d-5f89eb70ba8b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:10.022417 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92419329-bd23-424e-befc-94c176f4cff0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:10.037312 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404b968-9eea-4d55-ab5d-5f89eb70ba8b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:10.039941 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92419329-bd23-424e-befc-94c176f4cff0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:10.046734 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4b329-84f0-4e6b-8717-0b06eb98926b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:10.051801 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4b329-84f0-4e6b-8717-0b06eb98926b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:10.051801 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4b329-84f0-4e6b-8717-0b06eb98926b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:10.051801 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4b329-84f0-4e6b-8717-0b06eb98926b admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:10.051801 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4b329-84f0-4e6b-8717-0b06eb98926b admin admin] RBAC: Authorizing `identity:get_project(project_id=d5fd242268f0468aa4fc52ba184ac9a6)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:10.053197 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4b329-84f0-4e6b-8717-0b06eb98926b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:10.056108 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037abf1-142a-4048-80df-c709e72642c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:10.056958 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037abf1-142a-4048-80df-c709e72642c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:10.057238 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037abf1-142a-4048-80df-c709e72642c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:10.057510 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037abf1-142a-4048-80df-c709e72642c2 admin admin] PATH_INFO: `/v3/groups/5ec6ddf7bd824a1487eb8933b3117110` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:10.058463 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 185/375] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:29:10 2022] GET /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6 => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:10.063415 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4b329-84f0-4e6b-8717-0b06eb98926b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:10.070641 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037abf1-142a-4048-80df-c709e72642c2 admin admin] RBAC: Authorizing `identity:get_group(group_id=5ec6ddf7bd824a1487eb8933b3117110)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:10.072608 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037abf1-142a-4048-80df-c709e72642c2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:10.074301 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 191/376] 10.222.0.35 () {56 vars in 1201 bytes} [Tue Feb 8 16:29:10 2022] GET /identity/v3/groups/5ec6ddf7bd824a1487eb8933b3117110 => generated 229 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:10.080946 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037abf1-142a-4048-80df-c709e72642c2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:10.081773 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4b329-84f0-4e6b-8717-0b06eb98926b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:10.096586 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037abf1-142a-4048-80df-c709e72642c2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:10.098890 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8aee8-87d4-44f2-bce9-f26ac989184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:10.099725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8aee8-87d4-44f2-bce9-f26ac989184a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:10.100033 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8aee8-87d4-44f2-bce9-f26ac989184a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:10.100306 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8aee8-87d4-44f2-bce9-f26ac989184a admin admin] PATH_INFO: `/v3/groups/5aa905faf66f4afaa4ae22a3b3700772` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:10.102634 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8aee8-87d4-44f2-bce9-f26ac989184a admin admin] RBAC: Authorizing `identity:get_group(group_id=5aa905faf66f4afaa4ae22a3b3700772)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:10.103677 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING py.warnings [None req-79a8aee8-87d4-44f2-bce9-f26ac989184a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:29:10.103677 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: warnings.warn(msg) Feb 08 16:29:10.103677 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: Feb 08 16:29:10.104904 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8aee8-87d4-44f2-bce9-f26ac989184a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:10.106929 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 186/377] 10.222.0.35 () {56 vars in 1201 bytes} [Tue Feb 8 16:29:10 2022] GET /identity/v3/groups/5aa905faf66f4afaa4ae22a3b3700772 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:10.114857 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc071e-6d6c-46bd-ac2d-ec6f5f7cf5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:10.115989 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc071e-6d6c-46bd-ac2d-ec6f5f7cf5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:10.116486 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc071e-6d6c-46bd-ac2d-ec6f5f7cf5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:10.116995 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc071e-6d6c-46bd-ac2d-ec6f5f7cf5a2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:10.118122 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc071e-6d6c-46bd-ac2d-ec6f5f7cf5a2 admin admin] RBAC: Adding query filter params (group.id=5ec6ddf7bd824a1487eb8933b3117110, role.id=e6d18df5c4e74dfd8ebd9c636f45936e, scope.project.id=2b5e4fc6dd694372b7f8775a6f881cca) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:10.118703 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc071e-6d6c-46bd-ac2d-ec6f5f7cf5a2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:10.120844 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8aee8-87d4-44f2-bce9-f26ac989184a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:10.121403 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc071e-6d6c-46bd-ac2d-ec6f5f7cf5a2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:10.132268 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 192/378] 10.222.0.35 () {56 vars in 1397 bytes} [Tue Feb 8 16:29:10 2022] GET /identity/v3/role_assignments?group.id=5ec6ddf7bd824a1487eb8933b3117110&scope.project.id=2b5e4fc6dd694372b7f8775a6f881cca&role.id=e6d18df5c4e74dfd8ebd9c636f45936e => generated 260 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:10.142588 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8aee8-87d4-44f2-bce9-f26ac989184a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:10.153583 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511258bd-e017-43b1-9ae8-3c2eae007418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:10.154662 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511258bd-e017-43b1-9ae8-3c2eae007418 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:10.155208 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511258bd-e017-43b1-9ae8-3c2eae007418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:10.155684 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511258bd-e017-43b1-9ae8-3c2eae007418 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:10.157021 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511258bd-e017-43b1-9ae8-3c2eae007418 admin admin] RBAC: Adding query filter params (group.id=5aa905faf66f4afaa4ae22a3b3700772, role.id=519f10f80fbd4e108392697b77c2178a, scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:10.157636 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511258bd-e017-43b1-9ae8-3c2eae007418 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:10.159878 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511258bd-e017-43b1-9ae8-3c2eae007418 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:10.179961 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 187/379] 10.222.0.35 () {56 vars in 1397 bytes} [Tue Feb 8 16:29:10 2022] GET /identity/v3/role_assignments?group.id=5aa905faf66f4afaa4ae22a3b3700772&scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6&role.id=519f10f80fbd4e108392697b77c2178a => generated 260 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:10.616738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132be227-1367-4ee3-a139-2eb35d417d54 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:10.616738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132be227-1367-4ee3-a139-2eb35d417d54 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:10.616738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132be227-1367-4ee3-a139-2eb35d417d54 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:10.616738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 193/380] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:10.623112 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bed49-93e3-4773-bbbf-fa268f646af9 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:10.623404 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bed49-93e3-4773-bbbf-fa268f646af9 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:10.623683 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bed49-93e3-4773-bbbf-fa268f646af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:10.648899 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-f61bed49-93e3-4773-bbbf-fa268f646af9 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:10.650100 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-f61bed49-93e3-4773-bbbf-fa268f646af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:10.665424 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 188/381] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:29:10.709213 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132be227-1367-4ee3-a139-2eb35d417d54 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:10.732914 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132be227-1367-4ee3-a139-2eb35d417d54 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:10.743352 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d392f0-66e7-4dc3-b444-5f50bfd12ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:10.744622 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d392f0-66e7-4dc3-b444-5f50bfd12ecd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:10.745143 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d392f0-66e7-4dc3-b444-5f50bfd12ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:10.745632 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d392f0-66e7-4dc3-b444-5f50bfd12ecd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:10.757835 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d392f0-66e7-4dc3-b444-5f50bfd12ecd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:10.768568 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-02d392f0-66e7-4dc3-b444-5f50bfd12ecd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 08 16:29:10.771410 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 194/382] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:10.776451 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bed49-93e3-4773-bbbf-fa268f646af9 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:10.789772 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bed49-93e3-4773-bbbf-fa268f646af9 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:10.801253 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dbfe6-b315-4569-8a38-07fdf0e47d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:10.802189 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dbfe6-b315-4569-8a38-07fdf0e47d81 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:10.802472 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dbfe6-b315-4569-8a38-07fdf0e47d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:10.802740 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dbfe6-b315-4569-8a38-07fdf0e47d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:10.803521 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454dbfe6-b315-4569-8a38-07fdf0e47d81 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:10.803835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454dbfe6-b315-4569-8a38-07fdf0e47d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:10.805426 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454dbfe6-b315-4569-8a38-07fdf0e47d81 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:10.820342 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 189/383] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:29:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:10.826042 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d392f0-66e7-4dc3-b444-5f50bfd12ecd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:10.837606 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d392f0-66e7-4dc3-b444-5f50bfd12ecd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:10.848325 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae796de4-b620-4948-8d7b-f307a282d02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:10.849511 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae796de4-b620-4948-8d7b-f307a282d02d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:10.850040 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae796de4-b620-4948-8d7b-f307a282d02d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:10.850511 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae796de4-b620-4948-8d7b-f307a282d02d admin admin] PATH_INFO: `/v3/groups/5aa905faf66f4afaa4ae22a3b3700772` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:10.852073 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae796de4-b620-4948-8d7b-f307a282d02d admin admin] RBAC: Authorizing `identity:get_group(group_id=5aa905faf66f4afaa4ae22a3b3700772)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:10.854251 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae796de4-b620-4948-8d7b-f307a282d02d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:10.856323 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 195/384] 10.222.0.35 () {56 vars in 1201 bytes} [Tue Feb 8 16:29:10 2022] GET /identity/v3/groups/5aa905faf66f4afaa4ae22a3b3700772 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:10.863655 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dbfe6-b315-4569-8a38-07fdf0e47d81 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:10.878197 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dbfe6-b315-4569-8a38-07fdf0e47d81 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:10.888146 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d7cd7-de42-495d-919c-5fd3b4e256e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:10.889016 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d7cd7-de42-495d-919c-5fd3b4e256e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:10.889296 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d7cd7-de42-495d-919c-5fd3b4e256e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:10.889567 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d7cd7-de42-495d-919c-5fd3b4e256e6 admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:10.895156 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d7cd7-de42-495d-919c-5fd3b4e256e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=67f1c5c4abff46008cee0510849c586e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:10.897288 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d7cd7-de42-495d-919c-5fd3b4e256e6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:10.899350 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 190/385] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:29:10 2022] GET /identity/v3/projects/67f1c5c4abff46008cee0510849c586e => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:10.905342 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae796de4-b620-4948-8d7b-f307a282d02d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:10.920357 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae796de4-b620-4948-8d7b-f307a282d02d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:10.927430 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18c8f5-cdd0-4a47-a3d0-25296471b160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:10.928626 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18c8f5-cdd0-4a47-a3d0-25296471b160 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:10.929142 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18c8f5-cdd0-4a47-a3d0-25296471b160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:10.929635 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18c8f5-cdd0-4a47-a3d0-25296471b160 admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e/groups/5aa905faf66f4afaa4ae22a3b3700772/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:10.931992 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18c8f5-cdd0-4a47-a3d0-25296471b160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f1c5c4abff46008cee0510849c586e, group_id=5aa905faf66f4afaa4ae22a3b3700772, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:10.935049 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18c8f5-cdd0-4a47-a3d0-25296471b160 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:10.963400 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 196/386] 10.222.0.35 () {58 vars in 1463 bytes} [Tue Feb 8 16:29:10 2022] PUT /identity/v3/projects/67f1c5c4abff46008cee0510849c586e/groups/5aa905faf66f4afaa4ae22a3b3700772/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:29:11.182238 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4dacb1-07c1-4ca4-920d-27055a3e18de None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:11.182574 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4dacb1-07c1-4ca4-920d-27055a3e18de None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:11.182692 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4dacb1-07c1-4ca4-920d-27055a3e18de None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:11.184774 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 191/387] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:11.191202 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539a7ee-c56b-4401-932d-efd370d7dc60 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:11.191809 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539a7ee-c56b-4401-932d-efd370d7dc60 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:11.192294 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539a7ee-c56b-4401-932d-efd370d7dc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:11.216320 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-0539a7ee-c56b-4401-932d-efd370d7dc60 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:11.217884 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0539a7ee-c56b-4401-932d-efd370d7dc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:11.294672 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 197/388] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:11.340250 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4dacb1-07c1-4ca4-920d-27055a3e18de None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:11.361544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4dacb1-07c1-4ca4-920d-27055a3e18de None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:11.369074 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9a937-9ac1-40c2-8ebc-96688a715dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:11.369891 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9a937-9ac1-40c2-8ebc-96688a715dae admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:11.370171 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9a937-9ac1-40c2-8ebc-96688a715dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:11.370443 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9a937-9ac1-40c2-8ebc-96688a715dae admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:11.393528 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9a937-9ac1-40c2-8ebc-96688a715dae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:11.400907 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-30c9a937-9ac1-40c2-8ebc-96688a715dae admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 08 16:29:11.402445 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 192/389] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:29:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:11.408120 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539a7ee-c56b-4401-932d-efd370d7dc60 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:11.423791 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539a7ee-c56b-4401-932d-efd370d7dc60 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:11.429671 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c2120-1019-4478-9edb-ee12149b4357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:11.430553 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c2120-1019-4478-9edb-ee12149b4357 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:11.431047 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c2120-1019-4478-9edb-ee12149b4357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:11.431514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c2120-1019-4478-9edb-ee12149b4357 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:11.432560 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c2120-1019-4478-9edb-ee12149b4357 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:11.433074 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c2120-1019-4478-9edb-ee12149b4357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:11.434972 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c2120-1019-4478-9edb-ee12149b4357 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:11.451710 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 198/390] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:11.459072 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9a937-9ac1-40c2-8ebc-96688a715dae admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:11.473077 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9a937-9ac1-40c2-8ebc-96688a715dae admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:11.489291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d093e-e610-4719-bdb5-8502fa46b915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:11.490162 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d093e-e610-4719-bdb5-8502fa46b915 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:11.490444 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d093e-e610-4719-bdb5-8502fa46b915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:11.490722 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d093e-e610-4719-bdb5-8502fa46b915 admin admin] PATH_INFO: `/v3/groups/5aa905faf66f4afaa4ae22a3b3700772` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:11.495429 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d093e-e610-4719-bdb5-8502fa46b915 admin admin] RBAC: Authorizing `identity:get_group(group_id=5aa905faf66f4afaa4ae22a3b3700772)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:11.497394 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d093e-e610-4719-bdb5-8502fa46b915 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:11.499309 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 193/391] 10.222.0.35 () {56 vars in 1201 bytes} [Tue Feb 8 16:29:11 2022] GET /identity/v3/groups/5aa905faf66f4afaa4ae22a3b3700772 => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:11.505495 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c2120-1019-4478-9edb-ee12149b4357 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:11.517264 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c2120-1019-4478-9edb-ee12149b4357 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:11.528086 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa18c68-bdb1-47bf-b831-b5bd224c2dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:11.529309 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa18c68-bdb1-47bf-b831-b5bd224c2dfd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:11.529792 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa18c68-bdb1-47bf-b831-b5bd224c2dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:11.530296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa18c68-bdb1-47bf-b831-b5bd224c2dfd admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:11.531869 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa18c68-bdb1-47bf-b831-b5bd224c2dfd admin admin] RBAC: Authorizing `identity:get_project(project_id=67f1c5c4abff46008cee0510849c586e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:11.534446 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa18c68-bdb1-47bf-b831-b5bd224c2dfd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:11.536463 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 199/392] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:29:11 2022] GET /identity/v3/projects/67f1c5c4abff46008cee0510849c586e => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:11.542319 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d093e-e610-4719-bdb5-8502fa46b915 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:11.557723 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d093e-e610-4719-bdb5-8502fa46b915 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:11.573395 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71300d4d-ef66-40c4-8111-910861639edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:11.574276 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71300d4d-ef66-40c4-8111-910861639edb admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:11.574555 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71300d4d-ef66-40c4-8111-910861639edb admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:11.574827 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71300d4d-ef66-40c4-8111-910861639edb admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e/groups/5aa905faf66f4afaa4ae22a3b3700772/roles/519f10f80fbd4e108392697b77c2178a` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:11.581641 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71300d4d-ef66-40c4-8111-910861639edb admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f1c5c4abff46008cee0510849c586e, group_id=5aa905faf66f4afaa4ae22a3b3700772, role_id=519f10f80fbd4e108392697b77c2178a)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:11.584291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71300d4d-ef66-40c4-8111-910861639edb admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:11.612137 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 194/393] 10.222.0.35 () {58 vars in 1463 bytes} [Tue Feb 8 16:29:11 2022] PUT /identity/v3/projects/67f1c5c4abff46008cee0510849c586e/groups/5aa905faf66f4afaa4ae22a3b3700772/roles/519f10f80fbd4e108392697b77c2178a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:29:11.796865 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342089d-aa82-419e-b3e2-0cb9098302f2 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:11.798767 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342089d-aa82-419e-b3e2-0cb9098302f2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:11.799368 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342089d-aa82-419e-b3e2-0cb9098302f2 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:11.801885 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 200/394] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:11.807273 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aeda7-641e-42cd-b3b2-a90b0013ca35 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:11.807780 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aeda7-641e-42cd-b3b2-a90b0013ca35 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:11.807857 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aeda7-641e-42cd-b3b2-a90b0013ca35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:11.836990 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-497aeda7-641e-42cd-b3b2-a90b0013ca35 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:11.838222 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-497aeda7-641e-42cd-b3b2-a90b0013ca35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:11.913089 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 195/395] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:11.939640 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342089d-aa82-419e-b3e2-0cb9098302f2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:11.953274 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342089d-aa82-419e-b3e2-0cb9098302f2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:11.959578 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56f205-ab97-4bb2-a0d9-435455677b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:11.962495 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56f205-ab97-4bb2-a0d9-435455677b4c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:11.963012 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56f205-ab97-4bb2-a0d9-435455677b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:11.963519 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56f205-ab97-4bb2-a0d9-435455677b4c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:11.981660 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56f205-ab97-4bb2-a0d9-435455677b4c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:11.990911 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-2e56f205-ab97-4bb2-a0d9-435455677b4c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 08 16:29:11.992441 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 201/396] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:11.998113 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497aeda7-641e-42cd-b3b2-a90b0013ca35 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:12.012834 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497aeda7-641e-42cd-b3b2-a90b0013ca35 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:12.024406 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac412c18-90cc-48cc-ad1b-d756ae5c9a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:12.025084 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac412c18-90cc-48cc-ad1b-d756ae5c9a65 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:12.025365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac412c18-90cc-48cc-ad1b-d756ae5c9a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:12.025637 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac412c18-90cc-48cc-ad1b-d756ae5c9a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:12.026406 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac412c18-90cc-48cc-ad1b-d756ae5c9a65 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:12.026711 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac412c18-90cc-48cc-ad1b-d756ae5c9a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:12.028332 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac412c18-90cc-48cc-ad1b-d756ae5c9a65 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:12.042003 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 196/397] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:29:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:12.048407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56f205-ab97-4bb2-a0d9-435455677b4c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:12.059514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56f205-ab97-4bb2-a0d9-435455677b4c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:12.071719 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f4f43-9252-481a-9483-d8852a977842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:12.072989 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f4f43-9252-481a-9483-d8852a977842 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:12.073542 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f4f43-9252-481a-9483-d8852a977842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:12.074032 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f4f43-9252-481a-9483-d8852a977842 admin admin] PATH_INFO: `/v3/groups/5aa905faf66f4afaa4ae22a3b3700772` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:12.075573 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f4f43-9252-481a-9483-d8852a977842 admin admin] RBAC: Authorizing `identity:get_group(group_id=5aa905faf66f4afaa4ae22a3b3700772)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:12.077828 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f4f43-9252-481a-9483-d8852a977842 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:12.080685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 202/398] 10.222.0.35 () {56 vars in 1201 bytes} [Tue Feb 8 16:29:12 2022] GET /identity/v3/groups/5aa905faf66f4afaa4ae22a3b3700772 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:12.086611 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac412c18-90cc-48cc-ad1b-d756ae5c9a65 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:12.101404 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac412c18-90cc-48cc-ad1b-d756ae5c9a65 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:12.111845 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f0dae-6a79-4464-933c-c381ae8ca66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:12.112708 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f0dae-6a79-4464-933c-c381ae8ca66e admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:12.112991 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f0dae-6a79-4464-933c-c381ae8ca66e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:12.113257 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f0dae-6a79-4464-933c-c381ae8ca66e admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:12.120529 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f0dae-6a79-4464-933c-c381ae8ca66e admin admin] RBAC: Authorizing `identity:get_project(project_id=d5fd242268f0468aa4fc52ba184ac9a6)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:12.122599 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f0dae-6a79-4464-933c-c381ae8ca66e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:12.124638 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 197/399] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:29:12 2022] GET /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6 => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:12.130534 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f4f43-9252-481a-9483-d8852a977842 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:12.147787 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f4f43-9252-481a-9483-d8852a977842 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:12.152623 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b13f5-bbf2-428e-97c0-0ca052fcb561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:12.153494 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b13f5-bbf2-428e-97c0-0ca052fcb561 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:12.153775 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b13f5-bbf2-428e-97c0-0ca052fcb561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:12.154049 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b13f5-bbf2-428e-97c0-0ca052fcb561 admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6/groups/5aa905faf66f4afaa4ae22a3b3700772/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:12.161083 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b13f5-bbf2-428e-97c0-0ca052fcb561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5fd242268f0468aa4fc52ba184ac9a6, group_id=5aa905faf66f4afaa4ae22a3b3700772, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:12.163715 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b13f5-bbf2-428e-97c0-0ca052fcb561 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:12.197867 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 203/400] 10.222.0.35 () {58 vars in 1463 bytes} [Tue Feb 8 16:29:12 2022] PUT /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6/groups/5aa905faf66f4afaa4ae22a3b3700772/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:29:13.067489 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970aa799-29fa-4436-9af3-40e942e455b3 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:13.068546 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970aa799-29fa-4436-9af3-40e942e455b3 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:13.069035 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970aa799-29fa-4436-9af3-40e942e455b3 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:13.071426 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 198/401] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:13.076521 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bdab9-046f-4a6f-a298-121a2e4c0895 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:13.076950 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bdab9-046f-4a6f-a298-121a2e4c0895 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:13.077124 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bdab9-046f-4a6f-a298-121a2e4c0895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:13.103896 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ac8bdab9-046f-4a6f-a298-121a2e4c0895 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:13.105096 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ac8bdab9-046f-4a6f-a298-121a2e4c0895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:13.184143 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 204/402] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:29:13.209209 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970aa799-29fa-4436-9af3-40e942e455b3 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:13.228203 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970aa799-29fa-4436-9af3-40e942e455b3 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:13.232908 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d695e34-f151-42a9-92bc-bffa5596d52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:13.234079 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d695e34-f151-42a9-92bc-bffa5596d52e admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:13.235144 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d695e34-f151-42a9-92bc-bffa5596d52e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:13.235655 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d695e34-f151-42a9-92bc-bffa5596d52e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:13.260356 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d695e34-f151-42a9-92bc-bffa5596d52e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:13.269162 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-8d695e34-f151-42a9-92bc-bffa5596d52e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 08 16:29:13.271647 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 199/403] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:29:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:13.276245 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bdab9-046f-4a6f-a298-121a2e4c0895 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:13.289010 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bdab9-046f-4a6f-a298-121a2e4c0895 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:13.299888 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe14be-3c8a-44c7-9463-4e6fb98b2486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:13.300557 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe14be-3c8a-44c7-9463-4e6fb98b2486 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:13.300836 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe14be-3c8a-44c7-9463-4e6fb98b2486 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:13.301109 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe14be-3c8a-44c7-9463-4e6fb98b2486 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:13.301865 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe14be-3c8a-44c7-9463-4e6fb98b2486 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:13.302163 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe14be-3c8a-44c7-9463-4e6fb98b2486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:13.303745 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe14be-3c8a-44c7-9463-4e6fb98b2486 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:13.327197 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 205/404] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:13.332756 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d695e34-f151-42a9-92bc-bffa5596d52e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:13.348683 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d695e34-f151-42a9-92bc-bffa5596d52e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:13.353567 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec0250-ef79-4c39-9bf6-b4c5a40e440c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:13.354629 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec0250-ef79-4c39-9bf6-b4c5a40e440c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:13.355165 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec0250-ef79-4c39-9bf6-b4c5a40e440c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:13.355635 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec0250-ef79-4c39-9bf6-b4c5a40e440c admin admin] PATH_INFO: `/v3/groups/5aa905faf66f4afaa4ae22a3b3700772` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:13.357147 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec0250-ef79-4c39-9bf6-b4c5a40e440c admin admin] RBAC: Authorizing `identity:get_group(group_id=5aa905faf66f4afaa4ae22a3b3700772)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:13.359278 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec0250-ef79-4c39-9bf6-b4c5a40e440c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:13.365661 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 200/405] 10.222.0.35 () {56 vars in 1201 bytes} [Tue Feb 8 16:29:13 2022] GET /identity/v3/groups/5aa905faf66f4afaa4ae22a3b3700772 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:13.371371 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe14be-3c8a-44c7-9463-4e6fb98b2486 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:13.388060 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe14be-3c8a-44c7-9463-4e6fb98b2486 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:13.400745 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d795fc-ab5c-4db5-b04b-5be6210286a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:13.401634 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d795fc-ab5c-4db5-b04b-5be6210286a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:13.401917 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d795fc-ab5c-4db5-b04b-5be6210286a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:13.402194 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d795fc-ab5c-4db5-b04b-5be6210286a6 admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:13.403511 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d795fc-ab5c-4db5-b04b-5be6210286a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5fd242268f0468aa4fc52ba184ac9a6)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:13.405645 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d795fc-ab5c-4db5-b04b-5be6210286a6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:13.408799 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 206/406] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:29:13 2022] GET /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:13.414382 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec0250-ef79-4c39-9bf6-b4c5a40e440c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:13.427767 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec0250-ef79-4c39-9bf6-b4c5a40e440c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:13.432665 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723d4c2-8e3f-46be-aaa4-ccedde3cf25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:13.433872 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723d4c2-8e3f-46be-aaa4-ccedde3cf25a admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:13.434356 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723d4c2-8e3f-46be-aaa4-ccedde3cf25a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:13.434861 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723d4c2-8e3f-46be-aaa4-ccedde3cf25a admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6/groups/5aa905faf66f4afaa4ae22a3b3700772/roles/519f10f80fbd4e108392697b77c2178a` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:13.437422 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723d4c2-8e3f-46be-aaa4-ccedde3cf25a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5fd242268f0468aa4fc52ba184ac9a6, group_id=5aa905faf66f4afaa4ae22a3b3700772, role_id=519f10f80fbd4e108392697b77c2178a)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:13.441349 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723d4c2-8e3f-46be-aaa4-ccedde3cf25a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:13.472336 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 201/407] 10.222.0.35 () {58 vars in 1463 bytes} [Tue Feb 8 16:29:13 2022] PUT /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6/groups/5aa905faf66f4afaa4ae22a3b3700772/roles/519f10f80fbd4e108392697b77c2178a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:29:13.757971 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca5d27-e250-48c4-99b7-f0175b46ccdd None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:13.758313 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca5d27-e250-48c4-99b7-f0175b46ccdd None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:13.758491 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca5d27-e250-48c4-99b7-f0175b46ccdd None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:13.760442 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 207/408] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:13.767205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea268ccc-36b7-4cd1-92ab-6630d7e6949a None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:13.767797 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea268ccc-36b7-4cd1-92ab-6630d7e6949a None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:13.768085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea268ccc-36b7-4cd1-92ab-6630d7e6949a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:13.786999 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-ea268ccc-36b7-4cd1-92ab-6630d7e6949a None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:13.789208 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-ea268ccc-36b7-4cd1-92ab-6630d7e6949a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:13.853499 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 202/409] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:13.880164 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca5d27-e250-48c4-99b7-f0175b46ccdd None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:13.898327 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca5d27-e250-48c4-99b7-f0175b46ccdd None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:13.904714 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f1c53-c33a-4a3e-bc12-982affc40e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:13.905496 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f1c53-c33a-4a3e-bc12-982affc40e93 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:13.905779 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f1c53-c33a-4a3e-bc12-982affc40e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:13.906057 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f1c53-c33a-4a3e-bc12-982affc40e93 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:13.921934 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f1c53-c33a-4a3e-bc12-982affc40e93 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:13.929487 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-f50f1c53-c33a-4a3e-bc12-982affc40e93 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:29:13.930705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 208/410] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:29:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:13.936942 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea268ccc-36b7-4cd1-92ab-6630d7e6949a None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:13.944587 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75df1a-116e-479d-82e3-4556f815dc31 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:13.944876 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75df1a-116e-479d-82e3-4556f815dc31 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:13.945147 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75df1a-116e-479d-82e3-4556f815dc31 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:13.947186 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 209/411] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:29:13.952120 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea268ccc-36b7-4cd1-92ab-6630d7e6949a None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:13.952556 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff944f1e-d949-4866-85af-4462ef6ec57e None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:13.952844 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff944f1e-d949-4866-85af-4462ef6ec57e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:13.953127 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff944f1e-d949-4866-85af-4462ef6ec57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:13.957565 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc240e8a-304e-440b-bde9-59b300c1abf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:13.958227 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc240e8a-304e-440b-bde9-59b300c1abf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:13.958513 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc240e8a-304e-440b-bde9-59b300c1abf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:13.958849 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc240e8a-304e-440b-bde9-59b300c1abf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:13.959554 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc240e8a-304e-440b-bde9-59b300c1abf0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:13.960579 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc240e8a-304e-440b-bde9-59b300c1abf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:13.962499 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc240e8a-304e-440b-bde9-59b300c1abf0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:13.976102 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 203/412] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:13.982948 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc240e8a-304e-440b-bde9-59b300c1abf0 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:13.989341 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ff944f1e-d949-4866-85af-4462ef6ec57e None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:13.990545 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ff944f1e-d949-4866-85af-4462ef6ec57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:13.997190 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc240e8a-304e-440b-bde9-59b300c1abf0 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:14.004981 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605fc9f-b9e5-468b-a0a6-cc023a72a84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:14.005942 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605fc9f-b9e5-468b-a0a6-cc023a72a84b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:14.006274 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605fc9f-b9e5-468b-a0a6-cc023a72a84b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:14.006556 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605fc9f-b9e5-468b-a0a6-cc023a72a84b admin admin] PATH_INFO: `/v3/groups/5ec6ddf7bd824a1487eb8933b3117110` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:14.007880 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605fc9f-b9e5-468b-a0a6-cc023a72a84b admin admin] RBAC: Authorizing `identity:get_group(group_id=5ec6ddf7bd824a1487eb8933b3117110)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:14.009454 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 210/413] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:29:14.010339 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605fc9f-b9e5-468b-a0a6-cc023a72a84b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:14.012115 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 204/414] 10.222.0.35 () {56 vars in 1201 bytes} [Tue Feb 8 16:29:13 2022] GET /identity/v3/groups/5ec6ddf7bd824a1487eb8933b3117110 => generated 229 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:14.020682 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff944f1e-d949-4866-85af-4462ef6ec57e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:14.033862 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff944f1e-d949-4866-85af-4462ef6ec57e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:14.039238 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa019c82-cd86-4fa9-b414-3c0c89d8d450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:14.040271 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa019c82-cd86-4fa9-b414-3c0c89d8d450 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:14.040664 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa019c82-cd86-4fa9-b414-3c0c89d8d450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:14.041001 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa019c82-cd86-4fa9-b414-3c0c89d8d450 admin admin] PATH_INFO: `/v3/projects/2b5e4fc6dd694372b7f8775a6f881cca` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:14.042301 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa019c82-cd86-4fa9-b414-3c0c89d8d450 admin admin] RBAC: Authorizing `identity:get_project(project_id=2b5e4fc6dd694372b7f8775a6f881cca)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:14.048576 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa019c82-cd86-4fa9-b414-3c0c89d8d450 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:14.050882 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 211/415] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:29:14 2022] GET /identity/v3/projects/2b5e4fc6dd694372b7f8775a6f881cca => generated 344 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:14.052342 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605fc9f-b9e5-468b-a0a6-cc023a72a84b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:14.063586 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605fc9f-b9e5-468b-a0a6-cc023a72a84b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:14.064803 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa019c82-cd86-4fa9-b414-3c0c89d8d450 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:14.074327 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261f6fb-2347-44d5-9ea6-20c814100e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:14.076404 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261f6fb-2347-44d5-9ea6-20c814100e84 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:14.076749 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261f6fb-2347-44d5-9ea6-20c814100e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:14.077024 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261f6fb-2347-44d5-9ea6-20c814100e84 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:14.086275 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa019c82-cd86-4fa9-b414-3c0c89d8d450 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:14.095210 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15da70-87f8-4f91-bca7-5ad340a30804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:14.096106 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15da70-87f8-4f91-bca7-5ad340a30804 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:14.097009 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15da70-87f8-4f91-bca7-5ad340a30804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:14.097284 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15da70-87f8-4f91-bca7-5ad340a30804 admin admin] PATH_INFO: `/v3/projects/2b5e4fc6dd694372b7f8775a6f881cca/groups/5ec6ddf7bd824a1487eb8933b3117110/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:14.101759 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15da70-87f8-4f91-bca7-5ad340a30804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b5e4fc6dd694372b7f8775a6f881cca, group_id=5ec6ddf7bd824a1487eb8933b3117110, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:14.102806 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261f6fb-2347-44d5-9ea6-20c814100e84 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:14.107457 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15da70-87f8-4f91-bca7-5ad340a30804 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:14.116188 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-8261f6fb-2347-44d5-9ea6-20c814100e84 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 08 16:29:14.117431 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 205/416] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:14.125851 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261f6fb-2347-44d5-9ea6-20c814100e84 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:14.142231 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 212/417] 10.222.0.35 () {58 vars in 1463 bytes} [Tue Feb 8 16:29:14 2022] PUT /identity/v3/projects/2b5e4fc6dd694372b7f8775a6f881cca/groups/5ec6ddf7bd824a1487eb8933b3117110/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:29:14.145448 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261f6fb-2347-44d5-9ea6-20c814100e84 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:14.209343 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e470e03-68a1-47b6-b5e0-c893627251e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:14.210105 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e470e03-68a1-47b6-b5e0-c893627251e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:14.210388 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e470e03-68a1-47b6-b5e0-c893627251e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:14.210658 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e470e03-68a1-47b6-b5e0-c893627251e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:14.211435 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e470e03-68a1-47b6-b5e0-c893627251e6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:14.211739 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e470e03-68a1-47b6-b5e0-c893627251e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:14.213684 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e470e03-68a1-47b6-b5e0-c893627251e6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:14.226201 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 206/418] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:29:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:14.231297 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15da70-87f8-4f91-bca7-5ad340a30804 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:14.243176 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15da70-87f8-4f91-bca7-5ad340a30804 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:14.248042 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731ab7b-71af-43b7-8e8c-e64648fe24a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:14.248749 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731ab7b-71af-43b7-8e8c-e64648fe24a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:14.249090 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731ab7b-71af-43b7-8e8c-e64648fe24a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:14.249364 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731ab7b-71af-43b7-8e8c-e64648fe24a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:14.259766 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731ab7b-71af-43b7-8e8c-e64648fe24a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:14.261513 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731ab7b-71af-43b7-8e8c-e64648fe24a7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:14.276752 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 213/419] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 08 16:29:14.279522 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e470e03-68a1-47b6-b5e0-c893627251e6 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:14.290336 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e470e03-68a1-47b6-b5e0-c893627251e6 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:14.294953 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c2ca5-7dde-4667-8ec7-d44a131ca6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:14.295846 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c2ca5-7dde-4667-8ec7-d44a131ca6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:14.296129 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c2ca5-7dde-4667-8ec7-d44a131ca6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:14.296400 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c2ca5-7dde-4667-8ec7-d44a131ca6c8 admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:14.297618 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c2ca5-7dde-4667-8ec7-d44a131ca6c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=67f1c5c4abff46008cee0510849c586e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:14.299768 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c2ca5-7dde-4667-8ec7-d44a131ca6c8 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:14.301670 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 207/420] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:29:14 2022] GET /identity/v3/projects/67f1c5c4abff46008cee0510849c586e => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:14.307602 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731ab7b-71af-43b7-8e8c-e64648fe24a7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:14.317715 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731ab7b-71af-43b7-8e8c-e64648fe24a7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:14.322351 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc01b6-e2be-4aff-bc9f-727abbfd28c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:14.323241 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc01b6-e2be-4aff-bc9f-727abbfd28c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:14.323622 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc01b6-e2be-4aff-bc9f-727abbfd28c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:14.323929 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc01b6-e2be-4aff-bc9f-727abbfd28c1 admin admin] PATH_INFO: `/v3/groups/5aa905faf66f4afaa4ae22a3b3700772` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:14.325333 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc01b6-e2be-4aff-bc9f-727abbfd28c1 admin admin] RBAC: Authorizing `identity:get_group(group_id=5aa905faf66f4afaa4ae22a3b3700772)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:14.327294 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc01b6-e2be-4aff-bc9f-727abbfd28c1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:14.332599 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 214/421] 10.222.0.35 () {56 vars in 1201 bytes} [Tue Feb 8 16:29:14 2022] GET /identity/v3/groups/5aa905faf66f4afaa4ae22a3b3700772 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:14.336152 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c2ca5-7dde-4667-8ec7-d44a131ca6c8 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:14.346704 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c2ca5-7dde-4667-8ec7-d44a131ca6c8 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:14.351264 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a575c42-dfb9-438b-982b-5b57553df648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:14.352010 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a575c42-dfb9-438b-982b-5b57553df648 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:14.352290 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a575c42-dfb9-438b-982b-5b57553df648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:14.352653 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a575c42-dfb9-438b-982b-5b57553df648 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:14.353506 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a575c42-dfb9-438b-982b-5b57553df648 admin admin] RBAC: Adding query filter params (group.id=5aa905faf66f4afaa4ae22a3b3700772, role.id=c5c492cc34274d1db36b946b78fa47d7, scope.project.id=67f1c5c4abff46008cee0510849c586e) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:14.353862 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a575c42-dfb9-438b-982b-5b57553df648 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:14.355812 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a575c42-dfb9-438b-982b-5b57553df648 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:14.367977 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 208/422] 10.222.0.35 () {56 vars in 1397 bytes} [Tue Feb 8 16:29:14 2022] GET /identity/v3/role_assignments?group.id=5aa905faf66f4afaa4ae22a3b3700772&scope.project.id=67f1c5c4abff46008cee0510849c586e&role.id=c5c492cc34274d1db36b946b78fa47d7 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:14.543992 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4e19d-ce90-4f1c-919e-834931147fee None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:14.544287 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4e19d-ce90-4f1c-919e-834931147fee None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:14.544508 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4e19d-ce90-4f1c-919e-834931147fee None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:14.548128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 215/423] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:14.553390 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547dd0e-4a1d-4e04-a5b9-56a3254171f3 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:14.553675 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547dd0e-4a1d-4e04-a5b9-56a3254171f3 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:14.553947 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547dd0e-4a1d-4e04-a5b9-56a3254171f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:14.574613 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-e547dd0e-4a1d-4e04-a5b9-56a3254171f3 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:14.575861 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-e547dd0e-4a1d-4e04-a5b9-56a3254171f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:14.585621 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 209/424] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:29:14.609540 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4e19d-ce90-4f1c-919e-834931147fee None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:14.621852 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4e19d-ce90-4f1c-919e-834931147fee None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:14.626239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca32935-8996-44ec-95a2-c06f7080facc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:14.627069 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca32935-8996-44ec-95a2-c06f7080facc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:14.627350 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca32935-8996-44ec-95a2-c06f7080facc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:14.627619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca32935-8996-44ec-95a2-c06f7080facc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:14.638467 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca32935-8996-44ec-95a2-c06f7080facc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:14.646581 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-5ca32935-8996-44ec-95a2-c06f7080facc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 08 16:29:14.651880 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 216/425] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:29:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:14.653958 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547dd0e-4a1d-4e04-a5b9-56a3254171f3 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:14.663936 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547dd0e-4a1d-4e04-a5b9-56a3254171f3 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:14.668389 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be01d6-1be7-42cc-ad6a-a5fd41e6d9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:14.669135 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be01d6-1be7-42cc-ad6a-a5fd41e6d9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:14.669412 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be01d6-1be7-42cc-ad6a-a5fd41e6d9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:14.669684 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be01d6-1be7-42cc-ad6a-a5fd41e6d9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:14.670491 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be01d6-1be7-42cc-ad6a-a5fd41e6d9f1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:14.670788 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be01d6-1be7-42cc-ad6a-a5fd41e6d9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:14.672538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be01d6-1be7-42cc-ad6a-a5fd41e6d9f1 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:14.684028 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 210/426] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:14.688077 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca32935-8996-44ec-95a2-c06f7080facc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:14.698689 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca32935-8996-44ec-95a2-c06f7080facc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:14.703739 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098e8f6-e906-4e71-91fa-d4485b7c2af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:14.704397 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098e8f6-e906-4e71-91fa-d4485b7c2af4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:14.704895 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098e8f6-e906-4e71-91fa-d4485b7c2af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:14.705163 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098e8f6-e906-4e71-91fa-d4485b7c2af4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:14.714004 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098e8f6-e906-4e71-91fa-d4485b7c2af4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:14.715838 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098e8f6-e906-4e71-91fa-d4485b7c2af4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:14.728147 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 217/427] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:29:14.731969 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be01d6-1be7-42cc-ad6a-a5fd41e6d9f1 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:14.742098 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be01d6-1be7-42cc-ad6a-a5fd41e6d9f1 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:14.746632 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0caf2f-38c0-400f-88cc-d8b133598f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:14.747478 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0caf2f-38c0-400f-88cc-d8b133598f45 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:14.747763 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0caf2f-38c0-400f-88cc-d8b133598f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:14.751863 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0caf2f-38c0-400f-88cc-d8b133598f45 admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:14.753174 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0caf2f-38c0-400f-88cc-d8b133598f45 admin admin] RBAC: Authorizing `identity:get_project(project_id=67f1c5c4abff46008cee0510849c586e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:14.755306 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0caf2f-38c0-400f-88cc-d8b133598f45 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:14.757436 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 211/428] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:29:14 2022] GET /identity/v3/projects/67f1c5c4abff46008cee0510849c586e => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:14.762740 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098e8f6-e906-4e71-91fa-d4485b7c2af4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:14.776206 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098e8f6-e906-4e71-91fa-d4485b7c2af4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:14.780850 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf49e0e-74f7-43e3-94c8-4ba7b7685075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:14.782535 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf49e0e-74f7-43e3-94c8-4ba7b7685075 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:14.782881 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf49e0e-74f7-43e3-94c8-4ba7b7685075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:14.783260 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf49e0e-74f7-43e3-94c8-4ba7b7685075 admin admin] PATH_INFO: `/v3/groups/5aa905faf66f4afaa4ae22a3b3700772` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:14.784676 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf49e0e-74f7-43e3-94c8-4ba7b7685075 admin admin] RBAC: Authorizing `identity:get_group(group_id=5aa905faf66f4afaa4ae22a3b3700772)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:14.787253 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf49e0e-74f7-43e3-94c8-4ba7b7685075 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:14.789906 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 218/429] 10.222.0.35 () {56 vars in 1201 bytes} [Tue Feb 8 16:29:14 2022] GET /identity/v3/groups/5aa905faf66f4afaa4ae22a3b3700772 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:14.796386 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0caf2f-38c0-400f-88cc-d8b133598f45 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:14.811263 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0caf2f-38c0-400f-88cc-d8b133598f45 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:14.818646 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc1700-69a1-490d-a3a5-3e74cb61315d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:14.819463 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc1700-69a1-490d-a3a5-3e74cb61315d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:14.819837 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc1700-69a1-490d-a3a5-3e74cb61315d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:14.820218 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc1700-69a1-490d-a3a5-3e74cb61315d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:14.821213 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc1700-69a1-490d-a3a5-3e74cb61315d admin admin] RBAC: Adding query filter params (group.id=5aa905faf66f4afaa4ae22a3b3700772, role.id=519f10f80fbd4e108392697b77c2178a, scope.project.id=67f1c5c4abff46008cee0510849c586e) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:14.821597 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc1700-69a1-490d-a3a5-3e74cb61315d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:14.823640 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc1700-69a1-490d-a3a5-3e74cb61315d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:14.832048 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 212/430] 10.222.0.35 () {56 vars in 1397 bytes} [Tue Feb 8 16:29:14 2022] GET /identity/v3/role_assignments?group.id=5aa905faf66f4afaa4ae22a3b3700772&scope.project.id=67f1c5c4abff46008cee0510849c586e&role.id=519f10f80fbd4e108392697b77c2178a => generated 611 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:15.411254 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df9e9a-f2f3-4568-860a-da37ce4f2bfb None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:15.411885 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df9e9a-f2f3-4568-860a-da37ce4f2bfb None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:15.411885 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df9e9a-f2f3-4568-860a-da37ce4f2bfb None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:15.413869 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 219/431] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:15.419725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e082e77-2f8c-4d82-be1e-10d69cf2b361 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:15.420215 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e082e77-2f8c-4d82-be1e-10d69cf2b361 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:15.420399 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e082e77-2f8c-4d82-be1e-10d69cf2b361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:15.441581 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-2e082e77-2f8c-4d82-be1e-10d69cf2b361 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:15.443095 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-2e082e77-2f8c-4d82-be1e-10d69cf2b361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:15.451242 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 213/432] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:15.476814 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df9e9a-f2f3-4568-860a-da37ce4f2bfb None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:15.493536 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df9e9a-f2f3-4568-860a-da37ce4f2bfb None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:15.497729 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a20064-007f-47e2-923f-82ca0e661b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:15.498497 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a20064-007f-47e2-923f-82ca0e661b5b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:15.498772 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a20064-007f-47e2-923f-82ca0e661b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:15.499042 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a20064-007f-47e2-923f-82ca0e661b5b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:15.511812 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a20064-007f-47e2-923f-82ca0e661b5b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:15.518977 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-f4a20064-007f-47e2-923f-82ca0e661b5b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 08 16:29:15.520514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 220/433] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:15.526196 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e082e77-2f8c-4d82-be1e-10d69cf2b361 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:15.536924 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e082e77-2f8c-4d82-be1e-10d69cf2b361 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:15.541905 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eaddeb-ce5c-4487-a74a-7d38d30d52b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:15.542562 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eaddeb-ce5c-4487-a74a-7d38d30d52b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:15.542836 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eaddeb-ce5c-4487-a74a-7d38d30d52b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:15.543186 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eaddeb-ce5c-4487-a74a-7d38d30d52b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:15.544378 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eaddeb-ce5c-4487-a74a-7d38d30d52b9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:15.544922 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eaddeb-ce5c-4487-a74a-7d38d30d52b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:15.548517 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eaddeb-ce5c-4487-a74a-7d38d30d52b9 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:15.558134 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 214/434] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:29:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:15.565144 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a20064-007f-47e2-923f-82ca0e661b5b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:15.576489 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a20064-007f-47e2-923f-82ca0e661b5b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:15.581572 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7a181-0d2b-401d-8c39-ffefa0be688e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:15.582469 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7a181-0d2b-401d-8c39-ffefa0be688e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:15.582953 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7a181-0d2b-401d-8c39-ffefa0be688e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:15.583429 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7a181-0d2b-401d-8c39-ffefa0be688e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:15.593415 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7a181-0d2b-401d-8c39-ffefa0be688e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:15.595794 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7a181-0d2b-401d-8c39-ffefa0be688e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:15.606111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 221/435] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:29:15.612898 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eaddeb-ce5c-4487-a74a-7d38d30d52b9 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:15.623890 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eaddeb-ce5c-4487-a74a-7d38d30d52b9 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:15.629601 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecee35-ba68-458b-bc52-0db42dfefaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:15.630601 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecee35-ba68-458b-bc52-0db42dfefaf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:15.630945 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecee35-ba68-458b-bc52-0db42dfefaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:15.631373 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecee35-ba68-458b-bc52-0db42dfefaf5 admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:15.632682 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecee35-ba68-458b-bc52-0db42dfefaf5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5fd242268f0468aa4fc52ba184ac9a6)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:15.634936 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecee35-ba68-458b-bc52-0db42dfefaf5 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:15.637120 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 215/436] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:29:15 2022] GET /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:15.642767 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7a181-0d2b-401d-8c39-ffefa0be688e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:15.652241 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7a181-0d2b-401d-8c39-ffefa0be688e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:15.656914 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7b9e5-426d-403e-b226-42c5883e6e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:15.657755 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7b9e5-426d-403e-b226-42c5883e6e66 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:15.658032 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7b9e5-426d-403e-b226-42c5883e6e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:15.658350 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7b9e5-426d-403e-b226-42c5883e6e66 admin admin] PATH_INFO: `/v3/groups/5aa905faf66f4afaa4ae22a3b3700772` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:15.659551 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7b9e5-426d-403e-b226-42c5883e6e66 admin admin] RBAC: Authorizing `identity:get_group(group_id=5aa905faf66f4afaa4ae22a3b3700772)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:15.661592 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7b9e5-426d-403e-b226-42c5883e6e66 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:15.663466 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 222/437] 10.222.0.35 () {56 vars in 1201 bytes} [Tue Feb 8 16:29:15 2022] GET /identity/v3/groups/5aa905faf66f4afaa4ae22a3b3700772 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:15.669064 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecee35-ba68-458b-bc52-0db42dfefaf5 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:15.679519 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecee35-ba68-458b-bc52-0db42dfefaf5 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:15.684181 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236f15e-7899-405c-9d09-db415a604b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:15.684819 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236f15e-7899-405c-9d09-db415a604b21 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:15.685095 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236f15e-7899-405c-9d09-db415a604b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:15.685426 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236f15e-7899-405c-9d09-db415a604b21 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:15.686260 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236f15e-7899-405c-9d09-db415a604b21 admin admin] RBAC: Adding query filter params (group.id=5aa905faf66f4afaa4ae22a3b3700772, role.id=c5c492cc34274d1db36b946b78fa47d7, scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:15.686615 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236f15e-7899-405c-9d09-db415a604b21 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:15.689074 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236f15e-7899-405c-9d09-db415a604b21 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:15.695845 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 216/438] 10.222.0.35 () {56 vars in 1397 bytes} [Tue Feb 8 16:29:15 2022] GET /identity/v3/role_assignments?group.id=5aa905faf66f4afaa4ae22a3b3700772&scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6&role.id=c5c492cc34274d1db36b946b78fa47d7 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:16.371413 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210049e-a312-4423-8a1f-6f316565b182 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:16.371690 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210049e-a312-4423-8a1f-6f316565b182 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:16.371989 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210049e-a312-4423-8a1f-6f316565b182 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:16.373743 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 223/439] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:16.379629 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc623a0-d46e-4294-aab1-eb30a440592c None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:16.379949 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc623a0-d46e-4294-aab1-eb30a440592c None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:16.380230 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc623a0-d46e-4294-aab1-eb30a440592c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:16.398345 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-4bc623a0-d46e-4294-aab1-eb30a440592c None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:16.399548 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-4bc623a0-d46e-4294-aab1-eb30a440592c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:16.407155 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 217/440] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:16.431348 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210049e-a312-4423-8a1f-6f316565b182 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:16.444644 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210049e-a312-4423-8a1f-6f316565b182 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:16.449052 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19cd34-45d6-4d0e-a47a-7649ade5b134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:16.449836 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19cd34-45d6-4d0e-a47a-7649ade5b134 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:16.450115 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19cd34-45d6-4d0e-a47a-7649ade5b134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:16.450387 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19cd34-45d6-4d0e-a47a-7649ade5b134 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:16.461460 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19cd34-45d6-4d0e-a47a-7649ade5b134 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:16.470207 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-1a19cd34-45d6-4d0e-a47a-7649ade5b134 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 08 16:29:16.471507 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 224/441] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:29:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:16.477560 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc623a0-d46e-4294-aab1-eb30a440592c None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:16.487845 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc623a0-d46e-4294-aab1-eb30a440592c None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:16.492302 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cb18f-2133-4443-91aa-ce2ee475e16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:16.492969 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cb18f-2133-4443-91aa-ce2ee475e16c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:16.493250 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cb18f-2133-4443-91aa-ce2ee475e16c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:16.493525 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cb18f-2133-4443-91aa-ce2ee475e16c admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:16.494303 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cb18f-2133-4443-91aa-ce2ee475e16c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:16.494639 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cb18f-2133-4443-91aa-ce2ee475e16c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:16.496388 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cb18f-2133-4443-91aa-ce2ee475e16c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:16.505500 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 218/442] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:16.511078 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19cd34-45d6-4d0e-a47a-7649ade5b134 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:16.521089 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19cd34-45d6-4d0e-a47a-7649ade5b134 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:16.525414 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33c77d-b488-4efe-8158-ab11f1734cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:16.526035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33c77d-b488-4efe-8158-ab11f1734cbc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:16.526319 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33c77d-b488-4efe-8158-ab11f1734cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:16.526598 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33c77d-b488-4efe-8158-ab11f1734cbc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:16.535267 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33c77d-b488-4efe-8158-ab11f1734cbc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:16.537044 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33c77d-b488-4efe-8158-ab11f1734cbc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:16.545856 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 225/443] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:29:16.552035 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cb18f-2133-4443-91aa-ce2ee475e16c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:16.561434 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cb18f-2133-4443-91aa-ce2ee475e16c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:16.565612 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10d3c1-2413-410a-877d-336abbb0d30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:16.566434 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10d3c1-2413-410a-877d-336abbb0d30f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:16.566709 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10d3c1-2413-410a-877d-336abbb0d30f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:16.566977 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10d3c1-2413-410a-877d-336abbb0d30f admin admin] PATH_INFO: `/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:16.568181 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a10d3c1-2413-410a-877d-336abbb0d30f admin admin] RBAC: Authorizing `identity:get_project(project_id=d5fd242268f0468aa4fc52ba184ac9a6)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:16.570210 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a10d3c1-2413-410a-877d-336abbb0d30f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:16.571838 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 219/444] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:29:16 2022] GET /identity/v3/projects/d5fd242268f0468aa4fc52ba184ac9a6 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:16.576857 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33c77d-b488-4efe-8158-ab11f1734cbc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:16.585747 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33c77d-b488-4efe-8158-ab11f1734cbc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:16.590256 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ebceb-9d19-494b-9592-ecf325fdc53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:16.591110 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ebceb-9d19-494b-9592-ecf325fdc53c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:16.591441 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ebceb-9d19-494b-9592-ecf325fdc53c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:16.591742 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ebceb-9d19-494b-9592-ecf325fdc53c admin admin] PATH_INFO: `/v3/groups/5aa905faf66f4afaa4ae22a3b3700772` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:16.592982 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ebceb-9d19-494b-9592-ecf325fdc53c admin admin] RBAC: Authorizing `identity:get_group(group_id=5aa905faf66f4afaa4ae22a3b3700772)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:16.595672 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ebceb-9d19-494b-9592-ecf325fdc53c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:16.597294 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 226/445] 10.222.0.35 () {56 vars in 1201 bytes} [Tue Feb 8 16:29:16 2022] GET /identity/v3/groups/5aa905faf66f4afaa4ae22a3b3700772 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:16.602961 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10d3c1-2413-410a-877d-336abbb0d30f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:16.613175 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10d3c1-2413-410a-877d-336abbb0d30f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:16.617392 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4409b8-4522-4088-bc8c-a7ce9f10e88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:16.618016 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4409b8-4522-4088-bc8c-a7ce9f10e88b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:16.618292 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4409b8-4522-4088-bc8c-a7ce9f10e88b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:16.618563 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4409b8-4522-4088-bc8c-a7ce9f10e88b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:16.619472 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4409b8-4522-4088-bc8c-a7ce9f10e88b admin admin] RBAC: Adding query filter params (group.id=5aa905faf66f4afaa4ae22a3b3700772, role.id=519f10f80fbd4e108392697b77c2178a, scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:16.619805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4409b8-4522-4088-bc8c-a7ce9f10e88b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:16.621632 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4409b8-4522-4088-bc8c-a7ce9f10e88b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:16.627487 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 220/446] 10.222.0.35 () {56 vars in 1397 bytes} [Tue Feb 8 16:29:16 2022] GET /identity/v3/role_assignments?group.id=5aa905faf66f4afaa4ae22a3b3700772&scope.project.id=d5fd242268f0468aa4fc52ba184ac9a6&role.id=519f10f80fbd4e108392697b77c2178a => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:16.748028 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcf524-9ee4-4fe9-8374-601addaee4a3 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:16.748312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcf524-9ee4-4fe9-8374-601addaee4a3 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:16.748592 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcf524-9ee4-4fe9-8374-601addaee4a3 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:16.751225 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 227/447] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:16.757102 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca826f46-79cb-4047-8ce3-71db33c52814 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:16.757388 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca826f46-79cb-4047-8ce3-71db33c52814 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:16.757663 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca826f46-79cb-4047-8ce3-71db33c52814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:16.777144 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-ca826f46-79cb-4047-8ce3-71db33c52814 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:16.778351 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-ca826f46-79cb-4047-8ce3-71db33c52814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:16.786252 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 221/448] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:16.810360 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcf524-9ee4-4fe9-8374-601addaee4a3 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:16.823281 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcf524-9ee4-4fe9-8374-601addaee4a3 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:16.827642 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df724614-308b-4348-b3c3-78e584b818ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:16.828475 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df724614-308b-4348-b3c3-78e584b818ad admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:16.828751 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df724614-308b-4348-b3c3-78e584b818ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:16.829015 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df724614-308b-4348-b3c3-78e584b818ad admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:16.839768 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df724614-308b-4348-b3c3-78e584b818ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:16.847093 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-df724614-308b-4348-b3c3-78e584b818ad admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:29:16.848805 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 228/449] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:29:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:16.854215 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca826f46-79cb-4047-8ce3-71db33c52814 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:16.863903 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca826f46-79cb-4047-8ce3-71db33c52814 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:16.868285 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcbf51-c2b6-4208-94c0-df3b69620e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:16.868939 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcbf51-c2b6-4208-94c0-df3b69620e21 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:16.869236 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcbf51-c2b6-4208-94c0-df3b69620e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:16.869488 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcbf51-c2b6-4208-94c0-df3b69620e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:16.870248 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcbf51-c2b6-4208-94c0-df3b69620e21 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:16.870551 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcbf51-c2b6-4208-94c0-df3b69620e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:16.872338 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcbf51-c2b6-4208-94c0-df3b69620e21 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:16.881353 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 222/450] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:16.886826 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df724614-308b-4348-b3c3-78e584b818ad admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:16.897188 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df724614-308b-4348-b3c3-78e584b818ad admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:16.904255 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5def90-db18-4cc5-973f-aff1f9e3b8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:16.904885 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5def90-db18-4cc5-973f-aff1f9e3b8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:16.905220 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5def90-db18-4cc5-973f-aff1f9e3b8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:16.905538 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5def90-db18-4cc5-973f-aff1f9e3b8c2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:16.914638 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5def90-db18-4cc5-973f-aff1f9e3b8c2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:16.916419 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5def90-db18-4cc5-973f-aff1f9e3b8c2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:16.926091 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 229/451] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:29:16.931683 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcbf51-c2b6-4208-94c0-df3b69620e21 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:16.942395 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcbf51-c2b6-4208-94c0-df3b69620e21 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:16.946759 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092fd49-3ac9-4e58-94df-4cba51fd7b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:16.947599 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092fd49-3ac9-4e58-94df-4cba51fd7b41 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:16.947965 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092fd49-3ac9-4e58-94df-4cba51fd7b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:16.948284 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092fd49-3ac9-4e58-94df-4cba51fd7b41 admin admin] PATH_INFO: `/v3/projects/2b5e4fc6dd694372b7f8775a6f881cca` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:16.949478 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092fd49-3ac9-4e58-94df-4cba51fd7b41 admin admin] RBAC: Authorizing `identity:get_project(project_id=2b5e4fc6dd694372b7f8775a6f881cca)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:16.951247 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092fd49-3ac9-4e58-94df-4cba51fd7b41 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:16.952972 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 223/452] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:29:16 2022] GET /identity/v3/projects/2b5e4fc6dd694372b7f8775a6f881cca => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:16.958710 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5def90-db18-4cc5-973f-aff1f9e3b8c2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:16.968096 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5def90-db18-4cc5-973f-aff1f9e3b8c2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:16.972617 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594fd22-90f7-41e3-8124-ae66bed66456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:16.973441 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594fd22-90f7-41e3-8124-ae66bed66456 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:16.973722 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594fd22-90f7-41e3-8124-ae66bed66456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:16.974004 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594fd22-90f7-41e3-8124-ae66bed66456 admin admin] PATH_INFO: `/v3/groups/5ec6ddf7bd824a1487eb8933b3117110` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:16.975196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594fd22-90f7-41e3-8124-ae66bed66456 admin admin] RBAC: Authorizing `identity:get_group(group_id=5ec6ddf7bd824a1487eb8933b3117110)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:16.977136 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594fd22-90f7-41e3-8124-ae66bed66456 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:16.978705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 230/453] 10.222.0.35 () {56 vars in 1201 bytes} [Tue Feb 8 16:29:16 2022] GET /identity/v3/groups/5ec6ddf7bd824a1487eb8933b3117110 => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:16.985298 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092fd49-3ac9-4e58-94df-4cba51fd7b41 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:16.994940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092fd49-3ac9-4e58-94df-4cba51fd7b41 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:16.999238 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787126f7-487e-4a21-9904-e80f07552850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:16.999932 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787126f7-487e-4a21-9904-e80f07552850 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:17.000804 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787126f7-487e-4a21-9904-e80f07552850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:17.001184 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787126f7-487e-4a21-9904-e80f07552850 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:17.002024 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787126f7-487e-4a21-9904-e80f07552850 admin admin] RBAC: Adding query filter params (group.id=5ec6ddf7bd824a1487eb8933b3117110, role.id=e6d18df5c4e74dfd8ebd9c636f45936e, scope.project.id=2b5e4fc6dd694372b7f8775a6f881cca) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:17.002336 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787126f7-487e-4a21-9904-e80f07552850 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:17.004208 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787126f7-487e-4a21-9904-e80f07552850 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:17.009864 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 224/454] 10.222.0.35 () {56 vars in 1397 bytes} [Tue Feb 8 16:29:16 2022] GET /identity/v3/role_assignments?group.id=5ec6ddf7bd824a1487eb8933b3117110&scope.project.id=2b5e4fc6dd694372b7f8775a6f881cca&role.id=e6d18df5c4e74dfd8ebd9c636f45936e => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:19.704709 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf41b6-2df1-46b5-81a4-04a291e3ce0b None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:19.705219 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf41b6-2df1-46b5-81a4-04a291e3ce0b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:19.705219 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf41b6-2df1-46b5-81a4-04a291e3ce0b None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:19.707201 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 231/455] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:19.713139 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4802f0-1300-4955-b6cb-bc88f610ada7 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:19.713589 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4802f0-1300-4955-b6cb-bc88f610ada7 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:19.713764 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4802f0-1300-4955-b6cb-bc88f610ada7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:19.732439 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-0c4802f0-1300-4955-b6cb-bc88f610ada7 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:19.733629 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-0c4802f0-1300-4955-b6cb-bc88f610ada7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:19.742151 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 225/456] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:29:19.768402 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf41b6-2df1-46b5-81a4-04a291e3ce0b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:19.781745 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf41b6-2df1-46b5-81a4-04a291e3ce0b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:19.786105 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1eb466-d007-4101-9652-aaf5b73e8ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:19.786879 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1eb466-d007-4101-9652-aaf5b73e8ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:19.787159 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1eb466-d007-4101-9652-aaf5b73e8ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:19.787433 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1eb466-d007-4101-9652-aaf5b73e8ea4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:19.798544 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1eb466-d007-4101-9652-aaf5b73e8ea4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:19.800417 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1eb466-d007-4101-9652-aaf5b73e8ea4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:19.818264 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-2a1eb466-d007-4101-9652-aaf5b73e8ea4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:19.819778 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 232/457] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:19.825480 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4802f0-1300-4955-b6cb-bc88f610ada7 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:19.835115 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4802f0-1300-4955-b6cb-bc88f610ada7 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:19.839808 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e706c4-8794-4876-a42f-703abf521fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:19.840461 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e706c4-8794-4876-a42f-703abf521fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:19.840739 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e706c4-8794-4876-a42f-703abf521fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:19.841016 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e706c4-8794-4876-a42f-703abf521fc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:19.841753 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e706c4-8794-4876-a42f-703abf521fc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:19.842057 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e706c4-8794-4876-a42f-703abf521fc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:19.843687 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e706c4-8794-4876-a42f-703abf521fc0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:19.856159 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 226/458] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:19.861794 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1eb466-d007-4101-9652-aaf5b73e8ea4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:19.871557 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1eb466-d007-4101-9652-aaf5b73e8ea4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:19.876158 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81489676-f27d-4842-a651-c52f0df6fb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:19.876823 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81489676-f27d-4842-a651-c52f0df6fb09 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:19.877104 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81489676-f27d-4842-a651-c52f0df6fb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:19.877378 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81489676-f27d-4842-a651-c52f0df6fb09 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:19.878104 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81489676-f27d-4842-a651-c52f0df6fb09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:19.880064 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81489676-f27d-4842-a651-c52f0df6fb09 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:19.914823 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 233/459] 10.222.0.35 () {60 vars in 1153 bytes} [Tue Feb 8 16:29:19 2022] POST /identity/v3/users => generated 246 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:29:19.977425 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f19a35-6074-45a8-80db-0420073ee5d3 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:19.977713 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f19a35-6074-45a8-80db-0420073ee5d3 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:19.977868 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f19a35-6074-45a8-80db-0420073ee5d3 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:19.979814 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 227/460] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:19.990458 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabfad5-58fa-400c-b7a1-56c214a568e0 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:19.990782 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabfad5-58fa-400c-b7a1-56c214a568e0 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:19.991017 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabfad5-58fa-400c-b7a1-56c214a568e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:20.024525 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-0eabfad5-58fa-400c-b7a1-56c214a568e0 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:20.026240 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0eabfad5-58fa-400c-b7a1-56c214a568e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:20.039966 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 234/461] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:29:20.044150 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd593eb-c80b-47fa-83f8-02f2a2a9008f None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:20.044457 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd593eb-c80b-47fa-83f8-02f2a2a9008f None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:20.044713 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd593eb-c80b-47fa-83f8-02f2a2a9008f None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:20.047361 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 228/462] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:20.053141 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915666f4-4830-4d03-8b07-8f70f6ea03df None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:20.053423 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915666f4-4830-4d03-8b07-8f70f6ea03df None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:20.053701 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915666f4-4830-4d03-8b07-8f70f6ea03df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:20.086867 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-915666f4-4830-4d03-8b07-8f70f6ea03df None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:20.087060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd593eb-c80b-47fa-83f8-02f2a2a9008f None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:20.088147 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-915666f4-4830-4d03-8b07-8f70f6ea03df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:20.101990 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd593eb-c80b-47fa-83f8-02f2a2a9008f None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:20.106919 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b1695-9e1e-441d-a2ab-b42d1afb3911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:20.107743 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b1695-9e1e-441d-a2ab-b42d1afb3911 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:20.108045 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b1695-9e1e-441d-a2ab-b42d1afb3911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:20.108419 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b1695-9e1e-441d-a2ab-b42d1afb3911 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:20.114237 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 235/463] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:20.121242 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b1695-9e1e-441d-a2ab-b42d1afb3911 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:20.123087 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b1695-9e1e-441d-a2ab-b42d1afb3911 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:20.141018 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-e72b1695-9e1e-441d-a2ab-b42d1afb3911 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:20.143035 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 229/464] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:20.148432 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915666f4-4830-4d03-8b07-8f70f6ea03df None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:20.152589 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b1695-9e1e-441d-a2ab-b42d1afb3911 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:20.163016 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b1695-9e1e-441d-a2ab-b42d1afb3911 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:20.164709 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915666f4-4830-4d03-8b07-8f70f6ea03df None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:20.167588 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132daac-152f-439d-9877-d9d59325e242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:20.168405 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132daac-152f-439d-9877-d9d59325e242 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:20.168795 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132daac-152f-439d-9877-d9d59325e242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:20.169176 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132daac-152f-439d-9877-d9d59325e242 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:20.174924 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e07da-1611-432a-b973-d44ccd9a38b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:20.175589 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e07da-1611-432a-b973-d44ccd9a38b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:20.175898 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e07da-1611-432a-b973-d44ccd9a38b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:20.176179 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e07da-1611-432a-b973-d44ccd9a38b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:20.176927 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e07da-1611-432a-b973-d44ccd9a38b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:20.177235 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e07da-1611-432a-b973-d44ccd9a38b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:20.178267 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-c14e07da-1611-432a-b973-d44ccd9a38b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:29:20.178267 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Feb 08 16:29:20.178267 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: Feb 08 16:29:20.179149 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e07da-1611-432a-b973-d44ccd9a38b3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:20.181881 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132daac-152f-439d-9877-d9d59325e242 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:20.183705 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132daac-152f-439d-9877-d9d59325e242 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:20.201822 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-3132daac-152f-439d-9877-d9d59325e242 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:20.203408 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 230/465] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:20.209003 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132daac-152f-439d-9877-d9d59325e242 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:20.211551 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 236/466] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:20.216793 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e07da-1611-432a-b973-d44ccd9a38b3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:20.220170 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132daac-152f-439d-9877-d9d59325e242 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:20.224727 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e79c7-e286-4c0c-aa2c-27d01abc159c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:20.225448 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e79c7-e286-4c0c-aa2c-27d01abc159c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:20.225736 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e79c7-e286-4c0c-aa2c-27d01abc159c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:20.226012 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e79c7-e286-4c0c-aa2c-27d01abc159c admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:20.226753 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e79c7-e286-4c0c-aa2c-27d01abc159c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:20.227059 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e79c7-e286-4c0c-aa2c-27d01abc159c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:20.228938 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e79c7-e286-4c0c-aa2c-27d01abc159c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:20.236535 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e07da-1611-432a-b973-d44ccd9a38b3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:20.241643 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c23d3-c6c7-450c-aea3-acf036efb891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:20.242307 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c23d3-c6c7-450c-aea3-acf036efb891 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:20.242594 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c23d3-c6c7-450c-aea3-acf036efb891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:20.242849 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 231/467] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:20.243012 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c23d3-c6c7-450c-aea3-acf036efb891 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:20.243582 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c23d3-c6c7-450c-aea3-acf036efb891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:20.245532 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c23d3-c6c7-450c-aea3-acf036efb891 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:20.248476 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e79c7-e286-4c0c-aa2c-27d01abc159c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:20.258672 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e79c7-e286-4c0c-aa2c-27d01abc159c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:20.266551 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3dce5e-a8cf-43c4-92fc-0bd486e964a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:20.267699 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dce5e-a8cf-43c4-92fc-0bd486e964a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:20.268157 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dce5e-a8cf-43c4-92fc-0bd486e964a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:20.268523 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dce5e-a8cf-43c4-92fc-0bd486e964a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:20.269267 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3dce5e-a8cf-43c4-92fc-0bd486e964a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:20.271253 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3dce5e-a8cf-43c4-92fc-0bd486e964a0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:20.277465 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 237/468] 10.222.0.35 () {60 vars in 1153 bytes} [Tue Feb 8 16:29:20 2022] POST /identity/v3/users => generated 248 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:29:20.298881 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 232/469] 10.222.0.35 () {60 vars in 1153 bytes} [Tue Feb 8 16:29:20 2022] POST /identity/v3/users => generated 248 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:29:20.832464 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc21ec8-b6e2-4c4d-90b6-b02295095299 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:20.832980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc21ec8-b6e2-4c4d-90b6-b02295095299 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:20.833054 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc21ec8-b6e2-4c4d-90b6-b02295095299 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:20.835065 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 238/470] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:20.849721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86905f7b-4549-457f-89a3-f62f74d874d2 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:20.850192 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86905f7b-4549-457f-89a3-f62f74d874d2 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:20.850265 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86905f7b-4549-457f-89a3-f62f74d874d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:20.872521 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-86905f7b-4549-457f-89a3-f62f74d874d2 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:20.873707 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-86905f7b-4549-457f-89a3-f62f74d874d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:20.883507 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 233/471] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:20.914525 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc21ec8-b6e2-4c4d-90b6-b02295095299 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:20.929485 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc21ec8-b6e2-4c4d-90b6-b02295095299 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:20.933810 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bf840-c1e9-4275-a02f-3b04a7352d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:20.934578 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bf840-c1e9-4275-a02f-3b04a7352d68 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:20.934860 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bf840-c1e9-4275-a02f-3b04a7352d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:20.935135 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bf840-c1e9-4275-a02f-3b04a7352d68 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:20.951866 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910bf840-c1e9-4275-a02f-3b04a7352d68 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:20.953931 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910bf840-c1e9-4275-a02f-3b04a7352d68 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:20.975007 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-910bf840-c1e9-4275-a02f-3b04a7352d68 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:20.976569 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 239/472] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:20.982248 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86905f7b-4549-457f-89a3-f62f74d874d2 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:20.996734 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86905f7b-4549-457f-89a3-f62f74d874d2 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:21.005915 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2445f5-00cf-4b10-aae7-398910a17c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:21.006567 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2445f5-00cf-4b10-aae7-398910a17c1c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:21.006895 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2445f5-00cf-4b10-aae7-398910a17c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:21.007170 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2445f5-00cf-4b10-aae7-398910a17c1c admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:21.007937 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2445f5-00cf-4b10-aae7-398910a17c1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:21.008240 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2445f5-00cf-4b10-aae7-398910a17c1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:21.009805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2445f5-00cf-4b10-aae7-398910a17c1c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:21.024536 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 234/473] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:21.030495 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bf840-c1e9-4275-a02f-3b04a7352d68 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:21.044989 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bf840-c1e9-4275-a02f-3b04a7352d68 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:21.050015 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580b9a1-cf1c-4d01-9529-7310ab6ed8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:21.050677 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580b9a1-cf1c-4d01-9529-7310ab6ed8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:21.050960 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580b9a1-cf1c-4d01-9529-7310ab6ed8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:21.051240 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580b9a1-cf1c-4d01-9529-7310ab6ed8f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:21.051999 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580b9a1-cf1c-4d01-9529-7310ab6ed8f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:21.053918 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580b9a1-cf1c-4d01-9529-7310ab6ed8f9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:21.093168 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 240/474] 10.222.0.35 () {60 vars in 1153 bytes} [Tue Feb 8 16:29:21 2022] POST /identity/v3/users => generated 249 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:29:21.411572 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4e80b-4918-4ad3-9bda-5c75b2530951 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:21.411911 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4e80b-4918-4ad3-9bda-5c75b2530951 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:21.412088 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4e80b-4918-4ad3-9bda-5c75b2530951 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:21.413844 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 235/475] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:21.419612 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90468254-73ba-4e2d-b465-17447885fc11 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:21.419944 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90468254-73ba-4e2d-b465-17447885fc11 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:21.420221 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90468254-73ba-4e2d-b465-17447885fc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:21.442261 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-90468254-73ba-4e2d-b465-17447885fc11 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:21.443467 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-90468254-73ba-4e2d-b465-17447885fc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:21.451446 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 241/476] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:21.475947 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4e80b-4918-4ad3-9bda-5c75b2530951 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:21.494731 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4e80b-4918-4ad3-9bda-5c75b2530951 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:21.499373 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5b986-30d0-412a-8704-fd5938623a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:21.500986 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5b986-30d0-412a-8704-fd5938623a10 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:21.501293 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5b986-30d0-412a-8704-fd5938623a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:21.501567 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5b986-30d0-412a-8704-fd5938623a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:21.502354 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5b986-30d0-412a-8704-fd5938623a10 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:21.503997 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5b986-30d0-412a-8704-fd5938623a10 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:21.517602 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.sql.core [None req-08a5b986-30d0-412a-8704-fd5938623a10 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 08 16:29:21.517602 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 08 16:29:21.517602 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [parameters: {'id': '934c985bfaad428fbbd8829970000be3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 08 16:29:21.517602 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79340) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 08 16:29:21.531867 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-08a5b986-30d0-412a-8704-fd5938623a10 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 08 16:29:21.533284 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 236/477] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:29:21 2022] POST /identity/v3/roles => generated 144 bytes in 58 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:21.540241 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90468254-73ba-4e2d-b465-17447885fc11 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:21.551655 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90468254-73ba-4e2d-b465-17447885fc11 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:21.556571 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b08916-b94a-4577-90ec-40fdc5e82b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:21.557612 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b08916-b94a-4577-90ec-40fdc5e82b2a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:21.558040 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b08916-b94a-4577-90ec-40fdc5e82b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:21.558460 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b08916-b94a-4577-90ec-40fdc5e82b2a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:21.575869 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b08916-b94a-4577-90ec-40fdc5e82b2a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:21.583327 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-60b08916-b94a-4577-90ec-40fdc5e82b2a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 08 16:29:21.589671 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 242/478] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:29:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:21.591027 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5b986-30d0-412a-8704-fd5938623a10 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:21.607287 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5b986-30d0-412a-8704-fd5938623a10 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:21.617054 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903dffa-5e84-4761-8f77-c03e93d17962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:21.618011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903dffa-5e84-4761-8f77-c03e93d17962 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:21.618290 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903dffa-5e84-4761-8f77-c03e93d17962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:21.618560 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903dffa-5e84-4761-8f77-c03e93d17962 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:21.619349 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903dffa-5e84-4761-8f77-c03e93d17962 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:21.619653 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903dffa-5e84-4761-8f77-c03e93d17962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:21.621395 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903dffa-5e84-4761-8f77-c03e93d17962 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:21.631467 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 237/479] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:23.040076 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e2384-65a5-45b6-8aca-16fbbbfb4b4c None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.041138 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e2384-65a5-45b6-8aca-16fbbbfb4b4c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.041639 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e2384-65a5-45b6-8aca-16fbbbfb4b4c None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.044092 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 243/480] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:23.053295 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef37aab-73c3-4984-9157-08f471d26ab1 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.054164 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef37aab-73c3-4984-9157-08f471d26ab1 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.054657 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef37aab-73c3-4984-9157-08f471d26ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.080820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-4ef37aab-73c3-4984-9157-08f471d26ab1 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:23.082031 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-4ef37aab-73c3-4984-9157-08f471d26ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:23.089946 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 238/481] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:23.098519 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7e05e-79aa-4bef-8bf1-e4f57a00f67b None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.099078 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7e05e-79aa-4bef-8bf1-e4f57a00f67b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.099615 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7e05e-79aa-4bef-8bf1-e4f57a00f67b None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.101859 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 244/482] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:23.106848 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade97958-7d66-444f-a09c-23b22a061268 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.107137 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade97958-7d66-444f-a09c-23b22a061268 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.107417 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade97958-7d66-444f-a09c-23b22a061268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.113039 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7e05e-79aa-4bef-8bf1-e4f57a00f67b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.127647 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-ade97958-7d66-444f-a09c-23b22a061268 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:23.128883 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-ade97958-7d66-444f-a09c-23b22a061268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:23.136411 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7e05e-79aa-4bef-8bf1-e4f57a00f67b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.137060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 239/483] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:23.141761 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4afef-9d46-4317-9b33-6d4291c0f40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.143096 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4afef-9d46-4317-9b33-6d4291c0f40a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.143590 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4afef-9d46-4317-9b33-6d4291c0f40a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.144113 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4afef-9d46-4317-9b33-6d4291c0f40a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.162495 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade97958-7d66-444f-a09c-23b22a061268 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.173047 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade97958-7d66-444f-a09c-23b22a061268 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.174049 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4afef-9d46-4317-9b33-6d4291c0f40a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:23.181588 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-93c4afef-9d46-4317-9b33-6d4291c0f40a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 08 16:29:23.183825 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 245/484] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:23.185789 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6b633-5f07-4eb9-824f-4b2971a377f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.186887 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6b633-5f07-4eb9-824f-4b2971a377f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.188081 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6b633-5f07-4eb9-824f-4b2971a377f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.188786 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6b633-5f07-4eb9-824f-4b2971a377f9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.189929 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4afef-9d46-4317-9b33-6d4291c0f40a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.205037 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4afef-9d46-4317-9b33-6d4291c0f40a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.214290 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6b633-5f07-4eb9-824f-4b2971a377f9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:23.216437 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac8bdf-8251-4a4d-8ad1-6149e367e256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.217102 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac8bdf-8251-4a4d-8ad1-6149e367e256 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.217380 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac8bdf-8251-4a4d-8ad1-6149e367e256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.217650 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac8bdf-8251-4a4d-8ad1-6149e367e256 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.218950 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac8bdf-8251-4a4d-8ad1-6149e367e256 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:23.219374 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac8bdf-8251-4a4d-8ad1-6149e367e256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.221168 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac8bdf-8251-4a4d-8ad1-6149e367e256 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.224216 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-0aa6b633-5f07-4eb9-824f-4b2971a377f9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 08 16:29:23.225988 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 240/485] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:23.231980 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6b633-5f07-4eb9-824f-4b2971a377f9 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.243315 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 246/486] 10.222.0.35 () {56 vars in 1124 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:23.244969 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6b633-5f07-4eb9-824f-4b2971a377f9 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.248775 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac8bdf-8251-4a4d-8ad1-6149e367e256 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.249646 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a016a-a7db-4f78-b8e2-bb03a52ab1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.255773 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a016a-a7db-4f78-b8e2-bb03a52ab1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.255773 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a016a-a7db-4f78-b8e2-bb03a52ab1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.255773 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a016a-a7db-4f78-b8e2-bb03a52ab1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.255773 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a016a-a7db-4f78-b8e2-bb03a52ab1a4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:23.255773 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a016a-a7db-4f78-b8e2-bb03a52ab1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.255773 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a016a-a7db-4f78-b8e2-bb03a52ab1a4 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.263820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 241/487] 10.222.0.35 () {56 vars in 1124 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:23.270662 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a016a-a7db-4f78-b8e2-bb03a52ab1a4 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.278142 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac8bdf-8251-4a4d-8ad1-6149e367e256 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.280889 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a016a-a7db-4f78-b8e2-bb03a52ab1a4 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.285254 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d046d-9416-4465-bac6-e0f93cd00883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.285458 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2b43c-d80d-44d1-9b88-20e090dad090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.286211 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2b43c-d80d-44d1-9b88-20e090dad090 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.286491 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2b43c-d80d-44d1-9b88-20e090dad090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.286764 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2b43c-d80d-44d1-9b88-20e090dad090 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.287059 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d046d-9416-4465-bac6-e0f93cd00883 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.287687 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d046d-9416-4465-bac6-e0f93cd00883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.288172 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d046d-9416-4465-bac6-e0f93cd00883 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.298064 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2b43c-d80d-44d1-9b88-20e090dad090 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.299851 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2b43c-d80d-44d1-9b88-20e090dad090 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.319334 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-b2d2b43c-d80d-44d1-9b88-20e090dad090 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:23.320805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 242/488] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:23.322910 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d046d-9416-4465-bac6-e0f93cd00883 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.329561 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d046d-9416-4465-bac6-e0f93cd00883 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.331328 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2b43c-d80d-44d1-9b88-20e090dad090 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.344420 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2b43c-d80d-44d1-9b88-20e090dad090 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.350116 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfb657-96e8-4a07-acf3-6f5129b3f9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.350772 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfb657-96e8-4a07-acf3-6f5129b3f9ad admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.351053 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfb657-96e8-4a07-acf3-6f5129b3f9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.351328 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfb657-96e8-4a07-acf3-6f5129b3f9ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.352262 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfb657-96e8-4a07-acf3-6f5129b3f9ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:23.352577 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfb657-96e8-4a07-acf3-6f5129b3f9ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.354214 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfb657-96e8-4a07-acf3-6f5129b3f9ad admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.367023 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 243/489] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:23.368166 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-557d046d-9416-4465-bac6-e0f93cd00883 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:23.369675 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 247/490] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:23.372333 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfb657-96e8-4a07-acf3-6f5129b3f9ad admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.374711 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d046d-9416-4465-bac6-e0f93cd00883 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.382807 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfb657-96e8-4a07-acf3-6f5129b3f9ad admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.388395 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ee4ac-a656-4126-8bb2-25bd1d3ecec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.389178 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ee4ac-a656-4126-8bb2-25bd1d3ecec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.389458 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ee4ac-a656-4126-8bb2-25bd1d3ecec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.389733 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ee4ac-a656-4126-8bb2-25bd1d3ecec9 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.394529 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d046d-9416-4465-bac6-e0f93cd00883 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.398994 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ee4ac-a656-4126-8bb2-25bd1d3ecec9 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.401165 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ee4ac-a656-4126-8bb2-25bd1d3ecec9 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.412559 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddd60f-6284-4d1e-9d29-56516aaf3937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.413229 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddd60f-6284-4d1e-9d29-56516aaf3937 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.413515 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddd60f-6284-4d1e-9d29-56516aaf3937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.413793 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddd60f-6284-4d1e-9d29-56516aaf3937 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.414541 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddd60f-6284-4d1e-9d29-56516aaf3937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:23.414844 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddd60f-6284-4d1e-9d29-56516aaf3937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.416502 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddd60f-6284-4d1e-9d29-56516aaf3937 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.416633 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-ec7ee4ac-a656-4126-8bb2-25bd1d3ecec9 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 08 16:29:23.418294 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 244/491] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:23.425084 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ee4ac-a656-4126-8bb2-25bd1d3ecec9 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.436002 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ee4ac-a656-4126-8bb2-25bd1d3ecec9 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.443494 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b5821-4720-48d5-8870-dfdd3bf62dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.444399 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b5821-4720-48d5-8870-dfdd3bf62dfe admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.444686 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b5821-4720-48d5-8870-dfdd3bf62dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.444963 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b5821-4720-48d5-8870-dfdd3bf62dfe admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.445887 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b5821-4720-48d5-8870-dfdd3bf62dfe admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:23.446196 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b5821-4720-48d5-8870-dfdd3bf62dfe admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.446499 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 248/492] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:23.447323 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING py.warnings [None req-f42b5821-4720-48d5-8870-dfdd3bf62dfe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:29:23.447323 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: warnings.warn(msg) Feb 08 16:29:23.447323 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: Feb 08 16:29:23.448552 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b5821-4720-48d5-8870-dfdd3bf62dfe admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.451256 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddd60f-6284-4d1e-9d29-56516aaf3937 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.474214 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddd60f-6284-4d1e-9d29-56516aaf3937 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.493237 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a61e7-c585-43d0-83c4-26fddf8a06f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.494027 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a61e7-c585-43d0-83c4-26fddf8a06f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.494305 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a61e7-c585-43d0-83c4-26fddf8a06f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.494568 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a61e7-c585-43d0-83c4-26fddf8a06f8 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.494753 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 245/493] 10.222.0.35 () {56 vars in 1158 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:23.501189 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b5821-4720-48d5-8870-dfdd3bf62dfe admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.512525 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b5821-4720-48d5-8870-dfdd3bf62dfe admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.518437 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86c5bc-5c9d-46bb-8a60-a641bf01df7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.519077 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86c5bc-5c9d-46bb-8a60-a641bf01df7e admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.519584 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86c5bc-5c9d-46bb-8a60-a641bf01df7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.520080 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86c5bc-5c9d-46bb-8a60-a641bf01df7e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.520490 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a61e7-c585-43d0-83c4-26fddf8a06f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.522538 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a61e7-c585-43d0-83c4-26fddf8a06f8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.528988 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86c5bc-5c9d-46bb-8a60-a641bf01df7e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.531165 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86c5bc-5c9d-46bb-8a60-a641bf01df7e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.542456 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 246/494] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 08 16:29:23.544604 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-7c5a61e7-c585-43d0-83c4-26fddf8a06f8 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 08 16:29:23.546078 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 249/495] 10.222.0.35 () {56 vars in 1114 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:23.549005 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b5c51-863e-43d1-bfb3-622ea554081a None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.549005 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b5c51-863e-43d1-bfb3-622ea554081a None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.551465 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b5c51-863e-43d1-bfb3-622ea554081a None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.553423 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 247/496] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:23 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:23.554347 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a61e7-c585-43d0-83c4-26fddf8a06f8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.555467 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b5c51-863e-43d1-bfb3-622ea554081a None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.566270 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a61e7-c585-43d0-83c4-26fddf8a06f8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.570803 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a4a04-f3dc-4d24-9de0-f2e8c83b69df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.571492 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a4a04-f3dc-4d24-9de0-f2e8c83b69df admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.571790 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a4a04-f3dc-4d24-9de0-f2e8c83b69df admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.572079 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a4a04-f3dc-4d24-9de0-f2e8c83b69df admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.572954 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a4a04-f3dc-4d24-9de0-f2e8c83b69df admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:23.573150 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b5c51-863e-43d1-bfb3-622ea554081a None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.573305 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a4a04-f3dc-4d24-9de0-f2e8c83b69df admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.574328 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-ef5a4a04-f3dc-4d24-9de0-f2e8c83b69df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:29:23.574328 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Feb 08 16:29:23.574328 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: Feb 08 16:29:23.575539 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a4a04-f3dc-4d24-9de0-f2e8c83b69df admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.577997 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c6371-b09b-4dd4-aeba-a254325fda59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.578768 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c6371-b09b-4dd4-aeba-a254325fda59 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.579050 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c6371-b09b-4dd4-aeba-a254325fda59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.579322 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c6371-b09b-4dd4-aeba-a254325fda59 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.591628 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c6371-b09b-4dd4-aeba-a254325fda59 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.593920 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c6371-b09b-4dd4-aeba-a254325fda59 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.614248 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-787c6371-b09b-4dd4-aeba-a254325fda59 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:23.614659 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 250/497] 10.222.0.35 () {56 vars in 1154 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:23.620066 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 248/498] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:23.620546 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56719a83-697e-482f-b7ac-a28d260560a2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.620935 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56719a83-697e-482f-b7ac-a28d260560a2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.621151 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c6371-b09b-4dd4-aeba-a254325fda59 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.621307 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56719a83-697e-482f-b7ac-a28d260560a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.632569 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c6371-b09b-4dd4-aeba-a254325fda59 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.638221 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a582f96-b71e-449c-9a16-011218c47998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.638868 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a582f96-b71e-449c-9a16-011218c47998 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.639150 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a582f96-b71e-449c-9a16-011218c47998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.639426 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a582f96-b71e-449c-9a16-011218c47998 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.640187 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a582f96-b71e-449c-9a16-011218c47998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:23.640383 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-56719a83-697e-482f-b7ac-a28d260560a2 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:23.640531 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a582f96-b71e-449c-9a16-011218c47998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.641722 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-56719a83-697e-482f-b7ac-a28d260560a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:23.642104 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a582f96-b71e-449c-9a16-011218c47998 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.650183 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 251/499] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:23.651013 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56719a83-697e-482f-b7ac-a28d260560a2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.661742 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56719a83-697e-482f-b7ac-a28d260560a2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.662992 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 249/500] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:23.666803 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365ec8e-9418-488b-8100-334572200b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.667519 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365ec8e-9418-488b-8100-334572200b62 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.667831 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365ec8e-9418-488b-8100-334572200b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.668220 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365ec8e-9418-488b-8100-334572200b62 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.676777 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a582f96-b71e-449c-9a16-011218c47998 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.678267 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365ec8e-9418-488b-8100-334572200b62 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.680130 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365ec8e-9418-488b-8100-334572200b62 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.692080 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 252/501] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:29:23.692988 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365ec8e-9418-488b-8100-334572200b62 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.694441 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a582f96-b71e-449c-9a16-011218c47998 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.699359 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4b18d-ccbb-42a5-a9e4-3df5e8e1542e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.700186 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4b18d-ccbb-42a5-a9e4-3df5e8e1542e admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.700468 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4b18d-ccbb-42a5-a9e4-3df5e8e1542e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.701373 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4b18d-ccbb-42a5-a9e4-3df5e8e1542e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.708733 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365ec8e-9418-488b-8100-334572200b62 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.709649 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4b18d-ccbb-42a5-a9e4-3df5e8e1542e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.711779 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4b18d-ccbb-42a5-a9e4-3df5e8e1542e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.715007 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aefc7c-f00f-4021-9327-17f8ff9b8a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.715813 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aefc7c-f00f-4021-9327-17f8ff9b8a60 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.716071 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aefc7c-f00f-4021-9327-17f8ff9b8a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.716348 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aefc7c-f00f-4021-9327-17f8ff9b8a60 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.727596 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aefc7c-f00f-4021-9327-17f8ff9b8a60 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:23.728163 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-bca4b18d-ccbb-42a5-a9e4-3df5e8e1542e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:23.729632 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 250/502] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:23.730195 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4b18d-ccbb-42a5-a9e4-3df5e8e1542e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.735565 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-e3aefc7c-f00f-4021-9327-17f8ff9b8a60 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 08 16:29:23.736939 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 253/503] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:23.737743 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aefc7c-f00f-4021-9327-17f8ff9b8a60 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.750656 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4b18d-ccbb-42a5-a9e4-3df5e8e1542e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.751387 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aefc7c-f00f-4021-9327-17f8ff9b8a60 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.755408 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471da1f4-f4df-45fa-9ba2-e413b15ec453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.756000 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c685dc-42d7-468f-90eb-98dc7f632202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.756223 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471da1f4-f4df-45fa-9ba2-e413b15ec453 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.756426 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471da1f4-f4df-45fa-9ba2-e413b15ec453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.756670 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c685dc-42d7-468f-90eb-98dc7f632202 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.756832 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471da1f4-f4df-45fa-9ba2-e413b15ec453 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.756993 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c685dc-42d7-468f-90eb-98dc7f632202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.757221 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c685dc-42d7-468f-90eb-98dc7f632202 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.758042 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c685dc-42d7-468f-90eb-98dc7f632202 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:23.758344 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c685dc-42d7-468f-90eb-98dc7f632202 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.760026 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-89c685dc-42d7-468f-90eb-98dc7f632202 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:29:23.760026 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Feb 08 16:29:23.760026 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: Feb 08 16:29:23.761262 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c685dc-42d7-468f-90eb-98dc7f632202 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.767799 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471da1f4-f4df-45fa-9ba2-e413b15ec453 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.769707 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471da1f4-f4df-45fa-9ba2-e413b15ec453 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.782203 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 254/504] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:23.783041 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c685dc-42d7-468f-90eb-98dc7f632202 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.791720 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-471da1f4-f4df-45fa-9ba2-e413b15ec453 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:23.792334 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c685dc-42d7-468f-90eb-98dc7f632202 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.792987 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 251/505] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:23.793934 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471da1f4-f4df-45fa-9ba2-e413b15ec453 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.797851 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee6f5c-c9e2-43ed-b2c0-608bcce34c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.798734 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6f5c-c9e2-43ed-b2c0-608bcce34c82 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.799260 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6f5c-c9e2-43ed-b2c0-608bcce34c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.799997 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6f5c-c9e2-43ed-b2c0-608bcce34c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.801545 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee6f5c-c9e2-43ed-b2c0-608bcce34c82 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:23.802074 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee6f5c-c9e2-43ed-b2c0-608bcce34c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.804223 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee6f5c-c9e2-43ed-b2c0-608bcce34c82 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.804854 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471da1f4-f4df-45fa-9ba2-e413b15ec453 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.810304 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bba766-4175-4aa4-9f7a-c54dc1b7a16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.810642 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bba766-4175-4aa4-9f7a-c54dc1b7a16a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.810924 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bba766-4175-4aa4-9f7a-c54dc1b7a16a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.811200 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bba766-4175-4aa4-9f7a-c54dc1b7a16a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.812232 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bba766-4175-4aa4-9f7a-c54dc1b7a16a admin admin] RBAC: Adding query filter params (role.id=54ef06f5478a48d08a2c08df2500fe6f, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=10453496872a45a9867fc6a13a13de49) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:23.813107 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bba766-4175-4aa4-9f7a-c54dc1b7a16a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.815122 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 255/506] 10.222.0.35 () {56 vars in 1124 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:23.815316 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bba766-4175-4aa4-9f7a-c54dc1b7a16a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.816344 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee6f5c-c9e2-43ed-b2c0-608bcce34c82 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.825809 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 252/507] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/role_assignments?user.id=10453496872a45a9867fc6a13a13de49&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=54ef06f5478a48d08a2c08df2500fe6f => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:23.826628 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bba766-4175-4aa4-9f7a-c54dc1b7a16a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.828524 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee6f5c-c9e2-43ed-b2c0-608bcce34c82 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.846405 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bba766-4175-4aa4-9f7a-c54dc1b7a16a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.848498 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba594c4-9f51-49bd-b24c-834b7890a450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.849420 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba594c4-9f51-49bd-b24c-834b7890a450 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.849926 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba594c4-9f51-49bd-b24c-834b7890a450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.850425 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba594c4-9f51-49bd-b24c-834b7890a450 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.851376 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba594c4-9f51-49bd-b24c-834b7890a450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:23.851910 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba594c4-9f51-49bd-b24c-834b7890a450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.853775 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba594c4-9f51-49bd-b24c-834b7890a450 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.869544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d9f00-fb5e-44f5-b8e1-6f3f9259e302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.870739 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d9f00-fb5e-44f5-b8e1-6f3f9259e302 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.871221 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d9f00-fb5e-44f5-b8e1-6f3f9259e302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.871684 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d9f00-fb5e-44f5-b8e1-6f3f9259e302 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.884943 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 256/508] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:23.889574 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d9f00-fb5e-44f5-b8e1-6f3f9259e302 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.891433 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba594c4-9f51-49bd-b24c-834b7890a450 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.894471 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d9f00-fb5e-44f5-b8e1-6f3f9259e302 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.913708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba594c4-9f51-49bd-b24c-834b7890a450 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.930643 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-eb8d9f00-fb5e-44f5-b8e1-6f3f9259e302 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:23.932372 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 253/509] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:23.933524 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcb64e-12b4-4b5e-9dad-99c32a6a3ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.934611 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcb64e-12b4-4b5e-9dad-99c32a6a3ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.934806 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcb64e-12b4-4b5e-9dad-99c32a6a3ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.935076 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcb64e-12b4-4b5e-9dad-99c32a6a3ab2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.943670 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d9f00-fb5e-44f5-b8e1-6f3f9259e302 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.949177 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcb64e-12b4-4b5e-9dad-99c32a6a3ab2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.951163 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcb64e-12b4-4b5e-9dad-99c32a6a3ab2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.956529 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d9f00-fb5e-44f5-b8e1-6f3f9259e302 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:23.962288 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c373c75-6366-4843-9243-a8bc4c95d4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:23.963308 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c373c75-6366-4843-9243-a8bc4c95d4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.963845 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c373c75-6366-4843-9243-a8bc4c95d4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.964369 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c373c75-6366-4843-9243-a8bc4c95d4c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.965606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c373c75-6366-4843-9243-a8bc4c95d4c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:23.966140 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c373c75-6366-4843-9243-a8bc4c95d4c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:23.968100 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c373c75-6366-4843-9243-a8bc4c95d4c6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:23.973236 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-91dcb64e-12b4-4b5e-9dad-99c32a6a3ab2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:23.974495 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 257/510] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:23.975884 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a9009-83fb-42a5-b505-7af4a705974c None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.976172 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a9009-83fb-42a5-b505-7af4a705974c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.976447 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a9009-83fb-42a5-b505-7af4a705974c None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.982555 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 258/511] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:23.983506 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a9009-83fb-42a5-b505-7af4a705974c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:23.984759 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 254/512] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:23.986274 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd83e7-14b6-4d2e-a06c-33b96687d2f5 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:23.986741 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd83e7-14b6-4d2e-a06c-33b96687d2f5 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:23.987195 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd83e7-14b6-4d2e-a06c-33b96687d2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:23.998737 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a9009-83fb-42a5-b505-7af4a705974c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.005014 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329585d6-dc86-4116-a879-b9c6823dca41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.006046 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329585d6-dc86-4116-a879-b9c6823dca41 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.006601 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329585d6-dc86-4116-a879-b9c6823dca41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.007102 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329585d6-dc86-4116-a879-b9c6823dca41 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.008248 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329585d6-dc86-4116-a879-b9c6823dca41 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:24.008357 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-3fcd83e7-14b6-4d2e-a06c-33b96687d2f5 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:24.008880 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329585d6-dc86-4116-a879-b9c6823dca41 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:24.009629 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-3fcd83e7-14b6-4d2e-a06c-33b96687d2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:24.011272 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329585d6-dc86-4116-a879-b9c6823dca41 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:24.019271 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 255/513] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:24.020489 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd83e7-14b6-4d2e-a06c-33b96687d2f5 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:24.026109 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 259/514] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:24.030004 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd83e7-14b6-4d2e-a06c-33b96687d2f5 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.032866 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329585d6-dc86-4116-a879-b9c6823dca41 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:24.036600 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc013c-4d22-4503-96f2-0c2b3d69d4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.037380 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc013c-4d22-4503-96f2-0c2b3d69d4fe admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.037648 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc013c-4d22-4503-96f2-0c2b3d69d4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.037914 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc013c-4d22-4503-96f2-0c2b3d69d4fe admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.048675 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329585d6-dc86-4116-a879-b9c6823dca41 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.049179 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc013c-4d22-4503-96f2-0c2b3d69d4fe admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:24.050790 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc013c-4d22-4503-96f2-0c2b3d69d4fe admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:24.055315 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ae06f-d6f5-4ee2-891a-a45d33ee4efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.056119 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ae06f-d6f5-4ee2-891a-a45d33ee4efa admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.056410 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ae06f-d6f5-4ee2-891a-a45d33ee4efa admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.056890 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ae06f-d6f5-4ee2-891a-a45d33ee4efa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.058009 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ae06f-d6f5-4ee2-891a-a45d33ee4efa admin admin] RBAC: Adding query filter params (role.id=54ef06f5478a48d08a2c08df2500fe6f, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=ccb02e5d8ef14f8f85bbacfa5b1f5be3) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:24.058460 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ae06f-d6f5-4ee2-891a-a45d33ee4efa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:24.060476 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ae06f-d6f5-4ee2-891a-a45d33ee4efa admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:24.066759 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 260/515] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:29:24 2022] GET /identity/v3/role_assignments?user.id=ccb02e5d8ef14f8f85bbacfa5b1f5be3&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=54ef06f5478a48d08a2c08df2500fe6f => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:24.067317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-a7cc013c-4d22-4503-96f2-0c2b3d69d4fe admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 08 16:29:24.067848 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ae06f-d6f5-4ee2-891a-a45d33ee4efa admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:24.068606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 256/516] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:24.080988 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc013c-4d22-4503-96f2-0c2b3d69d4fe admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:24.108114 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ae06f-d6f5-4ee2-891a-a45d33ee4efa admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.114845 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc013c-4d22-4503-96f2-0c2b3d69d4fe admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.119253 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2d8bc-7ced-46d2-b4cd-ce29f054da0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.120141 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2d8bc-7ced-46d2-b4cd-ce29f054da0d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.120419 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2d8bc-7ced-46d2-b4cd-ce29f054da0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.120692 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2d8bc-7ced-46d2-b4cd-ce29f054da0d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.129012 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f196434-6613-4fbf-82ea-5f30b1e14e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.129707 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f196434-6613-4fbf-82ea-5f30b1e14e91 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.131816 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f196434-6613-4fbf-82ea-5f30b1e14e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.132106 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f196434-6613-4fbf-82ea-5f30b1e14e91 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.134625 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f196434-6613-4fbf-82ea-5f30b1e14e91 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:24.136809 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f196434-6613-4fbf-82ea-5f30b1e14e91 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:24.138740 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f196434-6613-4fbf-82ea-5f30b1e14e91 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:24.153418 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2d8bc-7ced-46d2-b4cd-ce29f054da0d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:24.173958 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-cff2d8bc-7ced-46d2-b4cd-ce29f054da0d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 08 16:29:24.178006 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 261/517] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:29:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:24.181585 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2d8bc-7ced-46d2-b4cd-ce29f054da0d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:24.187935 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 257/518] 10.222.0.35 () {56 vars in 1158 bytes} [Tue Feb 8 16:29:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:24.192673 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f196434-6613-4fbf-82ea-5f30b1e14e91 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:24.207390 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f196434-6613-4fbf-82ea-5f30b1e14e91 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.207619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2d8bc-7ced-46d2-b4cd-ce29f054da0d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.212924 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503b557-6275-4904-9de9-cbc92511501b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.214003 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503b557-6275-4904-9de9-cbc92511501b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.214496 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503b557-6275-4904-9de9-cbc92511501b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.214986 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503b557-6275-4904-9de9-cbc92511501b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.224598 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106e205-8328-4650-a89d-48202aaad50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.225285 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106e205-8328-4650-a89d-48202aaad50f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.225583 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106e205-8328-4650-a89d-48202aaad50f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.225844 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106e205-8328-4650-a89d-48202aaad50f admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.226623 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106e205-8328-4650-a89d-48202aaad50f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:24.226927 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106e205-8328-4650-a89d-48202aaad50f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:24.227473 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503b557-6275-4904-9de9-cbc92511501b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:24.228609 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106e205-8328-4650-a89d-48202aaad50f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:24.230128 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503b557-6275-4904-9de9-cbc92511501b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:24.241463 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 258/519] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:29:24.243370 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 262/520] 10.222.0.35 () {56 vars in 1124 bytes} [Tue Feb 8 16:29:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:24.249123 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106e205-8328-4650-a89d-48202aaad50f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:24.249383 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503b557-6275-4904-9de9-cbc92511501b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:24.261090 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106e205-8328-4650-a89d-48202aaad50f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.261382 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503b557-6275-4904-9de9-cbc92511501b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.270146 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261c215-d896-4b0b-acb9-712f271ae8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.271046 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261c215-d896-4b0b-acb9-712f271ae8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.271386 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261c215-d896-4b0b-acb9-712f271ae8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.271671 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261c215-d896-4b0b-acb9-712f271ae8c8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.274530 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad4eae-a992-48d5-a60b-5aa5dba1a219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.275928 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad4eae-a992-48d5-a60b-5aa5dba1a219 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.276398 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad4eae-a992-48d5-a60b-5aa5dba1a219 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.276838 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad4eae-a992-48d5-a60b-5aa5dba1a219 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.283910 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261c215-d896-4b0b-acb9-712f271ae8c8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:24.287237 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261c215-d896-4b0b-acb9-712f271ae8c8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:24.303305 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad4eae-a992-48d5-a60b-5aa5dba1a219 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:24.305468 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad4eae-a992-48d5-a60b-5aa5dba1a219 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:24.317837 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-c261c215-d896-4b0b-acb9-712f271ae8c8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:24.319042 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 263/521] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:24.332426 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261c215-d896-4b0b-acb9-712f271ae8c8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:24.338634 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-12ad4eae-a992-48d5-a60b-5aa5dba1a219 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:24.339852 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 259/522] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:24.346409 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad4eae-a992-48d5-a60b-5aa5dba1a219 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:24.349388 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261c215-d896-4b0b-acb9-712f271ae8c8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.359963 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad4eae-a992-48d5-a60b-5aa5dba1a219 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.362418 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fe497-598b-4222-8479-7fe464f6b3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.363068 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fe497-598b-4222-8479-7fe464f6b3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.363342 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fe497-598b-4222-8479-7fe464f6b3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.363613 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fe497-598b-4222-8479-7fe464f6b3b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.364372 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fe497-598b-4222-8479-7fe464f6b3b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:24.364670 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fe497-598b-4222-8479-7fe464f6b3b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:24.366267 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fe497-598b-4222-8479-7fe464f6b3b4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:24.377548 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d2746-a4b5-4200-8632-961db3e12751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.378197 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d2746-a4b5-4200-8632-961db3e12751 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.378472 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d2746-a4b5-4200-8632-961db3e12751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.378743 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d2746-a4b5-4200-8632-961db3e12751 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.379472 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d2746-a4b5-4200-8632-961db3e12751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:24.379804 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d2746-a4b5-4200-8632-961db3e12751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:24.381379 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d2746-a4b5-4200-8632-961db3e12751 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:24.392628 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 264/523] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:24.393429 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fe497-598b-4222-8479-7fe464f6b3b4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:24.404912 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 260/524] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:24.408049 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fe497-598b-4222-8479-7fe464f6b3b4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.411373 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d2746-a4b5-4200-8632-961db3e12751 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:24.421540 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d2746-a4b5-4200-8632-961db3e12751 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.422710 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f07e49-1076-4120-9659-0d8c2ac6e4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.423496 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f07e49-1076-4120-9659-0d8c2ac6e4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.423782 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f07e49-1076-4120-9659-0d8c2ac6e4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.424061 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f07e49-1076-4120-9659-0d8c2ac6e4d4 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.435562 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f07e49-1076-4120-9659-0d8c2ac6e4d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:24.437676 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f07e49-1076-4120-9659-0d8c2ac6e4d4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:24.438676 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ea81b-efe2-438a-8997-929cb128eb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.439452 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ea81b-efe2-438a-8997-929cb128eb7c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.439725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ea81b-efe2-438a-8997-929cb128eb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.440012 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ea81b-efe2-438a-8997-929cb128eb7c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.456657 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ea81b-efe2-438a-8997-929cb128eb7c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:24.458627 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ea81b-efe2-438a-8997-929cb128eb7c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:24.460111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-d7f07e49-1076-4120-9659-0d8c2ac6e4d4 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 08 16:29:24.461585 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 265/525] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:29:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:24.472715 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f07e49-1076-4120-9659-0d8c2ac6e4d4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:24.480784 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-ad8ea81b-efe2-438a-8997-929cb128eb7c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:24.482268 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 261/526] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:24.486673 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f07e49-1076-4120-9659-0d8c2ac6e4d4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.488558 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ea81b-efe2-438a-8997-929cb128eb7c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:24.498471 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d0a97-14c9-4132-9785-5e3042ceb343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.500661 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d0a97-14c9-4132-9785-5e3042ceb343 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.501050 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d0a97-14c9-4132-9785-5e3042ceb343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.501866 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d0a97-14c9-4132-9785-5e3042ceb343 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.502952 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d0a97-14c9-4132-9785-5e3042ceb343 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:24.503264 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d0a97-14c9-4132-9785-5e3042ceb343 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:24.505514 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ea81b-efe2-438a-8997-929cb128eb7c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.508089 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d0a97-14c9-4132-9785-5e3042ceb343 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:24.517398 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1932f-9bed-4783-8242-974e4db88398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.519339 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1932f-9bed-4783-8242-974e4db88398 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.519629 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1932f-9bed-4783-8242-974e4db88398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.520322 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1932f-9bed-4783-8242-974e4db88398 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.521137 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1932f-9bed-4783-8242-974e4db88398 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:24.521450 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1932f-9bed-4783-8242-974e4db88398 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:24.524890 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING py.warnings [None req-3cb1932f-9bed-4783-8242-974e4db88398 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:29:24.524890 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: warnings.warn(msg) Feb 08 16:29:24.524890 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: Feb 08 16:29:24.527305 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1932f-9bed-4783-8242-974e4db88398 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:24.562021 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 266/527] 10.222.0.35 () {56 vars in 1160 bytes} [Tue Feb 8 16:29:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:24.567977 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d0a97-14c9-4132-9785-5e3042ceb343 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:24.582553 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d0a97-14c9-4132-9785-5e3042ceb343 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.587317 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3544c-2bb2-4912-93ac-acf22be0bbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.588057 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3544c-2bb2-4912-93ac-acf22be0bbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.588345 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3544c-2bb2-4912-93ac-acf22be0bbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.588670 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3544c-2bb2-4912-93ac-acf22be0bbd6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.590123 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 262/528] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:24.595903 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1932f-9bed-4783-8242-974e4db88398 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:24.597931 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3544c-2bb2-4912-93ac-acf22be0bbd6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:24.599844 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3544c-2bb2-4912-93ac-acf22be0bbd6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:24.610153 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 267/529] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 08 16:29:24.615638 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3544c-2bb2-4912-93ac-acf22be0bbd6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:24.618250 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1932f-9bed-4783-8242-974e4db88398 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.625807 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3544c-2bb2-4912-93ac-acf22be0bbd6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.630799 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391121cd-7293-4d45-9345-1801373f126d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.631669 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391121cd-7293-4d45-9345-1801373f126d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.632046 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391121cd-7293-4d45-9345-1801373f126d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.632506 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391121cd-7293-4d45-9345-1801373f126d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.633382 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c98360-46f7-4d1f-8cd4-13c256578d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.634118 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c98360-46f7-4d1f-8cd4-13c256578d13 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.634444 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c98360-46f7-4d1f-8cd4-13c256578d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.634729 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c98360-46f7-4d1f-8cd4-13c256578d13 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.635577 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c98360-46f7-4d1f-8cd4-13c256578d13 admin admin] RBAC: Adding query filter params (role.id=54ef06f5478a48d08a2c08df2500fe6f, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=591ac81647b8446ab342e44c3fb35174) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:24.635913 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c98360-46f7-4d1f-8cd4-13c256578d13 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:24.637770 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c98360-46f7-4d1f-8cd4-13c256578d13 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:24.644029 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391121cd-7293-4d45-9345-1801373f126d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:24.645930 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391121cd-7293-4d45-9345-1801373f126d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:24.658365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 263/530] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:29:24 2022] GET /identity/v3/role_assignments?user.id=591ac81647b8446ab342e44c3fb35174&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=54ef06f5478a48d08a2c08df2500fe6f => generated 259 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:24.664832 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-391121cd-7293-4d45-9345-1801373f126d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:24.666598 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 268/531] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:24.672747 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c98360-46f7-4d1f-8cd4-13c256578d13 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:24.694429 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c98360-46f7-4d1f-8cd4-13c256578d13 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.708635 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16923abc-118c-4e23-ac42-12be3ffdf1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.709320 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16923abc-118c-4e23-ac42-12be3ffdf1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.709677 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16923abc-118c-4e23-ac42-12be3ffdf1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.709955 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16923abc-118c-4e23-ac42-12be3ffdf1d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.710708 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16923abc-118c-4e23-ac42-12be3ffdf1d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:24.711012 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16923abc-118c-4e23-ac42-12be3ffdf1d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:24.712743 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16923abc-118c-4e23-ac42-12be3ffdf1d0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:24.729189 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 264/532] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:24.735688 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391121cd-7293-4d45-9345-1801373f126d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:24.749455 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391121cd-7293-4d45-9345-1801373f126d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.759956 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb29c8-299c-4b5d-bff1-b6810ef636c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.761080 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb29c8-299c-4b5d-bff1-b6810ef636c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.761542 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb29c8-299c-4b5d-bff1-b6810ef636c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.762019 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb29c8-299c-4b5d-bff1-b6810ef636c9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.771526 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb29c8-299c-4b5d-bff1-b6810ef636c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:24.773921 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb29c8-299c-4b5d-bff1-b6810ef636c9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:24.789315 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-cadb29c8-299c-4b5d-bff1-b6810ef636c9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:24.791197 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 269/533] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:24.797784 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16923abc-118c-4e23-ac42-12be3ffdf1d0 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:24.813716 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16923abc-118c-4e23-ac42-12be3ffdf1d0 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.829920 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae5c62-bc78-4dc7-b7f9-09b3b18f7b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.830598 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae5c62-bc78-4dc7-b7f9-09b3b18f7b1d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.830888 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae5c62-bc78-4dc7-b7f9-09b3b18f7b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.831169 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae5c62-bc78-4dc7-b7f9-09b3b18f7b1d admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.832004 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae5c62-bc78-4dc7-b7f9-09b3b18f7b1d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:24.832381 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae5c62-bc78-4dc7-b7f9-09b3b18f7b1d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:24.834353 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae5c62-bc78-4dc7-b7f9-09b3b18f7b1d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:24.857301 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 265/534] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:24.864519 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb29c8-299c-4b5d-bff1-b6810ef636c9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:24.880893 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb29c8-299c-4b5d-bff1-b6810ef636c9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:24.892912 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9f866-cf18-4a1d-8bac-3e8b4fa95fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:24.893907 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9f866-cf18-4a1d-8bac-3e8b4fa95fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.894419 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9f866-cf18-4a1d-8bac-3e8b4fa95fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.894901 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9f866-cf18-4a1d-8bac-3e8b4fa95fb6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.895946 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9f866-cf18-4a1d-8bac-3e8b4fa95fb6 admin admin] RBAC: Adding query filter params (role.id=54ef06f5478a48d08a2c08df2500fe6f, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=0b936dc9a67846f08e51648e64c3d6ec) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:24.896434 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9f866-cf18-4a1d-8bac-3e8b4fa95fb6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:24.898507 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9f866-cf18-4a1d-8bac-3e8b4fa95fb6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:24.905357 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 270/535] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:29:24 2022] GET /identity/v3/role_assignments?user.id=0b936dc9a67846f08e51648e64c3d6ec&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=54ef06f5478a48d08a2c08df2500fe6f => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:24.955402 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6f1e4-e526-4200-81d7-bc4d71276fef None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.955688 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6f1e4-e526-4200-81d7-bc4d71276fef None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.956000 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6f1e4-e526-4200-81d7-bc4d71276fef None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.958021 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 266/536] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:24.966603 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cde9b-8ba3-431d-ae33-749ce9c0d939 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:24.966838 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cde9b-8ba3-431d-ae33-749ce9c0d939 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:24.967103 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cde9b-8ba3-431d-ae33-749ce9c0d939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:24.997005 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-899cde9b-8ba3-431d-ae33-749ce9c0d939 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:24.998244 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-899cde9b-8ba3-431d-ae33-749ce9c0d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:25.011657 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 271/537] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:25.056042 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6f1e4-e526-4200-81d7-bc4d71276fef None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:25.075069 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6f1e4-e526-4200-81d7-bc4d71276fef None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:25.084583 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda24ede-284c-48fa-86d4-edba33b77c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:25.085704 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda24ede-284c-48fa-86d4-edba33b77c18 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:25.086171 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda24ede-284c-48fa-86d4-edba33b77c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:25.086638 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda24ede-284c-48fa-86d4-edba33b77c18 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:25.099307 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda24ede-284c-48fa-86d4-edba33b77c18 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:25.101523 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda24ede-284c-48fa-86d4-edba33b77c18 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:25.120087 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-cda24ede-284c-48fa-86d4-edba33b77c18 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:25.121539 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 267/538] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:25.128121 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cde9b-8ba3-431d-ae33-749ce9c0d939 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:25.137360 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cde9b-8ba3-431d-ae33-749ce9c0d939 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:25.146292 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e777c26-b158-4870-b4c9-11457483bfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:25.146961 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e777c26-b158-4870-b4c9-11457483bfdd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:25.147244 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e777c26-b158-4870-b4c9-11457483bfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:25.147518 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e777c26-b158-4870-b4c9-11457483bfdd admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:25.148340 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e777c26-b158-4870-b4c9-11457483bfdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:25.148636 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e777c26-b158-4870-b4c9-11457483bfdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:25.150241 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e777c26-b158-4870-b4c9-11457483bfdd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:25.163084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 272/539] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:25.168497 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda24ede-284c-48fa-86d4-edba33b77c18 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:25.181097 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda24ede-284c-48fa-86d4-edba33b77c18 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:25.186000 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb4df4-46ac-4227-a3d0-2921ba35f52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:25.186860 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb4df4-46ac-4227-a3d0-2921ba35f52f admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:25.187914 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb4df4-46ac-4227-a3d0-2921ba35f52f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:25.188347 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb4df4-46ac-4227-a3d0-2921ba35f52f admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:25.189218 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb4df4-46ac-4227-a3d0-2921ba35f52f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:25.191265 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb4df4-46ac-4227-a3d0-2921ba35f52f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:25.236592 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 268/540] 10.222.0.35 () {60 vars in 1153 bytes} [Tue Feb 8 16:29:25 2022] POST /identity/v3/users => generated 247 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:29:26.403135 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f279b44-70b8-48d0-84b1-63e5a131b171 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:26.403646 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f279b44-70b8-48d0-84b1-63e5a131b171 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:26.403718 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f279b44-70b8-48d0-84b1-63e5a131b171 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:26.405749 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 273/541] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:26.411330 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106348ea-4ef8-480b-8de3-1a03cfbd78fc None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:26.411814 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106348ea-4ef8-480b-8de3-1a03cfbd78fc None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:26.412026 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106348ea-4ef8-480b-8de3-1a03cfbd78fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:26.434645 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-106348ea-4ef8-480b-8de3-1a03cfbd78fc None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:26.435868 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-106348ea-4ef8-480b-8de3-1a03cfbd78fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:26.444509 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 269/542] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:29:26.468089 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f279b44-70b8-48d0-84b1-63e5a131b171 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:26.480810 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f279b44-70b8-48d0-84b1-63e5a131b171 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:26.485351 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc1790-c7d7-46c4-a0f7-0ce8a1f9f543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:26.486128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc1790-c7d7-46c4-a0f7-0ce8a1f9f543 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:26.486411 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc1790-c7d7-46c4-a0f7-0ce8a1f9f543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:26.486686 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc1790-c7d7-46c4-a0f7-0ce8a1f9f543 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:26.497077 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc1790-c7d7-46c4-a0f7-0ce8a1f9f543 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:26.504559 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-32dc1790-c7d7-46c4-a0f7-0ce8a1f9f543 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 08 16:29:26.506019 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 274/543] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:29:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:26.511828 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106348ea-4ef8-480b-8de3-1a03cfbd78fc None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:26.521831 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106348ea-4ef8-480b-8de3-1a03cfbd78fc None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:26.526519 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeda8c9-e31a-40a0-823d-2b3107f4c30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:26.527173 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeda8c9-e31a-40a0-823d-2b3107f4c30f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:26.527455 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeda8c9-e31a-40a0-823d-2b3107f4c30f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:26.527729 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeda8c9-e31a-40a0-823d-2b3107f4c30f admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:26.528527 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeda8c9-e31a-40a0-823d-2b3107f4c30f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:26.528830 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeda8c9-e31a-40a0-823d-2b3107f4c30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:26.530413 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeda8c9-e31a-40a0-823d-2b3107f4c30f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:26.539610 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 270/544] 10.222.0.35 () {56 vars in 1124 bytes} [Tue Feb 8 16:29:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:26.545270 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc1790-c7d7-46c4-a0f7-0ce8a1f9f543 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:26.557193 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc1790-c7d7-46c4-a0f7-0ce8a1f9f543 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:26.561851 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be0472-0e37-4a46-b7e6-9bbb6961d451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:26.563167 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be0472-0e37-4a46-b7e6-9bbb6961d451 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:26.563447 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be0472-0e37-4a46-b7e6-9bbb6961d451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:26.563718 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be0472-0e37-4a46-b7e6-9bbb6961d451 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:26.572519 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730ec1c-4cf4-44ad-87f4-a4badd271d55 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:26.572807 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730ec1c-4cf4-44ad-87f4-a4badd271d55 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:26.573088 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730ec1c-4cf4-44ad-87f4-a4badd271d55 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:26.575111 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 271/545] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:29:26.578416 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be0472-0e37-4a46-b7e6-9bbb6961d451 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:26.582123 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be0472-0e37-4a46-b7e6-9bbb6961d451 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:26.584780 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd91a90-0f5c-4596-a034-8598a3b21d59 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:26.585088 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd91a90-0f5c-4596-a034-8598a3b21d59 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:26.585372 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd91a90-0f5c-4596-a034-8598a3b21d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:26.607046 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-67be0472-0e37-4a46-b7e6-9bbb6961d451 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:26.616040 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 275/546] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:26.616174 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-9cd91a90-0f5c-4596-a034-8598a3b21d59 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:26.616904 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be0472-0e37-4a46-b7e6-9bbb6961d451 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:26.617399 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-9cd91a90-0f5c-4596-a034-8598a3b21d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:26.626920 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 272/547] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:29:26.629028 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be0472-0e37-4a46-b7e6-9bbb6961d451 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:26.639223 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18477ef-e2a4-4bb7-b1fa-b636698538ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:26.640449 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18477ef-e2a4-4bb7-b1fa-b636698538ff admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:26.641071 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18477ef-e2a4-4bb7-b1fa-b636698538ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:26.641581 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18477ef-e2a4-4bb7-b1fa-b636698538ff admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:26.643159 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18477ef-e2a4-4bb7-b1fa-b636698538ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:26.643833 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18477ef-e2a4-4bb7-b1fa-b636698538ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:26.646509 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18477ef-e2a4-4bb7-b1fa-b636698538ff admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:26.651867 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd91a90-0f5c-4596-a034-8598a3b21d59 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:26.666552 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 276/548] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:26.666795 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd91a90-0f5c-4596-a034-8598a3b21d59 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:26.672279 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18477ef-e2a4-4bb7-b1fa-b636698538ff admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:26.682212 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18de676-7569-42dd-a78e-e30e27050311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:26.682484 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18477ef-e2a4-4bb7-b1fa-b636698538ff admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:26.683059 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18de676-7569-42dd-a78e-e30e27050311 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:26.683337 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18de676-7569-42dd-a78e-e30e27050311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:26.683606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18de676-7569-42dd-a78e-e30e27050311 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:26.687708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e55b4a-b684-4b20-a931-503d7c64c603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:26.688661 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e55b4a-b684-4b20-a931-503d7c64c603 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:26.688948 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e55b4a-b684-4b20-a931-503d7c64c603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:26.689222 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e55b4a-b684-4b20-a931-503d7c64c603 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:26.697367 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e55b4a-b684-4b20-a931-503d7c64c603 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:26.699403 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e55b4a-b684-4b20-a931-503d7c64c603 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:26.705347 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18de676-7569-42dd-a78e-e30e27050311 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:26.713067 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-72e55b4a-b684-4b20-a931-503d7c64c603 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 08 16:29:26.714034 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-e18de676-7569-42dd-a78e-e30e27050311 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 08 16:29:26.714536 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 277/549] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:26.715477 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 273/550] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:29:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:26.719922 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e55b4a-b684-4b20-a931-503d7c64c603 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:26.721382 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18de676-7569-42dd-a78e-e30e27050311 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:26.729826 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e55b4a-b684-4b20-a931-503d7c64c603 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:26.738404 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876c951-acc8-4901-af52-5ec2a99c80a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:26.739065 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876c951-acc8-4901-af52-5ec2a99c80a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:26.739349 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876c951-acc8-4901-af52-5ec2a99c80a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:26.739621 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876c951-acc8-4901-af52-5ec2a99c80a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:26.740501 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876c951-acc8-4901-af52-5ec2a99c80a1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:26.740806 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876c951-acc8-4901-af52-5ec2a99c80a1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:26.742694 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876c951-acc8-4901-af52-5ec2a99c80a1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:26.746483 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18de676-7569-42dd-a78e-e30e27050311 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:26.757003 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c940d-6e2b-489a-a96e-74969839474d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:26.757794 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c940d-6e2b-489a-a96e-74969839474d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:26.758077 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c940d-6e2b-489a-a96e-74969839474d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:26.758353 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c940d-6e2b-489a-a96e-74969839474d admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:26.759210 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c940d-6e2b-489a-a96e-74969839474d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:26.759515 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c940d-6e2b-489a-a96e-74969839474d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:26.761108 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c940d-6e2b-489a-a96e-74969839474d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:26.775787 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 274/551] 10.222.0.35 () {56 vars in 1124 bytes} [Tue Feb 8 16:29:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:26.778186 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c940d-6e2b-489a-a96e-74969839474d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:26.780926 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 278/552] 10.222.0.35 () {56 vars in 1158 bytes} [Tue Feb 8 16:29:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:26.791012 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876c951-acc8-4901-af52-5ec2a99c80a1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:26.799665 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c940d-6e2b-489a-a96e-74969839474d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:26.806319 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876c951-acc8-4901-af52-5ec2a99c80a1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:26.810622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56a3ac-aaf8-49b6-bb51-ec5a3ca78902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:26.811398 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56a3ac-aaf8-49b6-bb51-ec5a3ca78902 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:26.811676 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56a3ac-aaf8-49b6-bb51-ec5a3ca78902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:26.812674 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56a3ac-aaf8-49b6-bb51-ec5a3ca78902 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:26.817278 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9a582-d791-474a-a9c5-a6fbb38b5a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:26.818045 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9a582-d791-474a-a9c5-a6fbb38b5a6f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:26.818321 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9a582-d791-474a-a9c5-a6fbb38b5a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:26.818591 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9a582-d791-474a-a9c5-a6fbb38b5a6f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:26.836451 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56a3ac-aaf8-49b6-bb51-ec5a3ca78902 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:26.838296 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56a3ac-aaf8-49b6-bb51-ec5a3ca78902 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:26.840629 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9a582-d791-474a-a9c5-a6fbb38b5a6f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:26.842476 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9a582-d791-474a-a9c5-a6fbb38b5a6f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:26.861482 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-70a9a582-d791-474a-a9c5-a6fbb38b5a6f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:26.862979 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 279/553] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:26.867624 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-6f56a3ac-aaf8-49b6-bb51-ec5a3ca78902 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:26.868294 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9a582-d791-474a-a9c5-a6fbb38b5a6f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:26.872336 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 275/554] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:26.878420 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56a3ac-aaf8-49b6-bb51-ec5a3ca78902 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:26.887239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9a582-d791-474a-a9c5-a6fbb38b5a6f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:26.893170 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56a3ac-aaf8-49b6-bb51-ec5a3ca78902 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:26.899530 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cae1a-a5d5-47d6-a40e-c24ee7acba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:26.900179 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff288b09-ba56-4fd2-9c98-c61159a4a335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:26.901295 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cae1a-a5d5-47d6-a40e-c24ee7acba4f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:26.901619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cae1a-a5d5-47d6-a40e-c24ee7acba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:26.901889 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cae1a-a5d5-47d6-a40e-c24ee7acba4f admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:26.902107 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff288b09-ba56-4fd2-9c98-c61159a4a335 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:26.902377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff288b09-ba56-4fd2-9c98-c61159a4a335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:26.902637 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff288b09-ba56-4fd2-9c98-c61159a4a335 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:26.903363 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff288b09-ba56-4fd2-9c98-c61159a4a335 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:26.903657 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff288b09-ba56-4fd2-9c98-c61159a4a335 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:26.905479 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cae1a-a5d5-47d6-a40e-c24ee7acba4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:26.905809 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cae1a-a5d5-47d6-a40e-c24ee7acba4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:26.907467 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cae1a-a5d5-47d6-a40e-c24ee7acba4f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:26.908446 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff288b09-ba56-4fd2-9c98-c61159a4a335 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:26.929415 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 276/555] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:26.931667 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 280/556] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:26.935116 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff288b09-ba56-4fd2-9c98-c61159a4a335 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:26.940475 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cae1a-a5d5-47d6-a40e-c24ee7acba4f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:26.954367 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cae1a-a5d5-47d6-a40e-c24ee7acba4f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:26.955505 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff288b09-ba56-4fd2-9c98-c61159a4a335 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:26.962711 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9526c-981f-45e0-b068-d2ce3de28311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:26.963486 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9526c-981f-45e0-b068-d2ce3de28311 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:26.963854 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9526c-981f-45e0-b068-d2ce3de28311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:26.964057 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9526c-981f-45e0-b068-d2ce3de28311 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:26.965088 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632593a7-0d60-441c-aa7d-c78eef893916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:26.965899 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632593a7-0d60-441c-aa7d-c78eef893916 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:26.966164 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632593a7-0d60-441c-aa7d-c78eef893916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:26.966426 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632593a7-0d60-441c-aa7d-c78eef893916 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:26.975886 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9526c-981f-45e0-b068-d2ce3de28311 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:26.977974 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9526c-981f-45e0-b068-d2ce3de28311 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:26.989157 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632593a7-0d60-441c-aa7d-c78eef893916 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:26.991378 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632593a7-0d60-441c-aa7d-c78eef893916 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:26.997412 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-63e9526c-981f-45e0-b068-d2ce3de28311 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 08 16:29:26.998962 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 277/557] 10.222.0.35 () {56 vars in 1114 bytes} [Tue Feb 8 16:29:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:27.005704 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9526c-981f-45e0-b068-d2ce3de28311 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:27.020825 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-632593a7-0d60-441c-aa7d-c78eef893916 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:27.021336 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 281/558] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:27.023564 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9526c-981f-45e0-b068-d2ce3de28311 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:27.029574 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632593a7-0d60-441c-aa7d-c78eef893916 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:27.029885 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e36c63-490d-462f-9b4a-340244b287be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:27.030639 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e36c63-490d-462f-9b4a-340244b287be admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:27.031499 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e36c63-490d-462f-9b4a-340244b287be admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:27.031832 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e36c63-490d-462f-9b4a-340244b287be admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:27.032701 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e36c63-490d-462f-9b4a-340244b287be admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:27.033011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e36c63-490d-462f-9b4a-340244b287be admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:27.035084 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e36c63-490d-462f-9b4a-340244b287be admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:27.044984 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632593a7-0d60-441c-aa7d-c78eef893916 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:27.060158 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5bfa0-17c4-4cc2-9a9d-c263707acf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:27.060839 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5bfa0-17c4-4cc2-9a9d-c263707acf31 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:27.061314 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5bfa0-17c4-4cc2-9a9d-c263707acf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:27.061589 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5bfa0-17c4-4cc2-9a9d-c263707acf31 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:27.063119 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5bfa0-17c4-4cc2-9a9d-c263707acf31 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:27.063373 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5bfa0-17c4-4cc2-9a9d-c263707acf31 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:27.065262 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5bfa0-17c4-4cc2-9a9d-c263707acf31 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:27.071195 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 278/559] 10.222.0.35 () {56 vars in 1154 bytes} [Tue Feb 8 16:29:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:27.083654 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e36c63-490d-462f-9b4a-340244b287be admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:27.094388 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 282/560] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:27.098024 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e36c63-490d-462f-9b4a-340244b287be admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:27.100074 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5bfa0-17c4-4cc2-9a9d-c263707acf31 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:27.110923 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5bfa0-17c4-4cc2-9a9d-c263707acf31 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:27.113020 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae664528-ace7-463f-81d1-00805a2447e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:27.113809 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae664528-ace7-463f-81d1-00805a2447e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:27.114094 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae664528-ace7-463f-81d1-00805a2447e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:27.114372 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae664528-ace7-463f-81d1-00805a2447e2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:27.115668 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422f6b2-f753-43b8-87d1-ba2a32a82851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:27.116660 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422f6b2-f753-43b8-87d1-ba2a32a82851 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:27.116944 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422f6b2-f753-43b8-87d1-ba2a32a82851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:27.117216 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422f6b2-f753-43b8-87d1-ba2a32a82851 admin admin] PATH_INFO: `/v3/projects/6b01069799b34858bbebc201a3f2046d/users/10453496872a45a9867fc6a13a13de49/roles/54ef06f5478a48d08a2c08df2500fe6f` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:27.141508 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422f6b2-f753-43b8-87d1-ba2a32a82851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b01069799b34858bbebc201a3f2046d, user_id=10453496872a45a9867fc6a13a13de49, role_id=54ef06f5478a48d08a2c08df2500fe6f)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:27.144515 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422f6b2-f753-43b8-87d1-ba2a32a82851 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:27.148587 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae664528-ace7-463f-81d1-00805a2447e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:27.150492 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae664528-ace7-463f-81d1-00805a2447e2 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:27.170758 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-ae664528-ace7-463f-81d1-00805a2447e2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:27.173671 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 279/561] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:27.179437 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae664528-ace7-463f-81d1-00805a2447e2 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:27.186761 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 283/562] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:29:27 2022] PUT /identity/v3/projects/6b01069799b34858bbebc201a3f2046d/users/10453496872a45a9867fc6a13a13de49/roles/54ef06f5478a48d08a2c08df2500fe6f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:29:27.192827 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae664528-ace7-463f-81d1-00805a2447e2 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:27.286649 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b6bc3-fe73-4ac5-a06b-8b8bdb518152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:27.287328 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b6bc3-fe73-4ac5-a06b-8b8bdb518152 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:27.287611 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b6bc3-fe73-4ac5-a06b-8b8bdb518152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:27.287933 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b6bc3-fe73-4ac5-a06b-8b8bdb518152 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:27.288741 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b6bc3-fe73-4ac5-a06b-8b8bdb518152 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:27.289049 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b6bc3-fe73-4ac5-a06b-8b8bdb518152 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:27.290803 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b6bc3-fe73-4ac5-a06b-8b8bdb518152 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:27.312899 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 280/563] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:27.318674 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422f6b2-f753-43b8-87d1-ba2a32a82851 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:27.342723 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422f6b2-f753-43b8-87d1-ba2a32a82851 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:27.356572 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194737bc-754e-492a-89ba-7b5c812a0ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:27.357463 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194737bc-754e-492a-89ba-7b5c812a0ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:27.357753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194737bc-754e-492a-89ba-7b5c812a0ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:27.358028 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194737bc-754e-492a-89ba-7b5c812a0ef9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:27.366232 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194737bc-754e-492a-89ba-7b5c812a0ef9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:27.368261 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194737bc-754e-492a-89ba-7b5c812a0ef9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:27.385801 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-194737bc-754e-492a-89ba-7b5c812a0ef9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:27.387363 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 284/564] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:27.393767 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b6bc3-fe73-4ac5-a06b-8b8bdb518152 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:27.410071 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b6bc3-fe73-4ac5-a06b-8b8bdb518152 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:27.416239 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc66f37-696b-4f58-b479-56ac046d999a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:27.416879 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc66f37-696b-4f58-b479-56ac046d999a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:27.417223 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc66f37-696b-4f58-b479-56ac046d999a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:27.417542 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc66f37-696b-4f58-b479-56ac046d999a admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:27.418353 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc66f37-696b-4f58-b479-56ac046d999a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:27.418661 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc66f37-696b-4f58-b479-56ac046d999a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:27.420690 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc66f37-696b-4f58-b479-56ac046d999a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:27.439370 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 281/565] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:27.445194 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194737bc-754e-492a-89ba-7b5c812a0ef9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:27.461979 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194737bc-754e-492a-89ba-7b5c812a0ef9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:27.466930 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a8615-2ae0-40c2-b9f4-3c7145d00ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:27.467965 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a8615-2ae0-40c2-b9f4-3c7145d00ade admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:27.469001 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a8615-2ae0-40c2-b9f4-3c7145d00ade admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:27.469382 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a8615-2ae0-40c2-b9f4-3c7145d00ade admin admin] PATH_INFO: `/v3/projects/6b01069799b34858bbebc201a3f2046d/users/ccb02e5d8ef14f8f85bbacfa5b1f5be3/roles/54ef06f5478a48d08a2c08df2500fe6f` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:27.485886 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a8615-2ae0-40c2-b9f4-3c7145d00ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b01069799b34858bbebc201a3f2046d, user_id=ccb02e5d8ef14f8f85bbacfa5b1f5be3, role_id=54ef06f5478a48d08a2c08df2500fe6f)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:27.487647 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ba93d-015b-4f06-8855-fd5b9593fd4b None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:27.488167 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ba93d-015b-4f06-8855-fd5b9593fd4b None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:27.488673 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ba93d-015b-4f06-8855-fd5b9593fd4b None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:27.488799 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a8615-2ae0-40c2-b9f4-3c7145d00ade admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:27.491177 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 282/566] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:27.496076 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9bcb8-d638-46bb-8278-be74db9754a1 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:27.496475 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9bcb8-d638-46bb-8278-be74db9754a1 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:27.496638 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9bcb8-d638-46bb-8278-be74db9754a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:27.508747 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 285/567] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:29:27 2022] PUT /identity/v3/projects/6b01069799b34858bbebc201a3f2046d/users/ccb02e5d8ef14f8f85bbacfa5b1f5be3/roles/54ef06f5478a48d08a2c08df2500fe6f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:29:27.524506 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-a9e9bcb8-d638-46bb-8278-be74db9754a1 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:27.524506 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a9e9bcb8-d638-46bb-8278-be74db9754a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:27.606488 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 283/568] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:29:27.654612 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a8615-2ae0-40c2-b9f4-3c7145d00ade admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:27.668680 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a8615-2ae0-40c2-b9f4-3c7145d00ade admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:27.680113 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcacf5-a207-4f5f-a146-51c204594785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:27.681353 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcacf5-a207-4f5f-a146-51c204594785 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:27.681840 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcacf5-a207-4f5f-a146-51c204594785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:27.682323 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcacf5-a207-4f5f-a146-51c204594785 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:27.698379 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfcacf5-a207-4f5f-a146-51c204594785 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:27.706570 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-ccfcacf5-a207-4f5f-a146-51c204594785 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 08 16:29:27.709598 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 286/569] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:29:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:27.715045 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9bcb8-d638-46bb-8278-be74db9754a1 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:27.725577 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9bcb8-d638-46bb-8278-be74db9754a1 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:27.730312 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7492a0-9f37-439a-9d33-b232a8cfc465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:27.731031 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7492a0-9f37-439a-9d33-b232a8cfc465 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:27.731359 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7492a0-9f37-439a-9d33-b232a8cfc465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:27.731638 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7492a0-9f37-439a-9d33-b232a8cfc465 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:27.732429 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7492a0-9f37-439a-9d33-b232a8cfc465 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:27.732732 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7492a0-9f37-439a-9d33-b232a8cfc465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:27.735273 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7492a0-9f37-439a-9d33-b232a8cfc465 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:27.745150 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 284/570] 10.222.0.35 () {56 vars in 1124 bytes} [Tue Feb 8 16:29:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:27.751198 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcacf5-a207-4f5f-a146-51c204594785 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:27.761810 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcacf5-a207-4f5f-a146-51c204594785 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:27.769816 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f647f8-7ce1-4c81-a88c-ae26f228c4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:27.770830 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f647f8-7ce1-4c81-a88c-ae26f228c4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:27.771258 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f647f8-7ce1-4c81-a88c-ae26f228c4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:27.771739 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f647f8-7ce1-4c81-a88c-ae26f228c4e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:27.783182 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f647f8-7ce1-4c81-a88c-ae26f228c4e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:27.785310 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f647f8-7ce1-4c81-a88c-ae26f228c4e5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:27.803627 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-13f647f8-7ce1-4c81-a88c-ae26f228c4e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:27.809799 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 287/571] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:27.811347 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7492a0-9f37-439a-9d33-b232a8cfc465 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:27.822473 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7492a0-9f37-439a-9d33-b232a8cfc465 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:27.827658 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1325207-f818-4d9f-81f0-c52fdeca124a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:27.829059 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1325207-f818-4d9f-81f0-c52fdeca124a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:27.829570 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1325207-f818-4d9f-81f0-c52fdeca124a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:27.829989 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1325207-f818-4d9f-81f0-c52fdeca124a admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:27.830882 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1325207-f818-4d9f-81f0-c52fdeca124a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:27.831389 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1325207-f818-4d9f-81f0-c52fdeca124a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:27.833160 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1325207-f818-4d9f-81f0-c52fdeca124a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:27.850528 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 285/572] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:27.852103 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f647f8-7ce1-4c81-a88c-ae26f228c4e5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:27.862308 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f647f8-7ce1-4c81-a88c-ae26f228c4e5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:27.867183 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce68b5e-14cf-4188-b66e-09b94322386a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:27.868246 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce68b5e-14cf-4188-b66e-09b94322386a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:27.868676 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce68b5e-14cf-4188-b66e-09b94322386a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:27.869089 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce68b5e-14cf-4188-b66e-09b94322386a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:27.878110 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce68b5e-14cf-4188-b66e-09b94322386a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:27.880490 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce68b5e-14cf-4188-b66e-09b94322386a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:27.896119 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-fce68b5e-14cf-4188-b66e-09b94322386a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 08 16:29:27.901533 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 288/573] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:27.903698 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1325207-f818-4d9f-81f0-c52fdeca124a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:27.913932 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1325207-f818-4d9f-81f0-c52fdeca124a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:27.919039 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64a787-ad42-43b9-ad38-417ec67c7607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:27.919949 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64a787-ad42-43b9-ad38-417ec67c7607 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:27.920377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64a787-ad42-43b9-ad38-417ec67c7607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:27.920797 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64a787-ad42-43b9-ad38-417ec67c7607 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:27.921988 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64a787-ad42-43b9-ad38-417ec67c7607 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:27.922442 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64a787-ad42-43b9-ad38-417ec67c7607 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:27.924531 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64a787-ad42-43b9-ad38-417ec67c7607 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:27.943730 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 286/574] 10.222.0.35 () {56 vars in 1158 bytes} [Tue Feb 8 16:29:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:27.949617 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce68b5e-14cf-4188-b66e-09b94322386a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:27.960608 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce68b5e-14cf-4188-b66e-09b94322386a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:27.965593 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf42e84-908f-4165-b116-66ef60ea70db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:27.966577 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf42e84-908f-4165-b116-66ef60ea70db admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:27.967019 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf42e84-908f-4165-b116-66ef60ea70db admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:27.967434 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf42e84-908f-4165-b116-66ef60ea70db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:27.979165 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf42e84-908f-4165-b116-66ef60ea70db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:27.981289 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf42e84-908f-4165-b116-66ef60ea70db admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:27.999449 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-faf42e84-908f-4165-b116-66ef60ea70db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:28.003843 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 289/575] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:28.007098 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64a787-ad42-43b9-ad38-417ec67c7607 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:28.017880 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64a787-ad42-43b9-ad38-417ec67c7607 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:28.022729 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bbc6b-3e1d-4be9-ab56-590ada6b0769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:28.023627 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bbc6b-3e1d-4be9-ab56-590ada6b0769 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.024202 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bbc6b-3e1d-4be9-ab56-590ada6b0769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.024656 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bbc6b-3e1d-4be9-ab56-590ada6b0769 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.025657 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bbc6b-3e1d-4be9-ab56-590ada6b0769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:28.026205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bbc6b-3e1d-4be9-ab56-590ada6b0769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:28.028043 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bbc6b-3e1d-4be9-ab56-590ada6b0769 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:28.045577 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 287/576] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:28.049396 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24491888-5702-451f-a36a-b634877f10c0 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.049955 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24491888-5702-451f-a36a-b634877f10c0 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.050382 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf42e84-908f-4165-b116-66ef60ea70db admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:28.050849 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24491888-5702-451f-a36a-b634877f10c0 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.055241 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 288/577] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:28.059884 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d8c48-8844-4814-8fda-865969552407 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.060362 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d8c48-8844-4814-8fda-865969552407 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.060835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d8c48-8844-4814-8fda-865969552407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.070306 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf42e84-908f-4165-b116-66ef60ea70db admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:28.083281 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777edde3-9231-47a9-86f8-bbcfbc8ced84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:28.084447 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777edde3-9231-47a9-86f8-bbcfbc8ced84 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.084931 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777edde3-9231-47a9-86f8-bbcfbc8ced84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.085396 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777edde3-9231-47a9-86f8-bbcfbc8ced84 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.097940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-669d8c48-8844-4814-8fda-865969552407 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:28.099514 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-669d8c48-8844-4814-8fda-865969552407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:28.103227 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777edde3-9231-47a9-86f8-bbcfbc8ced84 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:28.105321 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777edde3-9231-47a9-86f8-bbcfbc8ced84 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:28.108733 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 289/578] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:28.137191 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-777edde3-9231-47a9-86f8-bbcfbc8ced84 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:28.138653 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 290/579] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:28.148325 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d8c48-8844-4814-8fda-865969552407 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:28.148840 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777edde3-9231-47a9-86f8-bbcfbc8ced84 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:28.165029 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777edde3-9231-47a9-86f8-bbcfbc8ced84 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:28.169145 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d8c48-8844-4814-8fda-865969552407 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:28.174843 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5af173-7f7b-4567-b52d-07deda742abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:28.175744 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5af173-7f7b-4567-b52d-07deda742abb admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.176302 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5af173-7f7b-4567-b52d-07deda742abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.176751 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5af173-7f7b-4567-b52d-07deda742abb admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.177777 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5af173-7f7b-4567-b52d-07deda742abb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:28.178337 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5af173-7f7b-4567-b52d-07deda742abb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:28.181094 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5af173-7f7b-4567-b52d-07deda742abb admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:28.181335 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3e3e4-dd3e-4c9a-a343-231bc4961cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:28.182136 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3e3e4-dd3e-4c9a-a343-231bc4961cdc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.182413 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3e3e4-dd3e-4c9a-a343-231bc4961cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.182685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3e3e4-dd3e-4c9a-a343-231bc4961cdc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.201367 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 290/580] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:28.203222 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5af173-7f7b-4567-b52d-07deda742abb admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:28.212807 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3e3e4-dd3e-4c9a-a343-231bc4961cdc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:28.214060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5af173-7f7b-4567-b52d-07deda742abb admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:28.220751 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-95e3e3e4-dd3e-4c9a-a343-231bc4961cdc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 08 16:29:28.222246 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 291/581] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:29:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:28.228221 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3e3e4-dd3e-4c9a-a343-231bc4961cdc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:28.229121 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a606cd-98d5-405a-a074-b809393f92c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:28.230282 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a606cd-98d5-405a-a074-b809393f92c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.230813 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a606cd-98d5-405a-a074-b809393f92c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.231270 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a606cd-98d5-405a-a074-b809393f92c9 admin admin] PATH_INFO: `/v3/projects/6b01069799b34858bbebc201a3f2046d/users/591ac81647b8446ab342e44c3fb35174/roles/54ef06f5478a48d08a2c08df2500fe6f` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.250515 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a606cd-98d5-405a-a074-b809393f92c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b01069799b34858bbebc201a3f2046d, user_id=591ac81647b8446ab342e44c3fb35174, role_id=54ef06f5478a48d08a2c08df2500fe6f)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:28.253718 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a606cd-98d5-405a-a074-b809393f92c9 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:28.254359 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3e3e4-dd3e-4c9a-a343-231bc4961cdc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:28.272153 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 291/582] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:29:28 2022] PUT /identity/v3/projects/6b01069799b34858bbebc201a3f2046d/users/591ac81647b8446ab342e44c3fb35174/roles/54ef06f5478a48d08a2c08df2500fe6f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:29:28.275942 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfb4e2-c08d-4e65-84b8-859f984436e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:28.275942 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfb4e2-c08d-4e65-84b8-859f984436e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.275942 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfb4e2-c08d-4e65-84b8-859f984436e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.275942 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfb4e2-c08d-4e65-84b8-859f984436e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.276289 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfb4e2-c08d-4e65-84b8-859f984436e5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:28.276289 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfb4e2-c08d-4e65-84b8-859f984436e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:28.276922 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfb4e2-c08d-4e65-84b8-859f984436e5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:28.304065 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 292/583] 10.222.0.35 () {56 vars in 1124 bytes} [Tue Feb 8 16:29:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:28.316049 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a606cd-98d5-405a-a074-b809393f92c9 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:28.390183 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a606cd-98d5-405a-a074-b809393f92c9 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:28.395675 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39276902-ab66-4b4e-b9c0-970e90e3ddc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:28.396813 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39276902-ab66-4b4e-b9c0-970e90e3ddc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.397282 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39276902-ab66-4b4e-b9c0-970e90e3ddc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.397736 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39276902-ab66-4b4e-b9c0-970e90e3ddc7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.410274 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39276902-ab66-4b4e-b9c0-970e90e3ddc7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:28.412510 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39276902-ab66-4b4e-b9c0-970e90e3ddc7 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:28.432284 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-39276902-ab66-4b4e-b9c0-970e90e3ddc7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:28.434913 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 292/584] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:28.441309 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfb4e2-c08d-4e65-84b8-859f984436e5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:28.466404 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfb4e2-c08d-4e65-84b8-859f984436e5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:28.476877 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c3a48-0835-473c-b70c-64498790405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:28.477556 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c3a48-0835-473c-b70c-64498790405d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.477837 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c3a48-0835-473c-b70c-64498790405d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.478109 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c3a48-0835-473c-b70c-64498790405d admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.478857 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c3a48-0835-473c-b70c-64498790405d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:28.479160 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c3a48-0835-473c-b70c-64498790405d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:28.480807 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c3a48-0835-473c-b70c-64498790405d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:28.494540 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 293/585] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:28.500649 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39276902-ab66-4b4e-b9c0-970e90e3ddc7 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:28.511300 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39276902-ab66-4b4e-b9c0-970e90e3ddc7 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:28.519565 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48b1c2-1e2d-45db-bbca-415e5dc00051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:28.520673 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48b1c2-1e2d-45db-bbca-415e5dc00051 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.521199 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48b1c2-1e2d-45db-bbca-415e5dc00051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.521648 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48b1c2-1e2d-45db-bbca-415e5dc00051 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.530621 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48b1c2-1e2d-45db-bbca-415e5dc00051 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:28.532997 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48b1c2-1e2d-45db-bbca-415e5dc00051 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:28.549698 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-2c48b1c2-1e2d-45db-bbca-415e5dc00051 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 08 16:29:28.552134 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 293/586] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:29:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:28.557520 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c3a48-0835-473c-b70c-64498790405d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:28.566171 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a9302-0def-41c7-9a3a-5964466e4cfd None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.566748 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a9302-0def-41c7-9a3a-5964466e4cfd None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.567205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a9302-0def-41c7-9a3a-5964466e4cfd None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.569496 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 294/587] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:29:28.573767 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c3a48-0835-473c-b70c-64498790405d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:28.578844 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043e047-7196-4ebb-a426-22be7725aeff None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.579357 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043e047-7196-4ebb-a426-22be7725aeff None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.579903 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043e047-7196-4ebb-a426-22be7725aeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.584113 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735e4f3-d01c-4f35-9e84-5f7dcaeefbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:28.584838 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735e4f3-d01c-4f35-9e84-5f7dcaeefbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.585120 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735e4f3-d01c-4f35-9e84-5f7dcaeefbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.591878 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735e4f3-d01c-4f35-9e84-5f7dcaeefbc0 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.592785 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735e4f3-d01c-4f35-9e84-5f7dcaeefbc0 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:28.593100 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735e4f3-d01c-4f35-9e84-5f7dcaeefbc0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:28.595031 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735e4f3-d01c-4f35-9e84-5f7dcaeefbc0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:28.623391 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 294/588] 10.222.0.35 () {56 vars in 1160 bytes} [Tue Feb 8 16:29:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:28.623914 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-d043e047-7196-4ebb-a426-22be7725aeff None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:28.625986 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d043e047-7196-4ebb-a426-22be7725aeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:28.629470 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735e4f3-d01c-4f35-9e84-5f7dcaeefbc0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:28.639817 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735e4f3-d01c-4f35-9e84-5f7dcaeefbc0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:28.642800 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 295/589] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:29:28.645185 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029dddec-fa18-4b4a-846d-4a11f0fb2248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:28.645973 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dddec-fa18-4b4a-846d-4a11f0fb2248 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.646250 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dddec-fa18-4b4a-846d-4a11f0fb2248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.646519 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dddec-fa18-4b4a-846d-4a11f0fb2248 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.657287 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029dddec-fa18-4b4a-846d-4a11f0fb2248 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:28.659125 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029dddec-fa18-4b4a-846d-4a11f0fb2248 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:28.676351 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-029dddec-fa18-4b4a-846d-4a11f0fb2248 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:28.677859 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 295/590] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:28.682195 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043e047-7196-4ebb-a426-22be7725aeff None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:28.683029 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029dddec-fa18-4b4a-846d-4a11f0fb2248 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:28.693611 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029dddec-fa18-4b4a-846d-4a11f0fb2248 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:28.697864 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674fe10-9dee-4eed-b379-30cd1d888b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:28.698509 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674fe10-9dee-4eed-b379-30cd1d888b9f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.698792 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674fe10-9dee-4eed-b379-30cd1d888b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.699061 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674fe10-9dee-4eed-b379-30cd1d888b9f admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.699357 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043e047-7196-4ebb-a426-22be7725aeff None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:28.699894 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674fe10-9dee-4eed-b379-30cd1d888b9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:28.700201 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674fe10-9dee-4eed-b379-30cd1d888b9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:28.701814 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674fe10-9dee-4eed-b379-30cd1d888b9f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:28.709564 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a2ab6-e17b-4a7f-baba-1d8ec56faa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:28.710362 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a2ab6-e17b-4a7f-baba-1d8ec56faa95 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.710741 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a2ab6-e17b-4a7f-baba-1d8ec56faa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.711020 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a2ab6-e17b-4a7f-baba-1d8ec56faa95 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.714948 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 296/591] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:28.720492 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674fe10-9dee-4eed-b379-30cd1d888b9f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:28.730172 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674fe10-9dee-4eed-b379-30cd1d888b9f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:28.733327 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a2ab6-e17b-4a7f-baba-1d8ec56faa95 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:28.735040 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfd55e-91e9-4691-a39a-e5c7941510b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:28.736013 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfd55e-91e9-4691-a39a-e5c7941510b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.736462 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfd55e-91e9-4691-a39a-e5c7941510b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.736878 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfd55e-91e9-4691-a39a-e5c7941510b5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.742546 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-f57a2ab6-e17b-4a7f-baba-1d8ec56faa95 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 08 16:29:28.744304 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 296/592] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:29:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:28.744613 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfd55e-91e9-4691-a39a-e5c7941510b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:28.746783 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfd55e-91e9-4691-a39a-e5c7941510b5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:28.750720 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a2ab6-e17b-4a7f-baba-1d8ec56faa95 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:28.761624 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-40bfd55e-91e9-4691-a39a-e5c7941510b5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:28.763260 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 297/593] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:28.768723 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a2ab6-e17b-4a7f-baba-1d8ec56faa95 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:28.769889 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfd55e-91e9-4691-a39a-e5c7941510b5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:28.778481 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410477c-66ed-4a4c-9f2a-8baef5843e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:28.779205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410477c-66ed-4a4c-9f2a-8baef5843e54 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.779536 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410477c-66ed-4a4c-9f2a-8baef5843e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.779844 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410477c-66ed-4a4c-9f2a-8baef5843e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.780689 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410477c-66ed-4a4c-9f2a-8baef5843e54 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:28.781621 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410477c-66ed-4a4c-9f2a-8baef5843e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:28.783111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfd55e-91e9-4691-a39a-e5c7941510b5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:28.783422 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410477c-66ed-4a4c-9f2a-8baef5843e54 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:28.788492 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5db4bb-11ea-43c0-8b3e-be0f7e18fff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:28.789496 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5db4bb-11ea-43c0-8b3e-be0f7e18fff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.789975 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5db4bb-11ea-43c0-8b3e-be0f7e18fff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.790457 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5db4bb-11ea-43c0-8b3e-be0f7e18fff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.791449 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5db4bb-11ea-43c0-8b3e-be0f7e18fff9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:28.791985 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5db4bb-11ea-43c0-8b3e-be0f7e18fff9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:28.794061 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5db4bb-11ea-43c0-8b3e-be0f7e18fff9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:28.807085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 297/594] 10.222.0.35 () {56 vars in 1124 bytes} [Tue Feb 8 16:29:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:28.811924 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 298/595] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:28.812953 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410477c-66ed-4a4c-9f2a-8baef5843e54 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:28.814159 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5db4bb-11ea-43c0-8b3e-be0f7e18fff9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:28.824292 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5db4bb-11ea-43c0-8b3e-be0f7e18fff9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:28.829650 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46b0e4-ce2c-4743-9b65-62fffb7fc7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:28.829777 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410477c-66ed-4a4c-9f2a-8baef5843e54 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:28.830948 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46b0e4-ce2c-4743-9b65-62fffb7fc7ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.831442 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46b0e4-ce2c-4743-9b65-62fffb7fc7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.831957 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46b0e4-ce2c-4743-9b65-62fffb7fc7ff admin admin] PATH_INFO: `/v3/projects/6b01069799b34858bbebc201a3f2046d/users/0b936dc9a67846f08e51648e64c3d6ec/roles/54ef06f5478a48d08a2c08df2500fe6f` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.841439 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a646f1-9df8-4ae8-9f3f-c9e7aa6ed291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:28.842195 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a646f1-9df8-4ae8-9f3f-c9e7aa6ed291 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.842478 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a646f1-9df8-4ae8-9f3f-c9e7aa6ed291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.842753 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a646f1-9df8-4ae8-9f3f-c9e7aa6ed291 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.849220 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46b0e4-ce2c-4743-9b65-62fffb7fc7ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b01069799b34858bbebc201a3f2046d, user_id=0b936dc9a67846f08e51648e64c3d6ec, role_id=54ef06f5478a48d08a2c08df2500fe6f)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:28.852202 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46b0e4-ce2c-4743-9b65-62fffb7fc7ff admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:28.863778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a646f1-9df8-4ae8-9f3f-c9e7aa6ed291 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:28.865724 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a646f1-9df8-4ae8-9f3f-c9e7aa6ed291 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:28.867647 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 299/596] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:29:28 2022] PUT /identity/v3/projects/6b01069799b34858bbebc201a3f2046d/users/0b936dc9a67846f08e51648e64c3d6ec/roles/54ef06f5478a48d08a2c08df2500fe6f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:29:28.891957 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-77a646f1-9df8-4ae8-9f3f-c9e7aa6ed291 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:28.893569 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 298/597] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:28.899544 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46b0e4-ce2c-4743-9b65-62fffb7fc7ff admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:28.980932 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46b0e4-ce2c-4743-9b65-62fffb7fc7ff admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:28.988107 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19995888-3f48-4f95-ba68-cb3db71d3ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:28.989204 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19995888-3f48-4f95-ba68-cb3db71d3ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:28.989690 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19995888-3f48-4f95-ba68-cb3db71d3ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:28.990159 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19995888-3f48-4f95-ba68-cb3db71d3ff6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:28.991207 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19995888-3f48-4f95-ba68-cb3db71d3ff6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:28.991723 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19995888-3f48-4f95-ba68-cb3db71d3ff6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:28.993644 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19995888-3f48-4f95-ba68-cb3db71d3ff6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:29.007180 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 300/598] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:29.012671 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a646f1-9df8-4ae8-9f3f-c9e7aa6ed291 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:29.029986 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a646f1-9df8-4ae8-9f3f-c9e7aa6ed291 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:29.045402 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d4a19-b260-45c8-8a28-7ed17a9665c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:29.047042 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d4a19-b260-45c8-8a28-7ed17a9665c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:29.047325 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d4a19-b260-45c8-8a28-7ed17a9665c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:29.047649 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d4a19-b260-45c8-8a28-7ed17a9665c6 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:29.062537 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d4a19-b260-45c8-8a28-7ed17a9665c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:29.065170 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d4a19-b260-45c8-8a28-7ed17a9665c6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:29.091702 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-382d4a19-b260-45c8-8a28-7ed17a9665c6 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 08 16:29:29.098351 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 299/599] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:29:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:29.105161 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19995888-3f48-4f95-ba68-cb3db71d3ff6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:29.121903 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19995888-3f48-4f95-ba68-cb3db71d3ff6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:29.137465 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66939d3-7981-4916-8421-513209441ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:29.138521 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66939d3-7981-4916-8421-513209441ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:29.138999 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66939d3-7981-4916-8421-513209441ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:29.139469 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66939d3-7981-4916-8421-513209441ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:29.140578 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66939d3-7981-4916-8421-513209441ad6 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:29.141082 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66939d3-7981-4916-8421-513209441ad6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:29.143402 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66939d3-7981-4916-8421-513209441ad6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:29.162153 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 301/600] 10.222.0.35 () {56 vars in 1156 bytes} [Tue Feb 8 16:29:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:29.168565 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d4a19-b260-45c8-8a28-7ed17a9665c6 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:29.178224 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d4a19-b260-45c8-8a28-7ed17a9665c6 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:29.186314 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a2f63-cfbb-4385-a3ac-9c4577850f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:29.187056 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a2f63-cfbb-4385-a3ac-9c4577850f49 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:29.187867 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a2f63-cfbb-4385-a3ac-9c4577850f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:29.188234 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a2f63-cfbb-4385-a3ac-9c4577850f49 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:29.196975 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a2f63-cfbb-4385-a3ac-9c4577850f49 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:29.198735 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a2f63-cfbb-4385-a3ac-9c4577850f49 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:29.209706 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 300/601] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:29:29.214808 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66939d3-7981-4916-8421-513209441ad6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:29.225491 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66939d3-7981-4916-8421-513209441ad6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:29.231879 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb447f-c224-4604-81ae-519ef124d86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:29.232670 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb447f-c224-4604-81ae-519ef124d86f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:29.232954 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb447f-c224-4604-81ae-519ef124d86f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:29.233230 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb447f-c224-4604-81ae-519ef124d86f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:29.248783 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb447f-c224-4604-81ae-519ef124d86f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:29.251213 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb447f-c224-4604-81ae-519ef124d86f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:29.275405 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-d7bb447f-c224-4604-81ae-519ef124d86f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:29.276873 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 302/602] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:29.282368 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a2f63-cfbb-4385-a3ac-9c4577850f49 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:29.291710 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a2f63-cfbb-4385-a3ac-9c4577850f49 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:29.303451 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e2b89-66e5-451c-b340-c383b74b9cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:29.304139 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e2b89-66e5-451c-b340-c383b74b9cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:29.304423 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e2b89-66e5-451c-b340-c383b74b9cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:29.304701 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e2b89-66e5-451c-b340-c383b74b9cc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:29.305887 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e2b89-66e5-451c-b340-c383b74b9cc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:29.306197 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e2b89-66e5-451c-b340-c383b74b9cc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:29.307802 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e2b89-66e5-451c-b340-c383b74b9cc8 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:29.328781 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 301/603] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:29.334440 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb447f-c224-4604-81ae-519ef124d86f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:29.348933 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb447f-c224-4604-81ae-519ef124d86f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:29.357300 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d01314-dce7-4801-9d06-66697aecaf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:29.358092 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d01314-dce7-4801-9d06-66697aecaf45 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:29.358377 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d01314-dce7-4801-9d06-66697aecaf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:29.358654 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d01314-dce7-4801-9d06-66697aecaf45 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:29.369186 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d01314-dce7-4801-9d06-66697aecaf45 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:29.371204 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d01314-dce7-4801-9d06-66697aecaf45 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:29.391502 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-94d01314-dce7-4801-9d06-66697aecaf45 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:29.394275 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 303/604] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:29.399774 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e2b89-66e5-451c-b340-c383b74b9cc8 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:29.409900 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e2b89-66e5-451c-b340-c383b74b9cc8 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:29.419568 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f61909-dc43-4efc-ba34-ce794ab4e2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:29.420183 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f61909-dc43-4efc-ba34-ce794ab4e2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:29.420467 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f61909-dc43-4efc-ba34-ce794ab4e2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:29.420744 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f61909-dc43-4efc-ba34-ce794ab4e2d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:29.421591 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f61909-dc43-4efc-ba34-ce794ab4e2d1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:29.421898 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f61909-dc43-4efc-ba34-ce794ab4e2d1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:29.423837 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f61909-dc43-4efc-ba34-ce794ab4e2d1 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:29.440753 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 302/605] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:29.444135 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d01314-dce7-4801-9d06-66697aecaf45 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:29.457647 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d01314-dce7-4801-9d06-66697aecaf45 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:29.464465 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e188e6-5e45-44cc-9079-dd0e32c44b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:29.465106 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e188e6-5e45-44cc-9079-dd0e32c44b48 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:29.465388 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e188e6-5e45-44cc-9079-dd0e32c44b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:29.465665 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e188e6-5e45-44cc-9079-dd0e32c44b48 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:29.466572 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e188e6-5e45-44cc-9079-dd0e32c44b48 admin admin] RBAC: Adding query filter params (role.id=54ef06f5478a48d08a2c08df2500fe6f, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=00fd3c05cd8e4167946a1f567df2cc6a) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:29.467190 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e188e6-5e45-44cc-9079-dd0e32c44b48 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:29.470738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e188e6-5e45-44cc-9079-dd0e32c44b48 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:29.480539 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 304/606] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:29:29 2022] GET /identity/v3/role_assignments?user.id=00fd3c05cd8e4167946a1f567df2cc6a&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=54ef06f5478a48d08a2c08df2500fe6f => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:30.130322 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d5997-2089-4b2e-8337-5adad5554d8e None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.130322 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d5997-2089-4b2e-8337-5adad5554d8e None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.130322 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d5997-2089-4b2e-8337-5adad5554d8e None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.131264 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 303/607] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:30.135652 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02610fd8-61d3-48da-9f02-588744a039ee None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.136224 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02610fd8-61d3-48da-9f02-588744a039ee None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.136705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02610fd8-61d3-48da-9f02-588744a039ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.161332 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-02610fd8-61d3-48da-9f02-588744a039ee None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:30.162854 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-02610fd8-61d3-48da-9f02-588744a039ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:30.174074 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 305/608] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:29:30.204632 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d5997-2089-4b2e-8337-5adad5554d8e None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:30.221547 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d5997-2089-4b2e-8337-5adad5554d8e None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:30.226184 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca215f-cf20-4a0b-90d3-8a9b377005dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:30.227176 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca215f-cf20-4a0b-90d3-8a9b377005dc admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.227667 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca215f-cf20-4a0b-90d3-8a9b377005dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.228172 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca215f-cf20-4a0b-90d3-8a9b377005dc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.238770 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca215f-cf20-4a0b-90d3-8a9b377005dc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:30.246045 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-c4ca215f-cf20-4a0b-90d3-8a9b377005dc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 08 16:29:30.247783 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 304/609] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:29:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:30.255777 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02610fd8-61d3-48da-9f02-588744a039ee None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:30.268257 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02610fd8-61d3-48da-9f02-588744a039ee None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:30.281557 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464445e-d3d8-4898-9ce8-3a07f84d704b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:30.282326 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464445e-d3d8-4898-9ce8-3a07f84d704b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.282611 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464445e-d3d8-4898-9ce8-3a07f84d704b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.282888 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464445e-d3d8-4898-9ce8-3a07f84d704b admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.283655 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464445e-d3d8-4898-9ce8-3a07f84d704b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:30.283992 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464445e-d3d8-4898-9ce8-3a07f84d704b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:30.285594 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464445e-d3d8-4898-9ce8-3a07f84d704b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:30.302286 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 306/610] 10.222.0.35 () {56 vars in 1124 bytes} [Tue Feb 8 16:29:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:30.312835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca215f-cf20-4a0b-90d3-8a9b377005dc admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:30.325562 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfb252-f326-41fd-8c03-5a222810c345 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.325851 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfb252-f326-41fd-8c03-5a222810c345 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.326132 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfb252-f326-41fd-8c03-5a222810c345 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.328901 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 307/611] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:29:30.329777 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca215f-cf20-4a0b-90d3-8a9b377005dc admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:30.334056 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e18f8e-4aad-46ab-8c23-093db039d688 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.334341 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e18f8e-4aad-46ab-8c23-093db039d688 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.334674 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e18f8e-4aad-46ab-8c23-093db039d688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.341237 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b1b3e-eb7b-49a2-85d6-a8ed83d24cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:30.342028 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b1b3e-eb7b-49a2-85d6-a8ed83d24cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.342307 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b1b3e-eb7b-49a2-85d6-a8ed83d24cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.342589 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b1b3e-eb7b-49a2-85d6-a8ed83d24cb6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.360929 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-41e18f8e-4aad-46ab-8c23-093db039d688 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:30.363732 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-41e18f8e-4aad-46ab-8c23-093db039d688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:30.367504 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b1b3e-eb7b-49a2-85d6-a8ed83d24cb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:30.370422 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b1b3e-eb7b-49a2-85d6-a8ed83d24cb6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:30.381496 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 308/612] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:29:30.398593 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-511b1b3e-eb7b-49a2-85d6-a8ed83d24cb6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:30.400380 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 305/613] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:30.405424 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e18f8e-4aad-46ab-8c23-093db039d688 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:30.416887 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e18f8e-4aad-46ab-8c23-093db039d688 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:30.418843 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b1b3e-eb7b-49a2-85d6-a8ed83d24cb6 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:30.428469 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22fc80-7ff2-4bc0-9368-9538f0b348b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:30.429126 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22fc80-7ff2-4bc0-9368-9538f0b348b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.429404 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22fc80-7ff2-4bc0-9368-9538f0b348b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.429674 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22fc80-7ff2-4bc0-9368-9538f0b348b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.430495 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22fc80-7ff2-4bc0-9368-9538f0b348b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:30.430839 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22fc80-7ff2-4bc0-9368-9538f0b348b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:30.431330 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b1b3e-eb7b-49a2-85d6-a8ed83d24cb6 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:30.432476 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22fc80-7ff2-4bc0-9368-9538f0b348b0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:30.436576 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774377b9-57e2-46ac-b6cd-c6fbe5eeef90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:30.438457 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774377b9-57e2-46ac-b6cd-c6fbe5eeef90 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.439030 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774377b9-57e2-46ac-b6cd-c6fbe5eeef90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.439517 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774377b9-57e2-46ac-b6cd-c6fbe5eeef90 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.453164 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774377b9-57e2-46ac-b6cd-c6fbe5eeef90 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:30.459475 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 309/614] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:30.462118 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-774377b9-57e2-46ac-b6cd-c6fbe5eeef90 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 08 16:29:30.463883 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 306/615] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:29:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:30.467834 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22fc80-7ff2-4bc0-9368-9538f0b348b0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:30.470856 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774377b9-57e2-46ac-b6cd-c6fbe5eeef90 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:30.481211 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774377b9-57e2-46ac-b6cd-c6fbe5eeef90 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:30.486492 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22fc80-7ff2-4bc0-9368-9538f0b348b0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:30.487038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a24523-bda1-4382-b4a1-e4eb6f29e751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:30.488025 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a24523-bda1-4382-b4a1-e4eb6f29e751 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.488507 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a24523-bda1-4382-b4a1-e4eb6f29e751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.489018 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a24523-bda1-4382-b4a1-e4eb6f29e751 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.490087 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a24523-bda1-4382-b4a1-e4eb6f29e751 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:30.490592 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a24523-bda1-4382-b4a1-e4eb6f29e751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:30.492514 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a24523-bda1-4382-b4a1-e4eb6f29e751 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:30.500665 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca449cb0-a93b-4087-89b8-a326c4136b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:30.501467 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca449cb0-a93b-4087-89b8-a326c4136b45 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.501748 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca449cb0-a93b-4087-89b8-a326c4136b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.502024 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca449cb0-a93b-4087-89b8-a326c4136b45 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.503674 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 307/616] 10.222.0.35 () {56 vars in 1124 bytes} [Tue Feb 8 16:29:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:30.509354 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a24523-bda1-4382-b4a1-e4eb6f29e751 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:30.520312 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a24523-bda1-4382-b4a1-e4eb6f29e751 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:30.520882 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca449cb0-a93b-4087-89b8-a326c4136b45 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:30.523226 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca449cb0-a93b-4087-89b8-a326c4136b45 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:30.525621 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe335c-0f21-4521-a317-8606f48ca936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:30.526629 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe335c-0f21-4521-a317-8606f48ca936 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.527109 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe335c-0f21-4521-a317-8606f48ca936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.527593 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe335c-0f21-4521-a317-8606f48ca936 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.541617 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe335c-0f21-4521-a317-8606f48ca936 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:30.543779 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe335c-0f21-4521-a317-8606f48ca936 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:30.556535 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-ca449cb0-a93b-4087-89b8-a326c4136b45 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 08 16:29:30.558082 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 310/617] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:30.562112 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-4ffe335c-0f21-4521-a317-8606f48ca936 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:30.567777 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca449cb0-a93b-4087-89b8-a326c4136b45 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:30.568344 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 308/618] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:30.569734 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe335c-0f21-4521-a317-8606f48ca936 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:30.581655 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe335c-0f21-4521-a317-8606f48ca936 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:30.585441 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca449cb0-a93b-4087-89b8-a326c4136b45 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:30.586943 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100e863-c3ff-4ec1-86b8-ae002fec9bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:30.587809 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100e863-c3ff-4ec1-86b8-ae002fec9bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.588317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100e863-c3ff-4ec1-86b8-ae002fec9bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.588770 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100e863-c3ff-4ec1-86b8-ae002fec9bb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.589701 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100e863-c3ff-4ec1-86b8-ae002fec9bb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:30.590182 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100e863-c3ff-4ec1-86b8-ae002fec9bb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:30.592229 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100e863-c3ff-4ec1-86b8-ae002fec9bb6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:30.607728 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469849ed-931e-4c52-8aa1-41d233970238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:30.608783 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469849ed-931e-4c52-8aa1-41d233970238 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.609304 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469849ed-931e-4c52-8aa1-41d233970238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.610536 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469849ed-931e-4c52-8aa1-41d233970238 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.612732 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469849ed-931e-4c52-8aa1-41d233970238 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:30.613224 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469849ed-931e-4c52-8aa1-41d233970238 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:30.617955 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469849ed-931e-4c52-8aa1-41d233970238 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:30.621982 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 309/619] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:30.637231 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100e863-c3ff-4ec1-86b8-ae002fec9bb6 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:30.648956 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100e863-c3ff-4ec1-86b8-ae002fec9bb6 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:30.649919 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 311/620] 10.222.0.35 () {56 vars in 1158 bytes} [Tue Feb 8 16:29:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:30.654000 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db400f1-ddd8-4782-8833-e10ef2fed57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:30.655023 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db400f1-ddd8-4782-8833-e10ef2fed57a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.655325 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469849ed-931e-4c52-8aa1-41d233970238 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:30.656368 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db400f1-ddd8-4782-8833-e10ef2fed57a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.656925 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db400f1-ddd8-4782-8833-e10ef2fed57a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.664914 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db400f1-ddd8-4782-8833-e10ef2fed57a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:30.667166 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db400f1-ddd8-4782-8833-e10ef2fed57a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:30.673006 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469849ed-931e-4c52-8aa1-41d233970238 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:30.688753 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-0db400f1-ddd8-4782-8833-e10ef2fed57a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 08 16:29:30.690601 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 310/621] 10.222.0.35 () {56 vars in 1114 bytes} [Tue Feb 8 16:29:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:30.691340 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c1ee6-6974-4e08-8046-b878df91f79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:30.692317 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c1ee6-6974-4e08-8046-b878df91f79f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.692890 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c1ee6-6974-4e08-8046-b878df91f79f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.693303 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c1ee6-6974-4e08-8046-b878df91f79f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.698475 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db400f1-ddd8-4782-8833-e10ef2fed57a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:30.713626 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c1ee6-6974-4e08-8046-b878df91f79f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:30.715415 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c1ee6-6974-4e08-8046-b878df91f79f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:30.723414 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db400f1-ddd8-4782-8833-e10ef2fed57a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:30.731305 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 312/622] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:29:30.738067 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ae20c-6822-41ee-91a2-55f5fbd12d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:30.738793 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ae20c-6822-41ee-91a2-55f5fbd12d15 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.739081 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ae20c-6822-41ee-91a2-55f5fbd12d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.739350 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ae20c-6822-41ee-91a2-55f5fbd12d15 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.740252 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ae20c-6822-41ee-91a2-55f5fbd12d15 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:30.740615 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ae20c-6822-41ee-91a2-55f5fbd12d15 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:30.740764 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c1ee6-6974-4e08-8046-b878df91f79f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:30.742552 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ae20c-6822-41ee-91a2-55f5fbd12d15 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:30.759581 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c1ee6-6974-4e08-8046-b878df91f79f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:30.773511 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1aae9-55e8-48d9-84a1-29337abea54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:30.774353 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1aae9-55e8-48d9-84a1-29337abea54e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.776011 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1aae9-55e8-48d9-84a1-29337abea54e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.776349 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1aae9-55e8-48d9-84a1-29337abea54e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.780841 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 311/623] 10.222.0.35 () {56 vars in 1154 bytes} [Tue Feb 8 16:29:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:30.786484 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ae20c-6822-41ee-91a2-55f5fbd12d15 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:30.796481 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ae20c-6822-41ee-91a2-55f5fbd12d15 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:30.801809 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c2071-53c6-4b56-9e2a-758f067fc69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:30.802812 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c2071-53c6-4b56-9e2a-758f067fc69c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.803216 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c2071-53c6-4b56-9e2a-758f067fc69c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.803565 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c2071-53c6-4b56-9e2a-758f067fc69c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.804958 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1aae9-55e8-48d9-84a1-29337abea54e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:30.806816 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1aae9-55e8-48d9-84a1-29337abea54e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:30.813271 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c2071-53c6-4b56-9e2a-758f067fc69c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:30.815282 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c2071-53c6-4b56-9e2a-758f067fc69c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:30.825143 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 312/624] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:29:30.831169 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c2071-53c6-4b56-9e2a-758f067fc69c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:30.840091 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c2071-53c6-4b56-9e2a-758f067fc69c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:30.845456 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8c608-f439-41bc-90b8-2b6af1346895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:30.846239 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8c608-f439-41bc-90b8-2b6af1346895 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.846527 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8c608-f439-41bc-90b8-2b6af1346895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.846800 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8c608-f439-41bc-90b8-2b6af1346895 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.849381 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-fae1aae9-55e8-48d9-84a1-29337abea54e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:30.851370 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 313/625] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:30.857506 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1aae9-55e8-48d9-84a1-29337abea54e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:30.864341 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8c608-f439-41bc-90b8-2b6af1346895 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:30.866251 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8c608-f439-41bc-90b8-2b6af1346895 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:30.876929 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1aae9-55e8-48d9-84a1-29337abea54e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:30.884060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-ccf8c608-f439-41bc-90b8-2b6af1346895 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:30.885683 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 313/626] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:30.891377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8c608-f439-41bc-90b8-2b6af1346895 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:30.900891 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be0aec-dda3-4318-bc99-9f243dd6bca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:30.902025 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be0aec-dda3-4318-bc99-9f243dd6bca4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.902527 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be0aec-dda3-4318-bc99-9f243dd6bca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.903022 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be0aec-dda3-4318-bc99-9f243dd6bca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.904066 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8c608-f439-41bc-90b8-2b6af1346895 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:30.904419 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be0aec-dda3-4318-bc99-9f243dd6bca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:30.904970 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be0aec-dda3-4318-bc99-9f243dd6bca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:30.910123 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d414f11-7546-4603-92fa-16757b6d3a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:30.911419 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d414f11-7546-4603-92fa-16757b6d3a62 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.912139 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d414f11-7546-4603-92fa-16757b6d3a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.912781 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d414f11-7546-4603-92fa-16757b6d3a62 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.914368 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d414f11-7546-4603-92fa-16757b6d3a62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:30.915079 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d414f11-7546-4603-92fa-16757b6d3a62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:30.917313 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be0aec-dda3-4318-bc99-9f243dd6bca4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:30.917875 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d414f11-7546-4603-92fa-16757b6d3a62 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:30.933268 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 314/627] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:30.946204 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d414f11-7546-4603-92fa-16757b6d3a62 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:30.949419 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 314/628] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:30.954992 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be0aec-dda3-4318-bc99-9f243dd6bca4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:30.965541 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d414f11-7546-4603-92fa-16757b6d3a62 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:30.976075 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be0aec-dda3-4318-bc99-9f243dd6bca4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:30.976234 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4bdb0-0c9f-470f-8399-51d73deeef4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:30.976234 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4bdb0-0c9f-470f-8399-51d73deeef4d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.976234 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4bdb0-0c9f-470f-8399-51d73deeef4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.976234 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4bdb0-0c9f-470f-8399-51d73deeef4d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.983465 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066659fd-466c-4fa8-9cf5-a74fa91dad0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:30.985427 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066659fd-466c-4fa8-9cf5-a74fa91dad0c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:30.985925 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066659fd-466c-4fa8-9cf5-a74fa91dad0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:30.986334 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066659fd-466c-4fa8-9cf5-a74fa91dad0c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:30.990731 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4bdb0-0c9f-470f-8399-51d73deeef4d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:30.994918 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4bdb0-0c9f-470f-8399-51d73deeef4d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:30.998273 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066659fd-466c-4fa8-9cf5-a74fa91dad0c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:31.000641 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066659fd-466c-4fa8-9cf5-a74fa91dad0c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:31.027823 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-d6f4bdb0-0c9f-470f-8399-51d73deeef4d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:31.027823 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 315/629] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:31.028971 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4bdb0-0c9f-470f-8399-51d73deeef4d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:31.031104 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-066659fd-466c-4fa8-9cf5-a74fa91dad0c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:31.039871 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 315/630] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:31.040961 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066659fd-466c-4fa8-9cf5-a74fa91dad0c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:31.043068 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4bdb0-0c9f-470f-8399-51d73deeef4d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:31.053745 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066659fd-466c-4fa8-9cf5-a74fa91dad0c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:31.060568 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a6773-42ae-491f-afbe-e0ff95c8158c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:31.061275 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a6773-42ae-491f-afbe-e0ff95c8158c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:31.061553 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a6773-42ae-491f-afbe-e0ff95c8158c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:31.061886 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a6773-42ae-491f-afbe-e0ff95c8158c admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:31.062891 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a6773-42ae-491f-afbe-e0ff95c8158c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:31.063710 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a6773-42ae-491f-afbe-e0ff95c8158c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:31.065096 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0dffb-527d-4fcc-960c-57c5e10e0978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:31.065775 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0dffb-527d-4fcc-960c-57c5e10e0978 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:31.066049 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0dffb-527d-4fcc-960c-57c5e10e0978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:31.066314 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0dffb-527d-4fcc-960c-57c5e10e0978 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:31.067927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a6773-42ae-491f-afbe-e0ff95c8158c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:31.068365 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0dffb-527d-4fcc-960c-57c5e10e0978 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:31.068669 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0dffb-527d-4fcc-960c-57c5e10e0978 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:31.073802 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0dffb-527d-4fcc-960c-57c5e10e0978 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:31.088053 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 316/631] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:31.096799 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a6773-42ae-491f-afbe-e0ff95c8158c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:31.097822 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 316/632] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:31.102033 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0dffb-527d-4fcc-960c-57c5e10e0978 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:31.113606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a6773-42ae-491f-afbe-e0ff95c8158c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:31.121593 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0dffb-527d-4fcc-960c-57c5e10e0978 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:31.125111 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b1724-a98e-498c-9929-a423b0840833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:31.125776 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b1724-a98e-498c-9929-a423b0840833 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:31.126054 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b1724-a98e-498c-9929-a423b0840833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:31.126376 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b1724-a98e-498c-9929-a423b0840833 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:31.127721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b1724-a98e-498c-9929-a423b0840833 admin admin] RBAC: Adding query filter params (role.id=54ef06f5478a48d08a2c08df2500fe6f, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=ccb02e5d8ef14f8f85bbacfa5b1f5be3) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:31.128070 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b1724-a98e-498c-9929-a423b0840833 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:31.130619 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b1724-a98e-498c-9929-a423b0840833 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:31.137088 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf96b90-2301-4196-896c-878722804359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:31.137752 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf96b90-2301-4196-896c-878722804359 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:31.138085 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf96b90-2301-4196-896c-878722804359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:31.138409 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf96b90-2301-4196-896c-878722804359 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:31.139274 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf96b90-2301-4196-896c-878722804359 admin admin] RBAC: Adding query filter params (role.id=54ef06f5478a48d08a2c08df2500fe6f, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=10453496872a45a9867fc6a13a13de49) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:31.139587 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf96b90-2301-4196-896c-878722804359 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:31.145918 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 317/633] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:29:31 2022] GET /identity/v3/role_assignments?user.id=ccb02e5d8ef14f8f85bbacfa5b1f5be3&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=54ef06f5478a48d08a2c08df2500fe6f => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:31.146312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf96b90-2301-4196-896c-878722804359 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:31.153607 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 317/634] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:29:31 2022] GET /identity/v3/role_assignments?user.id=10453496872a45a9867fc6a13a13de49&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=54ef06f5478a48d08a2c08df2500fe6f => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:31.484777 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659cb93-9b30-42fa-b4a4-5445a3dbdb6e None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:31.485273 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659cb93-9b30-42fa-b4a4-5445a3dbdb6e None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:31.485504 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659cb93-9b30-42fa-b4a4-5445a3dbdb6e None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:31.487654 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 318/635] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:31.493156 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3036dcb-231c-4d66-bf6d-bd456d75469d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:31.493712 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3036dcb-231c-4d66-bf6d-bd456d75469d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:31.493712 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3036dcb-231c-4d66-bf6d-bd456d75469d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:31.514435 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c3036dcb-231c-4d66-bf6d-bd456d75469d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:31.516309 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c3036dcb-231c-4d66-bf6d-bd456d75469d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:31.526633 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 318/636] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:31.552692 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659cb93-9b30-42fa-b4a4-5445a3dbdb6e None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:31.568742 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659cb93-9b30-42fa-b4a4-5445a3dbdb6e None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:31.574303 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d75a9-ce9d-4a0b-a8bc-7f73918f9248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:31.575326 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d75a9-ce9d-4a0b-a8bc-7f73918f9248 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:31.575861 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d75a9-ce9d-4a0b-a8bc-7f73918f9248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:31.576341 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d75a9-ce9d-4a0b-a8bc-7f73918f9248 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:31.590074 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d75a9-ce9d-4a0b-a8bc-7f73918f9248 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:31.598630 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-f53d75a9-ce9d-4a0b-a8bc-7f73918f9248 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 08 16:29:31.600601 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 319/637] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:29:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:31.611437 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3036dcb-231c-4d66-bf6d-bd456d75469d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:31.618248 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3036dcb-231c-4d66-bf6d-bd456d75469d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:31.623064 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb8eb9-bbea-44ac-a5af-97f9423da6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:31.623744 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb8eb9-bbea-44ac-a5af-97f9423da6fd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:31.624055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb8eb9-bbea-44ac-a5af-97f9423da6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:31.624357 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb8eb9-bbea-44ac-a5af-97f9423da6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:31.625224 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb8eb9-bbea-44ac-a5af-97f9423da6fd admin admin] RBAC: Adding query filter params (name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:31.625635 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb8eb9-bbea-44ac-a5af-97f9423da6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:31.627287 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb8eb9-bbea-44ac-a5af-97f9423da6fd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:31.641265 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 319/638] 10.222.0.35 () {56 vars in 1124 bytes} [Tue Feb 8 16:29:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:31.642892 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d75a9-ce9d-4a0b-a8bc-7f73918f9248 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:31.653171 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d75a9-ce9d-4a0b-a8bc-7f73918f9248 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:31.658282 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47d34d-aafa-4431-8a77-2dfbad386df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:31.659111 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47d34d-aafa-4431-8a77-2dfbad386df6 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:31.659394 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47d34d-aafa-4431-8a77-2dfbad386df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:31.659715 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47d34d-aafa-4431-8a77-2dfbad386df6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:31.670530 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47d34d-aafa-4431-8a77-2dfbad386df6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:31.672981 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47d34d-aafa-4431-8a77-2dfbad386df6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:31.694450 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-ba47d34d-aafa-4431-8a77-2dfbad386df6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:31.695888 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 320/639] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:31.701533 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb8eb9-bbea-44ac-a5af-97f9423da6fd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:31.713777 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb8eb9-bbea-44ac-a5af-97f9423da6fd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:31.720021 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3a44c-f8f1-44cb-b240-d631e37f6d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:31.720677 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3a44c-f8f1-44cb-b240-d631e37f6d70 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:31.721004 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3a44c-f8f1-44cb-b240-d631e37f6d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:31.721279 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3a44c-f8f1-44cb-b240-d631e37f6d70 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:31.722073 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3a44c-f8f1-44cb-b240-d631e37f6d70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:31.722382 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3a44c-f8f1-44cb-b240-d631e37f6d70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:31.724041 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3a44c-f8f1-44cb-b240-d631e37f6d70 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:31.743139 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 320/640] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:31.745792 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47d34d-aafa-4431-8a77-2dfbad386df6 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:31.756496 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47d34d-aafa-4431-8a77-2dfbad386df6 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:31.761447 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468c6a8-ea6a-48c7-a084-b8a69e4a260e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:31.762226 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468c6a8-ea6a-48c7-a084-b8a69e4a260e admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:31.762507 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468c6a8-ea6a-48c7-a084-b8a69e4a260e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:31.762780 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468c6a8-ea6a-48c7-a084-b8a69e4a260e admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:31.771637 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468c6a8-ea6a-48c7-a084-b8a69e4a260e admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:31.773760 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468c6a8-ea6a-48c7-a084-b8a69e4a260e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:31.789004 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-6468c6a8-ea6a-48c7-a084-b8a69e4a260e admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 08 16:29:31.794940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 321/641] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:31.796963 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3a44c-f8f1-44cb-b240-d631e37f6d70 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:31.807300 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3a44c-f8f1-44cb-b240-d631e37f6d70 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:31.814143 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73ec29-6872-4496-bdea-c42af5a4d4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:31.814824 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73ec29-6872-4496-bdea-c42af5a4d4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:31.815107 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73ec29-6872-4496-bdea-c42af5a4d4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:31.815506 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73ec29-6872-4496-bdea-c42af5a4d4a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:31.816508 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73ec29-6872-4496-bdea-c42af5a4d4a5 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:31.816864 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73ec29-6872-4496-bdea-c42af5a4d4a5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:31.819067 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73ec29-6872-4496-bdea-c42af5a4d4a5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:31.846667 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 321/642] 10.222.0.35 () {56 vars in 1158 bytes} [Tue Feb 8 16:29:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:31.851351 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468c6a8-ea6a-48c7-a084-b8a69e4a260e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:31.864189 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468c6a8-ea6a-48c7-a084-b8a69e4a260e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:31.869210 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad04b81-c256-45fa-bde2-234260cf2150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:31.869906 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad04b81-c256-45fa-bde2-234260cf2150 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:31.870187 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad04b81-c256-45fa-bde2-234260cf2150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:31.870517 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad04b81-c256-45fa-bde2-234260cf2150 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:31.881565 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad04b81-c256-45fa-bde2-234260cf2150 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:31.884728 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad04b81-c256-45fa-bde2-234260cf2150 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:31.902105 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 322/643] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:29:31.903513 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73ec29-6872-4496-bdea-c42af5a4d4a5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:31.914251 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73ec29-6872-4496-bdea-c42af5a4d4a5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:31.919189 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6010c2-646c-4516-9f52-cb9f5ebd75ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:31.919993 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6010c2-646c-4516-9f52-cb9f5ebd75ac admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:31.920329 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6010c2-646c-4516-9f52-cb9f5ebd75ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:31.920605 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6010c2-646c-4516-9f52-cb9f5ebd75ac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:31.932446 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6010c2-646c-4516-9f52-cb9f5ebd75ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:31.934461 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6010c2-646c-4516-9f52-cb9f5ebd75ac admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:31.955114 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-4a6010c2-646c-4516-9f52-cb9f5ebd75ac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:31.956762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 322/644] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:31.964945 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad04b81-c256-45fa-bde2-234260cf2150 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:31.977029 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad04b81-c256-45fa-bde2-234260cf2150 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:31.983268 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb83e04-7f2e-4764-9d68-cd0a44526618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:31.984490 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb83e04-7f2e-4764-9d68-cd0a44526618 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:31.984756 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb83e04-7f2e-4764-9d68-cd0a44526618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:31.985087 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb83e04-7f2e-4764-9d68-cd0a44526618 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:31.985917 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb83e04-7f2e-4764-9d68-cd0a44526618 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:31.986289 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb83e04-7f2e-4764-9d68-cd0a44526618 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:31.988008 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb83e04-7f2e-4764-9d68-cd0a44526618 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:32.009069 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 323/645] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:32.014806 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6010c2-646c-4516-9f52-cb9f5ebd75ac admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:32.018034 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0013211-89a0-4a65-9d0d-b803dab6c47c None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.018445 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0013211-89a0-4a65-9d0d-b803dab6c47c None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.018823 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0013211-89a0-4a65-9d0d-b803dab6c47c None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.021115 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 324/646] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:29:32.026995 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d99df-aa33-4698-8b63-d423a842bb50 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.027365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d99df-aa33-4698-8b63-d423a842bb50 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.027710 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d99df-aa33-4698-8b63-d423a842bb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.029812 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6010c2-646c-4516-9f52-cb9f5ebd75ac admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:32.044545 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144b32d-9dca-4cc8-90d8-41138fe9f421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:32.045358 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144b32d-9dca-4cc8-90d8-41138fe9f421 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.045644 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144b32d-9dca-4cc8-90d8-41138fe9f421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.045920 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144b32d-9dca-4cc8-90d8-41138fe9f421 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.050243 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-3e3d99df-aa33-4698-8b63-d423a842bb50 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:32.051452 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-3e3d99df-aa33-4698-8b63-d423a842bb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:32.060948 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144b32d-9dca-4cc8-90d8-41138fe9f421 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:32.061122 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 325/647] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:32.063999 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144b32d-9dca-4cc8-90d8-41138fe9f421 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:32.088990 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-4144b32d-9dca-4cc8-90d8-41138fe9f421 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:32.090672 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d99df-aa33-4698-8b63-d423a842bb50 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:32.090864 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 323/648] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:32.098853 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144b32d-9dca-4cc8-90d8-41138fe9f421 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:32.108481 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d99df-aa33-4698-8b63-d423a842bb50 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:32.115658 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144b32d-9dca-4cc8-90d8-41138fe9f421 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:32.119255 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6242a6-8d5f-4733-96e3-c1458968bb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:32.120082 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6242a6-8d5f-4733-96e3-c1458968bb78 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.120357 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6242a6-8d5f-4733-96e3-c1458968bb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.120625 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6242a6-8d5f-4733-96e3-c1458968bb78 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.130210 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939f90a-f6c4-4f73-af93-26d15ecf33a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:32.130869 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939f90a-f6c4-4f73-af93-26d15ecf33a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.131146 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939f90a-f6c4-4f73-af93-26d15ecf33a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.131417 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939f90a-f6c4-4f73-af93-26d15ecf33a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.132242 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939f90a-f6c4-4f73-af93-26d15ecf33a0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:32.132545 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939f90a-f6c4-4f73-af93-26d15ecf33a0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:32.134394 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939f90a-f6c4-4f73-af93-26d15ecf33a0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:32.142741 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6242a6-8d5f-4733-96e3-c1458968bb78 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:32.149716 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-7e6242a6-8d5f-4733-96e3-c1458968bb78 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 08 16:29:32.152478 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 326/649] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:29:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:32.156553 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 324/650] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:32.161284 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6242a6-8d5f-4733-96e3-c1458968bb78 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:32.165245 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939f90a-f6c4-4f73-af93-26d15ecf33a0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:32.176832 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6242a6-8d5f-4733-96e3-c1458968bb78 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:32.182170 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939f90a-f6c4-4f73-af93-26d15ecf33a0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:32.188272 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad7665-0a1f-406a-be23-5d6092b3d905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:32.188945 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad7665-0a1f-406a-be23-5d6092b3d905 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.189223 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad7665-0a1f-406a-be23-5d6092b3d905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.189497 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad7665-0a1f-406a-be23-5d6092b3d905 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.190267 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad7665-0a1f-406a-be23-5d6092b3d905 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:32.190619 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad7665-0a1f-406a-be23-5d6092b3d905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:32.192321 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad7665-0a1f-406a-be23-5d6092b3d905 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:32.202379 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362e14d-4814-41ea-b72a-01f2c90c0e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:32.203804 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362e14d-4814-41ea-b72a-01f2c90c0e09 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.204192 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362e14d-4814-41ea-b72a-01f2c90c0e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.204473 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362e14d-4814-41ea-b72a-01f2c90c0e09 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.205328 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362e14d-4814-41ea-b72a-01f2c90c0e09 admin admin] RBAC: Adding query filter params (role.id=54ef06f5478a48d08a2c08df2500fe6f, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=591ac81647b8446ab342e44c3fb35174) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:32.205636 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362e14d-4814-41ea-b72a-01f2c90c0e09 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:32.207720 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362e14d-4814-41ea-b72a-01f2c90c0e09 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:32.209321 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 327/651] 10.222.0.35 () {56 vars in 1124 bytes} [Tue Feb 8 16:29:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:32.210599 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad7665-0a1f-406a-be23-5d6092b3d905 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:32.221446 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad7665-0a1f-406a-be23-5d6092b3d905 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:32.225820 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 325/652] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:29:32 2022] GET /identity/v3/role_assignments?user.id=591ac81647b8446ab342e44c3fb35174&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=54ef06f5478a48d08a2c08df2500fe6f => generated 608 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:32.226392 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aec3e3-a025-41b2-86c0-38b6a47d39f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:32.227360 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aec3e3-a025-41b2-86c0-38b6a47d39f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.227645 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aec3e3-a025-41b2-86c0-38b6a47d39f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.227995 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aec3e3-a025-41b2-86c0-38b6a47d39f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.241340 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aec3e3-a025-41b2-86c0-38b6a47d39f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:32.243305 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aec3e3-a025-41b2-86c0-38b6a47d39f4 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:32.263273 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-96aec3e3-a025-41b2-86c0-38b6a47d39f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:32.270127 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 328/653] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:32.271730 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362e14d-4814-41ea-b72a-01f2c90c0e09 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:32.284303 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362e14d-4814-41ea-b72a-01f2c90c0e09 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:32.289205 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a1a04-e052-4a86-93ce-e4ba9290790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:32.289875 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a1a04-e052-4a86-93ce-e4ba9290790a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.290157 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a1a04-e052-4a86-93ce-e4ba9290790a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.290438 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a1a04-e052-4a86-93ce-e4ba9290790a admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.291178 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a1a04-e052-4a86-93ce-e4ba9290790a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:32.291477 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a1a04-e052-4a86-93ce-e4ba9290790a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:32.293281 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a1a04-e052-4a86-93ce-e4ba9290790a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:32.311430 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 326/654] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:32.314535 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aec3e3-a025-41b2-86c0-38b6a47d39f4 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:32.324620 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aec3e3-a025-41b2-86c0-38b6a47d39f4 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:32.330372 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c00fa-ce7b-4c91-b309-d52a7846bd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:32.331176 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c00fa-ce7b-4c91-b309-d52a7846bd5e admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.331453 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c00fa-ce7b-4c91-b309-d52a7846bd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.331892 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c00fa-ce7b-4c91-b309-d52a7846bd5e admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.340342 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c00fa-ce7b-4c91-b309-d52a7846bd5e admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:32.342420 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c00fa-ce7b-4c91-b309-d52a7846bd5e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:32.358403 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-7b5c00fa-ce7b-4c91-b309-d52a7846bd5e admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 08 16:29:32.363901 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 329/655] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:29:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:32.365883 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a1a04-e052-4a86-93ce-e4ba9290790a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:32.377681 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a1a04-e052-4a86-93ce-e4ba9290790a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:32.383527 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26c5ab-fde1-464b-8b05-de5167e56d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:32.384336 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26c5ab-fde1-464b-8b05-de5167e56d92 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.384624 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26c5ab-fde1-464b-8b05-de5167e56d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.384903 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26c5ab-fde1-464b-8b05-de5167e56d92 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.385852 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26c5ab-fde1-464b-8b05-de5167e56d92 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:32.386164 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26c5ab-fde1-464b-8b05-de5167e56d92 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:32.388294 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26c5ab-fde1-464b-8b05-de5167e56d92 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:32.418017 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 327/656] 10.222.0.35 () {56 vars in 1160 bytes} [Tue Feb 8 16:29:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:32.419517 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c00fa-ce7b-4c91-b309-d52a7846bd5e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:32.430566 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c00fa-ce7b-4c91-b309-d52a7846bd5e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:32.435742 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33cdbb-7f67-4d8a-b52a-b9d50b1d6f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:32.436427 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33cdbb-7f67-4d8a-b52a-b9d50b1d6f93 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.436735 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33cdbb-7f67-4d8a-b52a-b9d50b1d6f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.437543 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33cdbb-7f67-4d8a-b52a-b9d50b1d6f93 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.446886 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33cdbb-7f67-4d8a-b52a-b9d50b1d6f93 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:32.448811 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33cdbb-7f67-4d8a-b52a-b9d50b1d6f93 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:32.466390 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 330/657] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:29:32.472518 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26c5ab-fde1-464b-8b05-de5167e56d92 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:32.482975 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26c5ab-fde1-464b-8b05-de5167e56d92 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:32.498503 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca94199-ca5e-4795-85ae-565dacb46393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:32.499897 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca94199-ca5e-4795-85ae-565dacb46393 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.500118 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca94199-ca5e-4795-85ae-565dacb46393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.500389 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca94199-ca5e-4795-85ae-565dacb46393 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.520757 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca94199-ca5e-4795-85ae-565dacb46393 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:32.522646 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca94199-ca5e-4795-85ae-565dacb46393 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:32.554055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-0ca94199-ca5e-4795-85ae-565dacb46393 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:32.555647 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 328/658] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:32.560990 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33cdbb-7f67-4d8a-b52a-b9d50b1d6f93 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:32.577985 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33cdbb-7f67-4d8a-b52a-b9d50b1d6f93 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:32.587748 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b21249-1940-4500-a35e-97a1bca1faec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:32.588929 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b21249-1940-4500-a35e-97a1bca1faec admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.589324 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b21249-1940-4500-a35e-97a1bca1faec admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.589609 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b21249-1940-4500-a35e-97a1bca1faec admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.590418 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b21249-1940-4500-a35e-97a1bca1faec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:32.590725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b21249-1940-4500-a35e-97a1bca1faec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:32.592524 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b21249-1940-4500-a35e-97a1bca1faec admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:32.611558 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 331/659] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:32.613073 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca94199-ca5e-4795-85ae-565dacb46393 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:32.633145 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca94199-ca5e-4795-85ae-565dacb46393 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:32.640676 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7a3a9-6a26-4ef6-8289-5958860b640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:32.641997 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7a3a9-6a26-4ef6-8289-5958860b640c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.642738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7a3a9-6a26-4ef6-8289-5958860b640c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.643257 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7a3a9-6a26-4ef6-8289-5958860b640c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.653241 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7a3a9-6a26-4ef6-8289-5958860b640c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:32.655610 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7a3a9-6a26-4ef6-8289-5958860b640c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:32.674544 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-7cd7a3a9-6a26-4ef6-8289-5958860b640c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:32.676457 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 329/660] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:32.682083 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b21249-1940-4500-a35e-97a1bca1faec admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:32.695800 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da41ac0-d70c-4614-a236-16f01c14cb0b None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.696174 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da41ac0-d70c-4614-a236-16f01c14cb0b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.696361 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da41ac0-d70c-4614-a236-16f01c14cb0b None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.696564 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b21249-1940-4500-a35e-97a1bca1faec admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:32.699682 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 330/661] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:29:32.704857 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd3ce3-fd8b-4958-a48f-83619eae1143 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.705162 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd3ce3-fd8b-4958-a48f-83619eae1143 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.705419 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd3ce3-fd8b-4958-a48f-83619eae1143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.706045 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9ef11-4ea9-44e7-bf02-a139ecc1c549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:32.707012 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9ef11-4ea9-44e7-bf02-a139ecc1c549 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.707586 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9ef11-4ea9-44e7-bf02-a139ecc1c549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.708090 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9ef11-4ea9-44e7-bf02-a139ecc1c549 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.709093 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9ef11-4ea9-44e7-bf02-a139ecc1c549 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:32.709596 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9ef11-4ea9-44e7-bf02-a139ecc1c549 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:32.711701 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9ef11-4ea9-44e7-bf02-a139ecc1c549 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:32.725244 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 332/662] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:32.732059 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9ef11-4ea9-44e7-bf02-a139ecc1c549 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:32.732983 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-04bd3ce3-fd8b-4958-a48f-83619eae1143 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:32.735079 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-04bd3ce3-fd8b-4958-a48f-83619eae1143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:32.746406 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9ef11-4ea9-44e7-bf02-a139ecc1c549 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:32.747830 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 331/663] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:29:32.756126 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff395d-9e36-4f7e-92ac-b78c175d0cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:32.757263 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff395d-9e36-4f7e-92ac-b78c175d0cdb admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.757748 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff395d-9e36-4f7e-92ac-b78c175d0cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.758218 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff395d-9e36-4f7e-92ac-b78c175d0cdb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.759268 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff395d-9e36-4f7e-92ac-b78c175d0cdb admin admin] RBAC: Adding query filter params (role.id=54ef06f5478a48d08a2c08df2500fe6f, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=0b936dc9a67846f08e51648e64c3d6ec) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:32.759869 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff395d-9e36-4f7e-92ac-b78c175d0cdb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:32.761922 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff395d-9e36-4f7e-92ac-b78c175d0cdb admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:32.769983 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 333/664] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:29:32 2022] GET /identity/v3/role_assignments?user.id=0b936dc9a67846f08e51648e64c3d6ec&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=54ef06f5478a48d08a2c08df2500fe6f => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:32.787097 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd3ce3-fd8b-4958-a48f-83619eae1143 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:32.800248 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd3ce3-fd8b-4958-a48f-83619eae1143 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:32.810596 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2a674-4f4a-4caf-925d-146970418c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:32.812456 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2a674-4f4a-4caf-925d-146970418c23 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.813374 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2a674-4f4a-4caf-925d-146970418c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.813932 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2a674-4f4a-4caf-925d-146970418c23 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.828940 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2a674-4f4a-4caf-925d-146970418c23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:32.836853 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-8ce2a674-4f4a-4caf-925d-146970418c23 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 08 16:29:32.838809 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 332/665] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:29:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:32.846307 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff395d-9e36-4f7e-92ac-b78c175d0cdb admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:32.857194 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff395d-9e36-4f7e-92ac-b78c175d0cdb admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:32.864364 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18f900-0794-4133-9d87-fde1a967b100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:32.865483 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18f900-0794-4133-9d87-fde1a967b100 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.865967 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18f900-0794-4133-9d87-fde1a967b100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.866486 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18f900-0794-4133-9d87-fde1a967b100 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.867470 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18f900-0794-4133-9d87-fde1a967b100 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:32.868012 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18f900-0794-4133-9d87-fde1a967b100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:32.870142 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18f900-0794-4133-9d87-fde1a967b100 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:32.886704 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 334/666] 10.222.0.35 () {56 vars in 1124 bytes} [Tue Feb 8 16:29:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:32.894558 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2a674-4f4a-4caf-925d-146970418c23 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:32.906268 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2a674-4f4a-4caf-925d-146970418c23 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:32.911736 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53df634-8d29-4038-a821-8ae0da6038a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:32.912945 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53df634-8d29-4038-a821-8ae0da6038a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.913450 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53df634-8d29-4038-a821-8ae0da6038a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.913919 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53df634-8d29-4038-a821-8ae0da6038a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.927499 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53df634-8d29-4038-a821-8ae0da6038a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:32.929848 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53df634-8d29-4038-a821-8ae0da6038a6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:32.949041 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-d53df634-8d29-4038-a821-8ae0da6038a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:32.950653 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 333/667] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:32.957322 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18f900-0794-4133-9d87-fde1a967b100 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:32.969557 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18f900-0794-4133-9d87-fde1a967b100 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:32.979415 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1b23b-cb25-4597-b090-d0ca222f2cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:32.980570 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1b23b-cb25-4597-b090-d0ca222f2cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:32.981053 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1b23b-cb25-4597-b090-d0ca222f2cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:32.981543 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1b23b-cb25-4597-b090-d0ca222f2cc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:32.982530 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1b23b-cb25-4597-b090-d0ca222f2cc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:32.983046 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1b23b-cb25-4597-b090-d0ca222f2cc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:32.986038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1b23b-cb25-4597-b090-d0ca222f2cc0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:33.005932 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 335/668] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:33.011425 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53df634-8d29-4038-a821-8ae0da6038a6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:33.022305 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53df634-8d29-4038-a821-8ae0da6038a6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:33.027512 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9225f-d3dc-45c1-83a3-b2ced56eda6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:33.028658 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9225f-d3dc-45c1-83a3-b2ced56eda6a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:33.029183 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9225f-d3dc-45c1-83a3-b2ced56eda6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:33.029649 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9225f-d3dc-45c1-83a3-b2ced56eda6a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:33.040239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9225f-d3dc-45c1-83a3-b2ced56eda6a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:33.043114 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9225f-d3dc-45c1-83a3-b2ced56eda6a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:33.058883 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-9ad9225f-d3dc-45c1-83a3-b2ced56eda6a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 08 16:29:33.060854 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 334/669] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:29:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:33.067261 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1b23b-cb25-4597-b090-d0ca222f2cc0 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:33.084338 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1b23b-cb25-4597-b090-d0ca222f2cc0 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:33.094723 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231ff67-0702-4404-a78c-543e1060bd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:33.095433 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231ff67-0702-4404-a78c-543e1060bd3b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:33.095699 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231ff67-0702-4404-a78c-543e1060bd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:33.096022 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231ff67-0702-4404-a78c-543e1060bd3b admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:33.096893 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231ff67-0702-4404-a78c-543e1060bd3b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:33.097197 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231ff67-0702-4404-a78c-543e1060bd3b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:33.099030 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231ff67-0702-4404-a78c-543e1060bd3b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:33.123515 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 336/670] 10.222.0.35 () {56 vars in 1156 bytes} [Tue Feb 8 16:29:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:33.130207 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9225f-d3dc-45c1-83a3-b2ced56eda6a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:33.143394 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9225f-d3dc-45c1-83a3-b2ced56eda6a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:33.152738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6b1a4-3d35-4a79-b683-70a21f042738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:33.153843 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6b1a4-3d35-4a79-b683-70a21f042738 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:33.154371 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6b1a4-3d35-4a79-b683-70a21f042738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:33.154813 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6b1a4-3d35-4a79-b683-70a21f042738 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:33.172780 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6b1a4-3d35-4a79-b683-70a21f042738 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:33.174971 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6b1a4-3d35-4a79-b683-70a21f042738 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:33.194484 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-abb6b1a4-3d35-4a79-b683-70a21f042738 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:33.196250 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 335/671] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:33.201443 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231ff67-0702-4404-a78c-543e1060bd3b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:33.215326 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231ff67-0702-4404-a78c-543e1060bd3b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:33.222524 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7b0e8-c35b-4c3e-ae43-3e6dc1fa1d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:33.223448 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7b0e8-c35b-4c3e-ae43-3e6dc1fa1d6b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:33.223939 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7b0e8-c35b-4c3e-ae43-3e6dc1fa1d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:33.224395 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7b0e8-c35b-4c3e-ae43-3e6dc1fa1d6b admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:33.225301 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7b0e8-c35b-4c3e-ae43-3e6dc1fa1d6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:33.225792 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7b0e8-c35b-4c3e-ae43-3e6dc1fa1d6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:33.227667 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7b0e8-c35b-4c3e-ae43-3e6dc1fa1d6b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:33.244932 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 337/672] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:33.250456 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6b1a4-3d35-4a79-b683-70a21f042738 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:33.264809 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6b1a4-3d35-4a79-b683-70a21f042738 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:33.273294 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007046f-cb78-48d9-b14c-39fdfedd4292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:33.274390 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007046f-cb78-48d9-b14c-39fdfedd4292 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:33.274881 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007046f-cb78-48d9-b14c-39fdfedd4292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:33.275321 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007046f-cb78-48d9-b14c-39fdfedd4292 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:33.288900 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007046f-cb78-48d9-b14c-39fdfedd4292 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:33.291188 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007046f-cb78-48d9-b14c-39fdfedd4292 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:33.308794 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-3007046f-cb78-48d9-b14c-39fdfedd4292 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:33.310782 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 336/673] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:33.316534 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7b0e8-c35b-4c3e-ae43-3e6dc1fa1d6b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:33.328920 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7b0e8-c35b-4c3e-ae43-3e6dc1fa1d6b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:33.337095 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a83679-9ca1-4a17-9033-a10268674c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:33.337997 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a83679-9ca1-4a17-9033-a10268674c0c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:33.338449 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a83679-9ca1-4a17-9033-a10268674c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:33.338915 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a83679-9ca1-4a17-9033-a10268674c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:33.339899 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a83679-9ca1-4a17-9033-a10268674c0c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:33.340377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a83679-9ca1-4a17-9033-a10268674c0c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:33.342416 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a83679-9ca1-4a17-9033-a10268674c0c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:33.359148 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 338/674] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:33.364953 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007046f-cb78-48d9-b14c-39fdfedd4292 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:33.376946 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007046f-cb78-48d9-b14c-39fdfedd4292 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:33.388027 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f2f62-ec5b-45af-9b4e-b7709c4b1f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:33.388909 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f2f62-ec5b-45af-9b4e-b7709c4b1f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:33.389188 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f2f62-ec5b-45af-9b4e-b7709c4b1f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:33.389458 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f2f62-ec5b-45af-9b4e-b7709c4b1f4f admin admin] PATH_INFO: `/v3/projects/6b01069799b34858bbebc201a3f2046d/users/00fd3c05cd8e4167946a1f567df2cc6a/roles/54ef06f5478a48d08a2c08df2500fe6f` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:33.408588 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f2f62-ec5b-45af-9b4e-b7709c4b1f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b01069799b34858bbebc201a3f2046d, user_id=00fd3c05cd8e4167946a1f567df2cc6a, role_id=54ef06f5478a48d08a2c08df2500fe6f)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:33.411663 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f2f62-ec5b-45af-9b4e-b7709c4b1f4f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:33.437584 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 337/675] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:29:33 2022] PUT /identity/v3/projects/6b01069799b34858bbebc201a3f2046d/users/00fd3c05cd8e4167946a1f567df2cc6a/roles/54ef06f5478a48d08a2c08df2500fe6f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:29:34.071709 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3c60d-2e01-4520-a262-6c07bcae1eb5 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:34.072273 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3c60d-2e01-4520-a262-6c07bcae1eb5 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:34.072273 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3c60d-2e01-4520-a262-6c07bcae1eb5 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:34.074295 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 339/676] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:34.081341 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c9377-8ee8-4392-b031-169ce3cf9fbd None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:34.081785 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c9377-8ee8-4392-b031-169ce3cf9fbd None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:34.081880 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c9377-8ee8-4392-b031-169ce3cf9fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:34.108889 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ae8c9377-8ee8-4392-b031-169ce3cf9fbd None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:34.110431 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ae8c9377-8ee8-4392-b031-169ce3cf9fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:34.176007 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 338/677] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:34.200161 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3c60d-2e01-4520-a262-6c07bcae1eb5 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:34.217384 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3c60d-2e01-4520-a262-6c07bcae1eb5 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:34.225231 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545765f-a0b5-48d0-835d-c4a33ecac53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:34.226023 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545765f-a0b5-48d0-835d-c4a33ecac53d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:34.226304 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545765f-a0b5-48d0-835d-c4a33ecac53d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:34.226578 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545765f-a0b5-48d0-835d-c4a33ecac53d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:34.239745 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545765f-a0b5-48d0-835d-c4a33ecac53d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:34.246420 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-5545765f-a0b5-48d0-835d-c4a33ecac53d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:29:34.247581 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 340/678] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:29:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:34.253713 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c9377-8ee8-4392-b031-169ce3cf9fbd None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:34.265355 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c9377-8ee8-4392-b031-169ce3cf9fbd None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:34.276083 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcb687-d640-48b4-8edd-d6a316324ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:34.276743 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcb687-d640-48b4-8edd-d6a316324ffa admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:34.277027 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcb687-d640-48b4-8edd-d6a316324ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:34.277302 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcb687-d640-48b4-8edd-d6a316324ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:34.278062 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcb687-d640-48b4-8edd-d6a316324ffa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:34.278368 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcb687-d640-48b4-8edd-d6a316324ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:34.279989 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcb687-d640-48b4-8edd-d6a316324ffa admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:34.294288 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 339/679] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:34.300236 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545765f-a0b5-48d0-835d-c4a33ecac53d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:34.319378 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545765f-a0b5-48d0-835d-c4a33ecac53d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:34.323996 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172b0e6-a488-4d60-b47f-ca621358a06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:34.324719 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172b0e6-a488-4d60-b47f-ca621358a06b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:34.324999 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172b0e6-a488-4d60-b47f-ca621358a06b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:34.325273 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172b0e6-a488-4d60-b47f-ca621358a06b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:34.337590 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172b0e6-a488-4d60-b47f-ca621358a06b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:34.339427 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172b0e6-a488-4d60-b47f-ca621358a06b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:34.357126 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-9172b0e6-a488-4d60-b47f-ca621358a06b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:34.358656 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 341/680] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:34.364297 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcb687-d640-48b4-8edd-d6a316324ffa admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:34.382128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcb687-d640-48b4-8edd-d6a316324ffa admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:34.397285 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b05379-c39a-4f89-aeea-0ccc8f7ddda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:34.398232 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b05379-c39a-4f89-aeea-0ccc8f7ddda8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:34.398705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b05379-c39a-4f89-aeea-0ccc8f7ddda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:34.399165 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b05379-c39a-4f89-aeea-0ccc8f7ddda8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:34.400143 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b05379-c39a-4f89-aeea-0ccc8f7ddda8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:34.400654 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b05379-c39a-4f89-aeea-0ccc8f7ddda8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:34.402428 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b05379-c39a-4f89-aeea-0ccc8f7ddda8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:34.407071 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1473e5-beeb-4f7c-bbef-f9c550d9b06d None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:34.407358 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1473e5-beeb-4f7c-bbef-f9c550d9b06d None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:34.407630 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1473e5-beeb-4f7c-bbef-f9c550d9b06d None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:34.409732 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 342/681] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:29:34.414832 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863d9b8-136b-4ea2-951a-c695c2a2823d None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:34.415119 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863d9b8-136b-4ea2-951a-c695c2a2823d None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:34.415392 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863d9b8-136b-4ea2-951a-c695c2a2823d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:34.420740 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 340/682] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:34.427164 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b05379-c39a-4f89-aeea-0ccc8f7ddda8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:34.439137 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-d863d9b8-136b-4ea2-951a-c695c2a2823d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:34.440672 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d863d9b8-136b-4ea2-951a-c695c2a2823d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:34.441114 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b05379-c39a-4f89-aeea-0ccc8f7ddda8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:34.449987 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 343/683] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:29:34.455865 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65df0d4-6085-4758-8253-d064fd51d71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:34.455865 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65df0d4-6085-4758-8253-d064fd51d71b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:34.455865 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65df0d4-6085-4758-8253-d064fd51d71b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:34.455865 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65df0d4-6085-4758-8253-d064fd51d71b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:34.464828 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65df0d4-6085-4758-8253-d064fd51d71b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:34.466852 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65df0d4-6085-4758-8253-d064fd51d71b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:34.478924 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863d9b8-136b-4ea2-951a-c695c2a2823d None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:34.481248 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-c65df0d4-6085-4758-8253-d064fd51d71b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 08 16:29:34.482672 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 341/684] 10.222.0.35 () {56 vars in 1114 bytes} [Tue Feb 8 16:29:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:34.489569 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863d9b8-136b-4ea2-951a-c695c2a2823d None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:34.491863 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65df0d4-6085-4758-8253-d064fd51d71b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:34.495148 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72010ab1-ce0d-44cb-abab-3702eae86f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:34.496305 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72010ab1-ce0d-44cb-abab-3702eae86f65 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:34.496784 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72010ab1-ce0d-44cb-abab-3702eae86f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:34.497273 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72010ab1-ce0d-44cb-abab-3702eae86f65 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:34.508981 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65df0d4-6085-4758-8253-d064fd51d71b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:34.510227 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72010ab1-ce0d-44cb-abab-3702eae86f65 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:34.512375 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72010ab1-ce0d-44cb-abab-3702eae86f65 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:34.525171 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744a29b-675a-4724-8249-0aea257d8fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:34.527055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744a29b-675a-4724-8249-0aea257d8fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:34.527711 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744a29b-675a-4724-8249-0aea257d8fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:34.529072 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744a29b-675a-4724-8249-0aea257d8fb9 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:34.532116 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744a29b-675a-4724-8249-0aea257d8fb9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:34.534325 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744a29b-675a-4724-8249-0aea257d8fb9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:34.539575 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744a29b-675a-4724-8249-0aea257d8fb9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:34.543066 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-72010ab1-ce0d-44cb-abab-3702eae86f65 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:34.545929 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 344/685] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:34.554960 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72010ab1-ce0d-44cb-abab-3702eae86f65 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:34.575806 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72010ab1-ce0d-44cb-abab-3702eae86f65 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:34.581636 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7378b8-f239-4610-9da8-9498e738a594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:34.581993 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 342/686] 10.222.0.35 () {56 vars in 1154 bytes} [Tue Feb 8 16:29:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:34.582787 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7378b8-f239-4610-9da8-9498e738a594 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:34.583291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7378b8-f239-4610-9da8-9498e738a594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:34.583780 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7378b8-f239-4610-9da8-9498e738a594 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:34.584778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7378b8-f239-4610-9da8-9498e738a594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:34.585276 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7378b8-f239-4610-9da8-9498e738a594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:34.587328 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7378b8-f239-4610-9da8-9498e738a594 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:34.587511 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744a29b-675a-4724-8249-0aea257d8fb9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:34.601437 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 345/687] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:34.607114 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7378b8-f239-4610-9da8-9498e738a594 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:34.611027 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744a29b-675a-4724-8249-0aea257d8fb9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:34.619364 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7378b8-f239-4610-9da8-9498e738a594 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:34.625236 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab411c-d195-4486-b437-1efec0c70b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:34.625610 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd170e6-4aca-4946-8e7d-91fe3208b287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:34.626254 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd170e6-4aca-4946-8e7d-91fe3208b287 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:34.626531 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd170e6-4aca-4946-8e7d-91fe3208b287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:34.626799 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd170e6-4aca-4946-8e7d-91fe3208b287 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:34.627153 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab411c-d195-4486-b437-1efec0c70b9f admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:34.627701 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab411c-d195-4486-b437-1efec0c70b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:34.628281 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab411c-d195-4486-b437-1efec0c70b9f admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:34.629207 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab411c-d195-4486-b437-1efec0c70b9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:34.631417 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab411c-d195-4486-b437-1efec0c70b9f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:34.653803 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd170e6-4aca-4946-8e7d-91fe3208b287 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:34.653803 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd170e6-4aca-4946-8e7d-91fe3208b287 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:34.661317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 346/688] 10.222.0.35 () {60 vars in 1153 bytes} [Tue Feb 8 16:29:34 2022] POST /identity/v3/users => generated 254 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:29:34.674318 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 343/689] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 08 16:29:34.679956 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab411c-d195-4486-b437-1efec0c70b9f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:34.690919 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab411c-d195-4486-b437-1efec0c70b9f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:34.700992 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b3795-b701-4b17-b965-70bcb4923fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:34.702154 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b3795-b701-4b17-b965-70bcb4923fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:34.703273 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b3795-b701-4b17-b965-70bcb4923fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:34.703781 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b3795-b701-4b17-b965-70bcb4923fa7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:34.717703 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b3795-b701-4b17-b965-70bcb4923fa7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:34.720008 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b3795-b701-4b17-b965-70bcb4923fa7 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:34.738354 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-262b3795-b701-4b17-b965-70bcb4923fa7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:34.740330 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 347/690] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:34.747793 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd170e6-4aca-4946-8e7d-91fe3208b287 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:34.767388 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd170e6-4aca-4946-8e7d-91fe3208b287 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:34.778732 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159e467-f82e-4aa8-b598-09f606cb6355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:34.779460 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159e467-f82e-4aa8-b598-09f606cb6355 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:34.779747 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159e467-f82e-4aa8-b598-09f606cb6355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:34.780116 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159e467-f82e-4aa8-b598-09f606cb6355 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:34.781392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159e467-f82e-4aa8-b598-09f606cb6355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:34.781731 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159e467-f82e-4aa8-b598-09f606cb6355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:34.783476 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159e467-f82e-4aa8-b598-09f606cb6355 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:34.801967 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 344/691] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:34.807434 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b3795-b701-4b17-b965-70bcb4923fa7 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:34.818513 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b3795-b701-4b17-b965-70bcb4923fa7 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:34.829677 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c192658-7e19-41ee-a048-f23fedc4fea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:34.830816 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c192658-7e19-41ee-a048-f23fedc4fea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:34.831298 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c192658-7e19-41ee-a048-f23fedc4fea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:34.831788 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c192658-7e19-41ee-a048-f23fedc4fea4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:34.839911 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c192658-7e19-41ee-a048-f23fedc4fea4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:34.842293 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c192658-7e19-41ee-a048-f23fedc4fea4 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:34.857389 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-8c192658-7e19-41ee-a048-f23fedc4fea4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:34.860159 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 348/692] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:34.867808 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159e467-f82e-4aa8-b598-09f606cb6355 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:34.882692 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159e467-f82e-4aa8-b598-09f606cb6355 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:34.898141 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2633170-e970-4d2b-a311-8fdd54e262c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:34.898811 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2633170-e970-4d2b-a311-8fdd54e262c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:34.899095 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2633170-e970-4d2b-a311-8fdd54e262c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:34.899373 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2633170-e970-4d2b-a311-8fdd54e262c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:34.900212 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2633170-e970-4d2b-a311-8fdd54e262c3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:34.900522 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2633170-e970-4d2b-a311-8fdd54e262c3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:34.902378 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2633170-e970-4d2b-a311-8fdd54e262c3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:34.916371 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 345/693] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:34.923151 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c192658-7e19-41ee-a048-f23fedc4fea4 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:34.935167 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c192658-7e19-41ee-a048-f23fedc4fea4 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:34.941428 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d165a-1ce4-4ae3-a3c7-ff7b37eec3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:34.942222 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d165a-1ce4-4ae3-a3c7-ff7b37eec3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:34.942572 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d165a-1ce4-4ae3-a3c7-ff7b37eec3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:34.942914 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d165a-1ce4-4ae3-a3c7-ff7b37eec3f3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:34.943846 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d165a-1ce4-4ae3-a3c7-ff7b37eec3f3 admin admin] RBAC: Adding query filter params (role.id=e6d18df5c4e74dfd8ebd9c636f45936e, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=ccb02e5d8ef14f8f85bbacfa5b1f5be3) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:34.944225 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d165a-1ce4-4ae3-a3c7-ff7b37eec3f3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:34.946123 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d165a-1ce4-4ae3-a3c7-ff7b37eec3f3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:34.952516 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 349/694] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:29:34 2022] GET /identity/v3/role_assignments?user.id=ccb02e5d8ef14f8f85bbacfa5b1f5be3&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=e6d18df5c4e74dfd8ebd9c636f45936e => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:35.284174 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a993854-28b8-4f3d-b27d-262c78d7f35e None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:35.284682 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a993854-28b8-4f3d-b27d-262c78d7f35e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:35.284682 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a993854-28b8-4f3d-b27d-262c78d7f35e None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:35.286627 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 346/695] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:35.291976 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cc673-2a6a-4afe-ac4a-390d2151aff4 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:35.292423 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cc673-2a6a-4afe-ac4a-390d2151aff4 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:35.292610 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cc673-2a6a-4afe-ac4a-390d2151aff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:35.321550 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-830cc673-2a6a-4afe-ac4a-390d2151aff4 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:35.322755 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-830cc673-2a6a-4afe-ac4a-390d2151aff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:35.333842 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 350/696] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:35.356681 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a993854-28b8-4f3d-b27d-262c78d7f35e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:35.376431 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a993854-28b8-4f3d-b27d-262c78d7f35e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:35.381065 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f982a1-e305-4c72-9fbb-d5286a3316dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:35.381854 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f982a1-e305-4c72-9fbb-d5286a3316dc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:35.382128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f982a1-e305-4c72-9fbb-d5286a3316dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:35.382398 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f982a1-e305-4c72-9fbb-d5286a3316dc admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:35.383234 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f982a1-e305-4c72-9fbb-d5286a3316dc admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:35.384094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-10f982a1-e305-4c72-9fbb-d5286a3316dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:29:35.384094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Feb 08 16:29:35.384094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: Feb 08 16:29:35.384957 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f982a1-e305-4c72-9fbb-d5286a3316dc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:35.423905 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-10f982a1-e305-4c72-9fbb-d5286a3316dc admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 08 16:29:35.426005 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 347/697] 10.222.0.35 () {56 vars in 1150 bytes} [Tue Feb 8 16:29:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:35.433233 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cc673-2a6a-4afe-ac4a-390d2151aff4 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:35.443096 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cc673-2a6a-4afe-ac4a-390d2151aff4 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:35.451828 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48022048-23ad-4981-8d87-c7477aef4062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:35.452672 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48022048-23ad-4981-8d87-c7477aef4062 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:35.452949 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48022048-23ad-4981-8d87-c7477aef4062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:35.453219 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48022048-23ad-4981-8d87-c7477aef4062 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:35.454008 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48022048-23ad-4981-8d87-c7477aef4062 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:35.454313 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48022048-23ad-4981-8d87-c7477aef4062 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:35.455365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING py.warnings [None req-48022048-23ad-4981-8d87-c7477aef4062 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:29:35.455365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: warnings.warn(msg) Feb 08 16:29:35.455365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: Feb 08 16:29:35.456317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48022048-23ad-4981-8d87-c7477aef4062 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:35.465843 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 351/698] 10.222.0.35 () {56 vars in 1145 bytes} [Tue Feb 8 16:29:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:35.471868 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f982a1-e305-4c72-9fbb-d5286a3316dc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:35.485301 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f982a1-e305-4c72-9fbb-d5286a3316dc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:35.495918 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bc48d-5b59-4ed3-add9-6457ab716067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:35.496576 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bc48d-5b59-4ed3-add9-6457ab716067 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:35.496849 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bc48d-5b59-4ed3-add9-6457ab716067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:35.497120 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bc48d-5b59-4ed3-add9-6457ab716067 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:35.497836 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bc48d-5b59-4ed3-add9-6457ab716067 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:35.498133 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bc48d-5b59-4ed3-add9-6457ab716067 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:35.499170 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-614bc48d-5b59-4ed3-add9-6457ab716067 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:29:35.499170 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Feb 08 16:29:35.499170 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: Feb 08 16:29:35.500248 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bc48d-5b59-4ed3-add9-6457ab716067 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:35.513166 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 348/699] 10.222.0.35 () {56 vars in 1145 bytes} [Tue Feb 8 16:29:35 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:35.867766 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf34a1-a29b-4701-bace-8198c1963c9e None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:35.868142 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf34a1-a29b-4701-bace-8198c1963c9e None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:35.868316 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf34a1-a29b-4701-bace-8198c1963c9e None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:35.870255 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 352/700] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:35.876916 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38216d9-4a95-4e9c-8e8a-7880a62fceaf None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:35.877184 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38216d9-4a95-4e9c-8e8a-7880a62fceaf None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:35.877470 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38216d9-4a95-4e9c-8e8a-7880a62fceaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:35.904750 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c38216d9-4a95-4e9c-8e8a-7880a62fceaf None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:35.906214 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c38216d9-4a95-4e9c-8e8a-7880a62fceaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:35.914479 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 349/701] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:35.942456 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf34a1-a29b-4701-bace-8198c1963c9e None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:35.961503 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf34a1-a29b-4701-bace-8198c1963c9e None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:35.965993 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b5ff5-1540-4b9e-ab1b-45b01af259af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:35.966777 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b5ff5-1540-4b9e-ab1b-45b01af259af admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:35.967094 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b5ff5-1540-4b9e-ab1b-45b01af259af admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:35.967374 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b5ff5-1540-4b9e-ab1b-45b01af259af admin admin] PATH_INFO: `/v3/services/network` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:35.968683 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b5ff5-1540-4b9e-ab1b-45b01af259af admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:35.969630 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING py.warnings [None req-428b5ff5-1540-4b9e-ab1b-45b01af259af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:29:35.969630 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: warnings.warn(msg) Feb 08 16:29:35.969630 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: Feb 08 16:29:35.970496 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b5ff5-1540-4b9e-ab1b-45b01af259af admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:35.990976 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-428b5ff5-1540-4b9e-ab1b-45b01af259af admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 08 16:29:35.992234 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 353/702] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:35 2022] GET /identity/v3/services/network => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:35.998018 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38216d9-4a95-4e9c-8e8a-7880a62fceaf None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:36.012759 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38216d9-4a95-4e9c-8e8a-7880a62fceaf None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:36.020161 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2426a72-1920-4b28-9bcb-80bf638351fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:36.020825 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2426a72-1920-4b28-9bcb-80bf638351fa admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:36.021109 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2426a72-1920-4b28-9bcb-80bf638351fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:36.021387 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2426a72-1920-4b28-9bcb-80bf638351fa admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:36.022111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2426a72-1920-4b28-9bcb-80bf638351fa admin admin] RBAC: Adding query filter params (name=network) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:36.022417 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2426a72-1920-4b28-9bcb-80bf638351fa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:36.024036 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2426a72-1920-4b28-9bcb-80bf638351fa admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:36.033962 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 350/703] 10.222.0.35 () {56 vars in 1133 bytes} [Tue Feb 8 16:29:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:36.039445 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b5ff5-1540-4b9e-ab1b-45b01af259af admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:36.050289 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b5ff5-1540-4b9e-ab1b-45b01af259af admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:36.059536 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7de41-f456-4702-88d4-aad16b9c27d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:36.060272 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7de41-f456-4702-88d4-aad16b9c27d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:36.060552 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7de41-f456-4702-88d4-aad16b9c27d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:36.060832 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7de41-f456-4702-88d4-aad16b9c27d2 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:36.061637 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7de41-f456-4702-88d4-aad16b9c27d2 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:36.061944 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7de41-f456-4702-88d4-aad16b9c27d2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:36.063632 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7de41-f456-4702-88d4-aad16b9c27d2 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:36.070195 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 354/704] 10.222.0.35 () {56 vars in 1133 bytes} [Tue Feb 8 16:29:36 2022] GET /identity/v3/services?type=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:36.471789 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934488e8-3cb3-42dd-b0df-31f2e0616f2f None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:36.471789 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934488e8-3cb3-42dd-b0df-31f2e0616f2f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:36.471789 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934488e8-3cb3-42dd-b0df-31f2e0616f2f None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:36.473628 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 351/705] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:36.480156 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675ff48-6fe9-4bae-b757-c0e32adbf4d4 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:36.480968 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675ff48-6fe9-4bae-b757-c0e32adbf4d4 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:36.481479 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675ff48-6fe9-4bae-b757-c0e32adbf4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:36.501410 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-9675ff48-6fe9-4bae-b757-c0e32adbf4d4 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:36.502885 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-9675ff48-6fe9-4bae-b757-c0e32adbf4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:36.515845 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 355/706] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 08 16:29:36.535919 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934488e8-3cb3-42dd-b0df-31f2e0616f2f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:36.550168 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934488e8-3cb3-42dd-b0df-31f2e0616f2f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:36.556152 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f9ff3-93b1-4e82-9ae1-124ae248e741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:36.557217 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f9ff3-93b1-4e82-9ae1-124ae248e741 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:36.557738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f9ff3-93b1-4e82-9ae1-124ae248e741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:36.558228 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f9ff3-93b1-4e82-9ae1-124ae248e741 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:36.571257 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f9ff3-93b1-4e82-9ae1-124ae248e741 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:36.579006 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-ad6f9ff3-93b1-4e82-9ae1-124ae248e741 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 08 16:29:36.583803 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 352/707] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:29:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:36.586891 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675ff48-6fe9-4bae-b757-c0e32adbf4d4 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:36.596827 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675ff48-6fe9-4bae-b757-c0e32adbf4d4 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:36.601699 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b6de5-5626-4f6c-88df-4e5b1217a6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:36.602587 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b6de5-5626-4f6c-88df-4e5b1217a6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:36.603068 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b6de5-5626-4f6c-88df-4e5b1217a6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:36.603563 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b6de5-5626-4f6c-88df-4e5b1217a6e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:36.604619 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b6de5-5626-4f6c-88df-4e5b1217a6e8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:36.605174 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b6de5-5626-4f6c-88df-4e5b1217a6e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:36.607020 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b6de5-5626-4f6c-88df-4e5b1217a6e8 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:36.620860 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 356/708] 10.222.0.35 () {56 vars in 1124 bytes} [Tue Feb 8 16:29:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:36.622404 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f9ff3-93b1-4e82-9ae1-124ae248e741 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:36.633380 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f9ff3-93b1-4e82-9ae1-124ae248e741 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:36.638279 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b7c8e-eb91-4544-aca7-6917c10ae2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:36.639352 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b7c8e-eb91-4544-aca7-6917c10ae2cb admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:36.640600 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b7c8e-eb91-4544-aca7-6917c10ae2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:36.641214 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b7c8e-eb91-4544-aca7-6917c10ae2cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:36.653846 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b7c8e-eb91-4544-aca7-6917c10ae2cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:36.656944 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b7c8e-eb91-4544-aca7-6917c10ae2cb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:36.679216 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-9c5b7c8e-eb91-4544-aca7-6917c10ae2cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:36.685400 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 353/709] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:36.687780 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b6de5-5626-4f6c-88df-4e5b1217a6e8 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:36.704455 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b6de5-5626-4f6c-88df-4e5b1217a6e8 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:36.709458 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25de4e-8890-4e25-b9e7-578e847657bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:36.710492 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25de4e-8890-4e25-b9e7-578e847657bb admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:36.710976 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25de4e-8890-4e25-b9e7-578e847657bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:36.711465 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25de4e-8890-4e25-b9e7-578e847657bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:36.712433 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25de4e-8890-4e25-b9e7-578e847657bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:36.712940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25de4e-8890-4e25-b9e7-578e847657bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:36.714807 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25de4e-8890-4e25-b9e7-578e847657bb admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:36.731538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 357/710] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:36.733236 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b7c8e-eb91-4544-aca7-6917c10ae2cb admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:36.743681 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b7c8e-eb91-4544-aca7-6917c10ae2cb admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:36.748507 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebd6f0-4efd-42df-a83f-0cdc729fdaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:36.750119 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebd6f0-4efd-42df-a83f-0cdc729fdaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:36.750609 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebd6f0-4efd-42df-a83f-0cdc729fdaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:36.751081 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebd6f0-4efd-42df-a83f-0cdc729fdaa5 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:36.760405 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebd6f0-4efd-42df-a83f-0cdc729fdaa5 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:36.762741 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebd6f0-4efd-42df-a83f-0cdc729fdaa5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:36.780910 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-c5ebd6f0-4efd-42df-a83f-0cdc729fdaa5 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 08 16:29:36.785392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 354/711] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:29:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:36.789009 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25de4e-8890-4e25-b9e7-578e847657bb admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:36.800101 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25de4e-8890-4e25-b9e7-578e847657bb admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:36.805376 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c7fdb-f824-41d3-999c-fb34d58d75d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:36.806573 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c7fdb-f824-41d3-999c-fb34d58d75d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:36.807080 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c7fdb-f824-41d3-999c-fb34d58d75d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:36.807559 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c7fdb-f824-41d3-999c-fb34d58d75d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:36.808654 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c7fdb-f824-41d3-999c-fb34d58d75d4 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:36.809174 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c7fdb-f824-41d3-999c-fb34d58d75d4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:36.812229 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c7fdb-f824-41d3-999c-fb34d58d75d4 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:36.841098 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 358/712] 10.222.0.35 () {56 vars in 1156 bytes} [Tue Feb 8 16:29:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:36.846041 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebd6f0-4efd-42df-a83f-0cdc729fdaa5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:36.858057 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebd6f0-4efd-42df-a83f-0cdc729fdaa5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:36.864174 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0696770-ab67-47cd-9b15-c4d5d62c8049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:36.865126 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0696770-ab67-47cd-9b15-c4d5d62c8049 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:36.865656 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0696770-ab67-47cd-9b15-c4d5d62c8049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:36.866135 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0696770-ab67-47cd-9b15-c4d5d62c8049 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:36.877187 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0696770-ab67-47cd-9b15-c4d5d62c8049 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:36.879531 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0696770-ab67-47cd-9b15-c4d5d62c8049 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:36.895965 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 355/713] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:29:36.897672 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c7fdb-f824-41d3-999c-fb34d58d75d4 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:36.908706 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c7fdb-f824-41d3-999c-fb34d58d75d4 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:36.914970 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9b4fc-c14f-4bdd-9302-cedd1d61bdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:36.916138 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9b4fc-c14f-4bdd-9302-cedd1d61bdeb admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:36.916662 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9b4fc-c14f-4bdd-9302-cedd1d61bdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:36.917241 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9b4fc-c14f-4bdd-9302-cedd1d61bdeb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:36.936174 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9b4fc-c14f-4bdd-9302-cedd1d61bdeb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:36.939699 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9b4fc-c14f-4bdd-9302-cedd1d61bdeb admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:36.959994 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-75a9b4fc-c14f-4bdd-9302-cedd1d61bdeb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:36.966434 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 359/714] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:36.968766 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0696770-ab67-47cd-9b15-c4d5d62c8049 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:36.984584 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0696770-ab67-47cd-9b15-c4d5d62c8049 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:36.989752 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b823c-4923-4347-82cb-c1dfc3fb262a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:36.990699 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b823c-4923-4347-82cb-c1dfc3fb262a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:36.991432 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b823c-4923-4347-82cb-c1dfc3fb262a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:36.992006 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b823c-4923-4347-82cb-c1dfc3fb262a admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:36.993010 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b823c-4923-4347-82cb-c1dfc3fb262a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:36.993507 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b823c-4923-4347-82cb-c1dfc3fb262a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:36.995359 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b823c-4923-4347-82cb-c1dfc3fb262a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:37.013816 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 356/715] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:37.016162 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9b4fc-c14f-4bdd-9302-cedd1d61bdeb admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:37.026590 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9b4fc-c14f-4bdd-9302-cedd1d61bdeb admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:37.031836 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa94d3-a2b4-4ef8-a602-681aa6ae4863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:37.032961 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa94d3-a2b4-4ef8-a602-681aa6ae4863 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:37.033504 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa94d3-a2b4-4ef8-a602-681aa6ae4863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:37.034093 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa94d3-a2b4-4ef8-a602-681aa6ae4863 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:37.042069 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa94d3-a2b4-4ef8-a602-681aa6ae4863 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:37.044370 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa94d3-a2b4-4ef8-a602-681aa6ae4863 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:37.059023 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-8caa94d3-a2b4-4ef8-a602-681aa6ae4863 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:37.063874 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 360/716] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:37.067593 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b823c-4923-4347-82cb-c1dfc3fb262a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:37.078096 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b823c-4923-4347-82cb-c1dfc3fb262a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:37.083014 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e6c70-6a9b-4f84-b366-d5fc2ee50d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:37.084017 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e6c70-6a9b-4f84-b366-d5fc2ee50d7f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:37.084493 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e6c70-6a9b-4f84-b366-d5fc2ee50d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:37.084965 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e6c70-6a9b-4f84-b366-d5fc2ee50d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:37.085954 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e6c70-6a9b-4f84-b366-d5fc2ee50d7f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:37.086489 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e6c70-6a9b-4f84-b366-d5fc2ee50d7f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:37.088970 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e6c70-6a9b-4f84-b366-d5fc2ee50d7f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:37.117563 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 357/717] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:37.119202 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa94d3-a2b4-4ef8-a602-681aa6ae4863 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:37.132041 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa94d3-a2b4-4ef8-a602-681aa6ae4863 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:37.137930 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ff62b-e426-426f-8c48-39a65e233072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:37.139130 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ff62b-e426-426f-8c48-39a65e233072 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:37.139688 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ff62b-e426-426f-8c48-39a65e233072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:37.140227 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ff62b-e426-426f-8c48-39a65e233072 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:37.141279 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ff62b-e426-426f-8c48-39a65e233072 admin admin] RBAC: Adding query filter params (role.id=54ef06f5478a48d08a2c08df2500fe6f, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=00fd3c05cd8e4167946a1f567df2cc6a) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:37.141823 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ff62b-e426-426f-8c48-39a65e233072 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:37.144676 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ff62b-e426-426f-8c48-39a65e233072 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:37.158988 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 361/718] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:29:37 2022] GET /identity/v3/role_assignments?user.id=00fd3c05cd8e4167946a1f567df2cc6a&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=54ef06f5478a48d08a2c08df2500fe6f => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:37.597144 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32447690-25f2-40d2-b9bc-1c004a845ca2 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:37.598237 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32447690-25f2-40d2-b9bc-1c004a845ca2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:37.598756 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32447690-25f2-40d2-b9bc-1c004a845ca2 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:37.601311 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 358/719] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:37.606837 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b828c70-449d-40cd-a6db-95f4295926c4 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:37.607768 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b828c70-449d-40cd-a6db-95f4295926c4 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:37.608399 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b828c70-449d-40cd-a6db-95f4295926c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:37.628768 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-9b828c70-449d-40cd-a6db-95f4295926c4 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:37.630469 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-9b828c70-449d-40cd-a6db-95f4295926c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:37.643699 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 362/720] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:37.668814 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32447690-25f2-40d2-b9bc-1c004a845ca2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:37.683567 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32447690-25f2-40d2-b9bc-1c004a845ca2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:37.688820 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c753b5-5331-4025-aaa2-837e02b96c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:37.689611 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c753b5-5331-4025-aaa2-837e02b96c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:37.689892 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c753b5-5331-4025-aaa2-837e02b96c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:37.690221 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c753b5-5331-4025-aaa2-837e02b96c69 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:37.707190 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c753b5-5331-4025-aaa2-837e02b96c69 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:37.714218 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-47c753b5-5331-4025-aaa2-837e02b96c69 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 08 16:29:37.715725 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 359/721] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:29:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:37.721594 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b828c70-449d-40cd-a6db-95f4295926c4 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:37.737683 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b828c70-449d-40cd-a6db-95f4295926c4 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:37.747949 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820f98b-24ce-45fb-b67f-38828df17f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:37.748614 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820f98b-24ce-45fb-b67f-38828df17f94 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:37.748892 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820f98b-24ce-45fb-b67f-38828df17f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:37.749698 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820f98b-24ce-45fb-b67f-38828df17f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:37.750577 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820f98b-24ce-45fb-b67f-38828df17f94 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:37.750880 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820f98b-24ce-45fb-b67f-38828df17f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:37.752496 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820f98b-24ce-45fb-b67f-38828df17f94 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:37.768392 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 363/722] 10.222.0.35 () {56 vars in 1124 bytes} [Tue Feb 8 16:29:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:37.773437 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c753b5-5331-4025-aaa2-837e02b96c69 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:37.787981 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c753b5-5331-4025-aaa2-837e02b96c69 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:37.797265 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22c8fe-3b02-48ff-a146-151c012da99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:37.798058 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22c8fe-3b02-48ff-a146-151c012da99a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:37.798317 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22c8fe-3b02-48ff-a146-151c012da99a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:37.798591 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22c8fe-3b02-48ff-a146-151c012da99a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:37.798761 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a96ce2-4919-4c5c-89b4-9efe2f1da6ce None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:37.799003 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a96ce2-4919-4c5c-89b4-9efe2f1da6ce None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:37.799377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a96ce2-4919-4c5c-89b4-9efe2f1da6ce None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:37.801535 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 364/723] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:29:37.808169 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac9da3-65d8-4526-b8e4-bf7592e1e282 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:37.808445 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac9da3-65d8-4526-b8e4-bf7592e1e282 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:37.808721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac9da3-65d8-4526-b8e4-bf7592e1e282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:37.829988 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22c8fe-3b02-48ff-a146-151c012da99a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:37.831971 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22c8fe-3b02-48ff-a146-151c012da99a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:37.846383 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-a8ac9da3-65d8-4526-b8e4-bf7592e1e282 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:37.847673 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a8ac9da3-65d8-4526-b8e4-bf7592e1e282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:37.855940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 365/724] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:37.860859 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-bc22c8fe-3b02-48ff-a146-151c012da99a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:37.862199 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 360/725] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:37.867685 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac9da3-65d8-4526-b8e4-bf7592e1e282 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:37.882316 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac9da3-65d8-4526-b8e4-bf7592e1e282 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:37.887290 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98199ea-d289-41a1-a660-cd114911976d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:37.888089 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98199ea-d289-41a1-a660-cd114911976d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:37.888859 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98199ea-d289-41a1-a660-cd114911976d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:37.889141 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98199ea-d289-41a1-a660-cd114911976d admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:37.890484 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98199ea-d289-41a1-a660-cd114911976d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:37.890788 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98199ea-d289-41a1-a660-cd114911976d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:37.892801 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98199ea-d289-41a1-a660-cd114911976d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:37.906254 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 366/726] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:37.911567 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22c8fe-3b02-48ff-a146-151c012da99a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:37.919488 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98199ea-d289-41a1-a660-cd114911976d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:37.932751 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22c8fe-3b02-48ff-a146-151c012da99a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:37.933818 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98199ea-d289-41a1-a660-cd114911976d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:37.942677 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c4f06-de27-4508-b929-26df1a978fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:37.943411 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2043a41-c568-4e60-b597-24a012cf78d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:37.944278 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2043a41-c568-4e60-b597-24a012cf78d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:37.944566 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2043a41-c568-4e60-b597-24a012cf78d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:37.944836 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2043a41-c568-4e60-b597-24a012cf78d5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:37.948547 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c4f06-de27-4508-b929-26df1a978fdd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:37.948838 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c4f06-de27-4508-b929-26df1a978fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:37.949095 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c4f06-de27-4508-b929-26df1a978fdd admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:37.958553 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2043a41-c568-4e60-b597-24a012cf78d5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:37.965657 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-c2043a41-c568-4e60-b597-24a012cf78d5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:29:37.967232 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 367/727] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:29:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:37.972353 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c4f06-de27-4508-b929-26df1a978fdd admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:37.974487 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c4f06-de27-4508-b929-26df1a978fdd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:37.975461 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2043a41-c568-4e60-b597-24a012cf78d5 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:37.987305 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2043a41-c568-4e60-b597-24a012cf78d5 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:37.996896 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8bd95-ebcd-4b03-829f-ccd0a16f5c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:37.997637 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8bd95-ebcd-4b03-829f-ccd0a16f5c65 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:37.999274 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8bd95-ebcd-4b03-829f-ccd0a16f5c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:37.999624 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8bd95-ebcd-4b03-829f-ccd0a16f5c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:38.001903 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8bd95-ebcd-4b03-829f-ccd0a16f5c65 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:38.002291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8bd95-ebcd-4b03-829f-ccd0a16f5c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:38.005799 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8bd95-ebcd-4b03-829f-ccd0a16f5c65 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:38.009862 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-ef7c4f06-de27-4508-b929-26df1a978fdd admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 08 16:29:38.012499 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 361/728] 10.222.0.35 () {56 vars in 1138 bytes} [Tue Feb 8 16:29:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:38.018727 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 368/729] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:38.020163 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c4f06-de27-4508-b929-26df1a978fdd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:38.029415 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8bd95-ebcd-4b03-829f-ccd0a16f5c65 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:38.038705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c4f06-de27-4508-b929-26df1a978fdd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:38.045333 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8bd95-ebcd-4b03-829f-ccd0a16f5c65 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:38.049410 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da048e4c-7d2d-4b51-8f09-48154abb5f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:38.050241 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da048e4c-7d2d-4b51-8f09-48154abb5f1e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:38.050668 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da048e4c-7d2d-4b51-8f09-48154abb5f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:38.051192 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da048e4c-7d2d-4b51-8f09-48154abb5f1e admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:38.052225 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da048e4c-7d2d-4b51-8f09-48154abb5f1e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:38.052697 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da048e4c-7d2d-4b51-8f09-48154abb5f1e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:38.055186 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da048e4c-7d2d-4b51-8f09-48154abb5f1e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:38.060428 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16372a-b9e3-4635-bae8-d9a943cb8be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:38.061365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16372a-b9e3-4635-bae8-d9a943cb8be0 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:38.061818 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16372a-b9e3-4635-bae8-d9a943cb8be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:38.062360 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16372a-b9e3-4635-bae8-d9a943cb8be0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:38.082132 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 362/730] 10.222.0.35 () {56 vars in 1170 bytes} [Tue Feb 8 16:29:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:38.083278 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16372a-b9e3-4635-bae8-d9a943cb8be0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:38.085200 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16372a-b9e3-4635-bae8-d9a943cb8be0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:38.090801 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da048e4c-7d2d-4b51-8f09-48154abb5f1e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:38.106629 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da048e4c-7d2d-4b51-8f09-48154abb5f1e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:38.111645 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-bc16372a-b9e3-4635-bae8-d9a943cb8be0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:38.113269 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 369/731] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:38.115280 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e645cff-bf14-48e7-adbb-eca6ce7b3b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:38.115941 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e645cff-bf14-48e7-adbb-eca6ce7b3b14 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:38.116222 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e645cff-bf14-48e7-adbb-eca6ce7b3b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:38.116497 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e645cff-bf14-48e7-adbb-eca6ce7b3b14 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:38.119271 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16372a-b9e3-4635-bae8-d9a943cb8be0 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:38.126061 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e645cff-bf14-48e7-adbb-eca6ce7b3b14 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:38.127935 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e645cff-bf14-48e7-adbb-eca6ce7b3b14 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:38.138432 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 363/732] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:29:38.139646 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16372a-b9e3-4635-bae8-d9a943cb8be0 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:38.144573 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e645cff-bf14-48e7-adbb-eca6ce7b3b14 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:38.154020 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e645cff-bf14-48e7-adbb-eca6ce7b3b14 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:38.159546 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4b473-a05a-4ddd-9b2a-a7c719163eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:38.160562 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4b473-a05a-4ddd-9b2a-a7c719163eba admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:38.160972 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4b473-a05a-4ddd-9b2a-a7c719163eba admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:38.161312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4b473-a05a-4ddd-9b2a-a7c719163eba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:38.161417 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c6a94-40d3-4a3e-8709-1d7e299361c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:38.162159 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c6a94-40d3-4a3e-8709-1d7e299361c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:38.162500 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c6a94-40d3-4a3e-8709-1d7e299361c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:38.162834 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c6a94-40d3-4a3e-8709-1d7e299361c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:38.163676 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c6a94-40d3-4a3e-8709-1d7e299361c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:38.164069 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c6a94-40d3-4a3e-8709-1d7e299361c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:38.165696 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c6a94-40d3-4a3e-8709-1d7e299361c7 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:38.172996 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4b473-a05a-4ddd-9b2a-a7c719163eba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:38.174963 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4b473-a05a-4ddd-9b2a-a7c719163eba admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:38.191028 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 370/733] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:38.192880 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-b3c4b473-a05a-4ddd-9b2a-a7c719163eba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:38.194357 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 364/734] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:38.196872 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c6a94-40d3-4a3e-8709-1d7e299361c7 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:38.199441 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4b473-a05a-4ddd-9b2a-a7c719163eba admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:38.210049 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4b473-a05a-4ddd-9b2a-a7c719163eba admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:38.216036 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c6a94-40d3-4a3e-8709-1d7e299361c7 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:38.218568 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc8b65-7f19-41ee-acaa-ec09515d5741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:38.219246 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc8b65-7f19-41ee-acaa-ec09515d5741 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:38.220240 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc8b65-7f19-41ee-acaa-ec09515d5741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:38.220522 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc8b65-7f19-41ee-acaa-ec09515d5741 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:38.222587 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc8b65-7f19-41ee-acaa-ec09515d5741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:38.223428 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc8b65-7f19-41ee-acaa-ec09515d5741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:38.226482 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc8b65-7f19-41ee-acaa-ec09515d5741 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:38.227233 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e137c-cbfa-4042-bec3-8dd2eb2b2d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:38.229271 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e137c-cbfa-4042-bec3-8dd2eb2b2d5e admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:38.229551 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e137c-cbfa-4042-bec3-8dd2eb2b2d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:38.229871 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e137c-cbfa-4042-bec3-8dd2eb2b2d5e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:38.247135 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e137c-cbfa-4042-bec3-8dd2eb2b2d5e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:38.250689 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 365/735] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:38.255991 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e137c-cbfa-4042-bec3-8dd2eb2b2d5e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:38.259662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc8b65-7f19-41ee-acaa-ec09515d5741 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:38.286889 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-c64e137c-cbfa-4042-bec3-8dd2eb2b2d5e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 08 16:29:38.288326 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 371/736] 10.222.0.35 () {56 vars in 1114 bytes} [Tue Feb 8 16:29:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:38.289473 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc8b65-7f19-41ee-acaa-ec09515d5741 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:38.297556 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e137c-cbfa-4042-bec3-8dd2eb2b2d5e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:38.298499 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b77fc4-4394-4fb9-a2ed-047c860e8e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:38.299713 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b77fc4-4394-4fb9-a2ed-047c860e8e4d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:38.300306 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b77fc4-4394-4fb9-a2ed-047c860e8e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:38.300774 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b77fc4-4394-4fb9-a2ed-047c860e8e4d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:38.319063 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b77fc4-4394-4fb9-a2ed-047c860e8e4d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:38.322967 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b77fc4-4394-4fb9-a2ed-047c860e8e4d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:38.330585 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e137c-cbfa-4042-bec3-8dd2eb2b2d5e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:38.338285 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0257a-c03b-40e3-ba6d-a2ef3afc013a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:38.339676 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0257a-c03b-40e3-ba6d-a2ef3afc013a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:38.340960 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0257a-c03b-40e3-ba6d-a2ef3afc013a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:38.342710 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0257a-c03b-40e3-ba6d-a2ef3afc013a admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:38.344888 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0257a-c03b-40e3-ba6d-a2ef3afc013a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:38.348124 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0257a-c03b-40e3-ba6d-a2ef3afc013a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:38.350903 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0257a-c03b-40e3-ba6d-a2ef3afc013a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:38.356005 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-15b77fc4-4394-4fb9-a2ed-047c860e8e4d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:38.363435 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 366/737] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:38.364635 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b77fc4-4394-4fb9-a2ed-047c860e8e4d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:38.376033 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b77fc4-4394-4fb9-a2ed-047c860e8e4d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:38.380890 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00083a45-3fd6-490c-8604-77693c9e8924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:38.381815 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00083a45-3fd6-490c-8604-77693c9e8924 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:38.382346 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00083a45-3fd6-490c-8604-77693c9e8924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:38.382819 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00083a45-3fd6-490c-8604-77693c9e8924 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:38.383845 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00083a45-3fd6-490c-8604-77693c9e8924 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:38.384401 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00083a45-3fd6-490c-8604-77693c9e8924 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:38.386504 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00083a45-3fd6-490c-8604-77693c9e8924 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:38.401571 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 372/738] 10.222.0.35 () {56 vars in 1154 bytes} [Tue Feb 8 16:29:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:38.405101 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 367/739] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:38.407589 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0257a-c03b-40e3-ba6d-a2ef3afc013a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:38.411233 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00083a45-3fd6-490c-8604-77693c9e8924 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:38.429513 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00083a45-3fd6-490c-8604-77693c9e8924 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:38.430558 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0257a-c03b-40e3-ba6d-a2ef3afc013a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:38.434851 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43ef72-0efc-4783-9e18-8365cd833324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:38.435723 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43ef72-0efc-4783-9e18-8365cd833324 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:38.436287 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43ef72-0efc-4783-9e18-8365cd833324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:38.437347 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43ef72-0efc-4783-9e18-8365cd833324 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:38.438840 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43ef72-0efc-4783-9e18-8365cd833324 admin admin] RBAC: Adding query filter params (role.id=54ef06f5478a48d08a2c08df2500fe6f, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=9761863f36284bd4be1ce29c86b631cc) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:38.439372 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43ef72-0efc-4783-9e18-8365cd833324 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:38.441756 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43ef72-0efc-4783-9e18-8365cd833324 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:38.449945 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83c7d7-2e85-49ea-baab-b8fe0b691bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:38.451641 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83c7d7-2e85-49ea-baab-b8fe0b691bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:38.453006 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 368/740] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:29:38 2022] GET /identity/v3/role_assignments?user.id=9761863f36284bd4be1ce29c86b631cc&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=54ef06f5478a48d08a2c08df2500fe6f => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:38.453864 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83c7d7-2e85-49ea-baab-b8fe0b691bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:38.454363 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83c7d7-2e85-49ea-baab-b8fe0b691bd3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:38.474821 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83c7d7-2e85-49ea-baab-b8fe0b691bd3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:38.477227 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83c7d7-2e85-49ea-baab-b8fe0b691bd3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:38.501720 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-de83c7d7-2e85-49ea-baab-b8fe0b691bd3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:38.507799 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 373/741] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:38.512903 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43ef72-0efc-4783-9e18-8365cd833324 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:38.524722 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43ef72-0efc-4783-9e18-8365cd833324 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:38.529576 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc57c3-3d8b-4d9d-8a4d-a7fa5add6240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:38.530513 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc57c3-3d8b-4d9d-8a4d-a7fa5add6240 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:38.531323 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc57c3-3d8b-4d9d-8a4d-a7fa5add6240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:38.531895 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc57c3-3d8b-4d9d-8a4d-a7fa5add6240 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:38.532889 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc57c3-3d8b-4d9d-8a4d-a7fa5add6240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:38.533391 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc57c3-3d8b-4d9d-8a4d-a7fa5add6240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:38.535297 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc57c3-3d8b-4d9d-8a4d-a7fa5add6240 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:38.560379 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 369/742] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:38.567227 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83c7d7-2e85-49ea-baab-b8fe0b691bd3 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:38.582487 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83c7d7-2e85-49ea-baab-b8fe0b691bd3 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:38.587387 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878572f-fb57-4d15-b1a3-440871c47c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:38.588467 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878572f-fb57-4d15-b1a3-440871c47c92 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:38.588947 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878572f-fb57-4d15-b1a3-440871c47c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:38.589412 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878572f-fb57-4d15-b1a3-440871c47c92 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:38.601750 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878572f-fb57-4d15-b1a3-440871c47c92 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:38.604253 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878572f-fb57-4d15-b1a3-440871c47c92 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:38.614672 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80c09f-7f02-46fe-9a1f-55d01aee4c9e None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:38.615589 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80c09f-7f02-46fe-9a1f-55d01aee4c9e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:38.616085 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80c09f-7f02-46fe-9a1f-55d01aee4c9e None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:38.618074 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 370/743] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:29:38.621245 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-5878572f-fb57-4d15-b1a3-440871c47c92 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:38.622743 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 374/744] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:38.623661 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcadf55-5083-425e-8081-93e312129587 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:38.624741 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcadf55-5083-425e-8081-93e312129587 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:38.625415 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcadf55-5083-425e-8081-93e312129587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:38.638904 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878572f-fb57-4d15-b1a3-440871c47c92 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:38.659188 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878572f-fb57-4d15-b1a3-440871c47c92 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:38.662378 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2bcadf55-5083-425e-8081-93e312129587 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:38.664827 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2bcadf55-5083-425e-8081-93e312129587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:38.667074 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c5c5c-dab5-4155-b12b-f08957ef5650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:38.668516 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c5c5c-dab5-4155-b12b-f08957ef5650 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:38.670438 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c5c5c-dab5-4155-b12b-f08957ef5650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:38.671390 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c5c5c-dab5-4155-b12b-f08957ef5650 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:38.673806 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c5c5c-dab5-4155-b12b-f08957ef5650 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:38.674774 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c5c5c-dab5-4155-b12b-f08957ef5650 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:38.680079 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c5c5c-dab5-4155-b12b-f08957ef5650 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:38.691148 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 371/745] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 08 16:29:38.699486 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 375/746] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:38.706051 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcadf55-5083-425e-8081-93e312129587 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:38.717132 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c5c5c-dab5-4155-b12b-f08957ef5650 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:38.718869 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcadf55-5083-425e-8081-93e312129587 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:38.729352 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77c20a-5841-4cfa-93d7-ddbdf4f483a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:38.730291 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77c20a-5841-4cfa-93d7-ddbdf4f483a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:38.730613 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77c20a-5841-4cfa-93d7-ddbdf4f483a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:38.730921 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77c20a-5841-4cfa-93d7-ddbdf4f483a6 admin admin] PATH_INFO: `/v3/projects/6b01069799b34858bbebc201a3f2046d/users/ccb02e5d8ef14f8f85bbacfa5b1f5be3/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:38.733722 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77c20a-5841-4cfa-93d7-ddbdf4f483a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b01069799b34858bbebc201a3f2046d, user_id=ccb02e5d8ef14f8f85bbacfa5b1f5be3, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:38.737101 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c5c5c-dab5-4155-b12b-f08957ef5650 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:38.738040 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77c20a-5841-4cfa-93d7-ddbdf4f483a6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:38.748611 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3be9c-6161-48c7-b280-81da0aea9778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:38.749767 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3be9c-6161-48c7-b280-81da0aea9778 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:38.750316 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3be9c-6161-48c7-b280-81da0aea9778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:38.750785 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3be9c-6161-48c7-b280-81da0aea9778 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:38.752833 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3be9c-6161-48c7-b280-81da0aea9778 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:38.759661 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 372/747] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:29:38 2022] PUT /identity/v3/projects/6b01069799b34858bbebc201a3f2046d/users/ccb02e5d8ef14f8f85bbacfa5b1f5be3/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:29:38.760428 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING py.warnings [None req-4da3be9c-6161-48c7-b280-81da0aea9778 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:29:38.760428 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: warnings.warn(msg) Feb 08 16:29:38.760428 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: Feb 08 16:29:38.761696 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3be9c-6161-48c7-b280-81da0aea9778 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:38.783167 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 376/748] 10.222.0.35 () {60 vars in 1162 bytes} [Tue Feb 8 16:29:38 2022] POST /identity/v3/services => generated 251 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:29:39.178633 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c359be-a0ed-4fa0-9b48-073f655545f8 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:39.179315 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c359be-a0ed-4fa0-9b48-073f655545f8 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:39.179881 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c359be-a0ed-4fa0-9b48-073f655545f8 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:39.182111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 373/749] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:39.188152 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611de031-3361-4819-9d09-acb40236c720 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:39.188688 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611de031-3361-4819-9d09-acb40236c720 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:39.189177 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611de031-3361-4819-9d09-acb40236c720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:39.208374 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-611de031-3361-4819-9d09-acb40236c720 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:39.209897 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-611de031-3361-4819-9d09-acb40236c720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:39.295396 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 377/750] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:39 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:29:39.325719 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c359be-a0ed-4fa0-9b48-073f655545f8 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:39.339697 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c359be-a0ed-4fa0-9b48-073f655545f8 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:39.345081 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409accab-bfc7-44ba-8cd9-c54c351cad4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:39.346011 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409accab-bfc7-44ba-8cd9-c54c351cad4a admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:39.346487 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409accab-bfc7-44ba-8cd9-c54c351cad4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:39.346985 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409accab-bfc7-44ba-8cd9-c54c351cad4a admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:39.348000 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409accab-bfc7-44ba-8cd9-c54c351cad4a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:39.349218 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-409accab-bfc7-44ba-8cd9-c54c351cad4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:29:39.349218 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Feb 08 16:29:39.349218 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: Feb 08 16:29:39.350413 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409accab-bfc7-44ba-8cd9-c54c351cad4a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:39.366765 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 374/751] 10.222.0.35 () {60 vars in 1162 bytes} [Tue Feb 8 16:29:39 2022] POST /identity/v3/services => generated 240 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:29:40.007522 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04c7f8-4bf3-4cdf-946b-6d745a23e9d9 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:40.008103 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04c7f8-4bf3-4cdf-946b-6d745a23e9d9 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:40.008362 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04c7f8-4bf3-4cdf-946b-6d745a23e9d9 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:40.010498 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 378/752] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:40.016504 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7c58b-a050-4651-84b8-7a0820c2c475 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:40.017176 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7c58b-a050-4651-84b8-7a0820c2c475 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:40.017391 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7c58b-a050-4651-84b8-7a0820c2c475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:40.043878 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e9f7c58b-a050-4651-84b8-7a0820c2c475 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:40.045082 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e9f7c58b-a050-4651-84b8-7a0820c2c475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:40.069183 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 375/753] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:40 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:29:40.113506 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04c7f8-4bf3-4cdf-946b-6d745a23e9d9 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:40.133421 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04c7f8-4bf3-4cdf-946b-6d745a23e9d9 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:40.138174 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2af943-15a7-4e18-8ef2-e2a4b5ec4b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:40.138978 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2af943-15a7-4e18-8ef2-e2a4b5ec4b24 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:40.139261 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2af943-15a7-4e18-8ef2-e2a4b5ec4b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:40.139671 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2af943-15a7-4e18-8ef2-e2a4b5ec4b24 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:40.158805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2af943-15a7-4e18-8ef2-e2a4b5ec4b24 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:40.166454 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-7b2af943-15a7-4e18-8ef2-e2a4b5ec4b24 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:29:40.172362 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 379/754] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:29:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:40.175032 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7c58b-a050-4651-84b8-7a0820c2c475 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:40.194319 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7c58b-a050-4651-84b8-7a0820c2c475 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:40.209275 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe509459-c626-42a8-9024-e91c7511f751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:40.209947 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe509459-c626-42a8-9024-e91c7511f751 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:40.210224 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe509459-c626-42a8-9024-e91c7511f751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:40.210494 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe509459-c626-42a8-9024-e91c7511f751 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:40.211257 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe509459-c626-42a8-9024-e91c7511f751 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:40.211556 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe509459-c626-42a8-9024-e91c7511f751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:40.213178 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe509459-c626-42a8-9024-e91c7511f751 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:40.230142 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 376/755] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:40.235976 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2af943-15a7-4e18-8ef2-e2a4b5ec4b24 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:40.253892 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2af943-15a7-4e18-8ef2-e2a4b5ec4b24 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:40.264508 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f668a-19e0-4257-b911-e19332ed7a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:40.265442 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f668a-19e0-4257-b911-e19332ed7a94 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:40.265725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f668a-19e0-4257-b911-e19332ed7a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:40.266002 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f668a-19e0-4257-b911-e19332ed7a94 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:40.283856 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f668a-19e0-4257-b911-e19332ed7a94 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:40.285704 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f668a-19e0-4257-b911-e19332ed7a94 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:40.323275 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-1d6f668a-19e0-4257-b911-e19332ed7a94 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:40.324817 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 380/756] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:40.330952 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe509459-c626-42a8-9024-e91c7511f751 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:40.354053 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe509459-c626-42a8-9024-e91c7511f751 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:40.369307 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974acc1-9de2-4d4c-80c7-0ed1838fa116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:40.369960 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974acc1-9de2-4d4c-80c7-0ed1838fa116 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:40.370232 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974acc1-9de2-4d4c-80c7-0ed1838fa116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:40.370500 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974acc1-9de2-4d4c-80c7-0ed1838fa116 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:40.371234 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974acc1-9de2-4d4c-80c7-0ed1838fa116 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:40.371533 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974acc1-9de2-4d4c-80c7-0ed1838fa116 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:40.373150 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974acc1-9de2-4d4c-80c7-0ed1838fa116 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:40.393555 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 377/757] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:40.399030 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f668a-19e0-4257-b911-e19332ed7a94 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:40.413102 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f668a-19e0-4257-b911-e19332ed7a94 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:40.429140 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dc048-1074-4189-87c0-c42713ce88d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:40.430339 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dc048-1074-4189-87c0-c42713ce88d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:40.430805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dc048-1074-4189-87c0-c42713ce88d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:40.431255 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dc048-1074-4189-87c0-c42713ce88d9 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:40.444953 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511dc048-1074-4189-87c0-c42713ce88d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:40.446991 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511dc048-1074-4189-87c0-c42713ce88d9 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:40.467254 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-511dc048-1074-4189-87c0-c42713ce88d9 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 08 16:29:40.469203 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 381/758] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:29:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:40.474946 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974acc1-9de2-4d4c-80c7-0ed1838fa116 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:40.488691 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974acc1-9de2-4d4c-80c7-0ed1838fa116 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:40.497250 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87737a9-e392-4c70-8325-d51f0f0a89db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:40.497911 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87737a9-e392-4c70-8325-d51f0f0a89db admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:40.498188 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87737a9-e392-4c70-8325-d51f0f0a89db admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:40.498461 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87737a9-e392-4c70-8325-d51f0f0a89db admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:40.499904 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87737a9-e392-4c70-8325-d51f0f0a89db admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:40.500299 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87737a9-e392-4c70-8325-d51f0f0a89db admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:40.502138 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87737a9-e392-4c70-8325-d51f0f0a89db admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:40.527022 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 378/759] 10.222.0.35 () {56 vars in 1156 bytes} [Tue Feb 8 16:29:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:40.532952 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dc048-1074-4189-87c0-c42713ce88d9 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:40.549148 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dc048-1074-4189-87c0-c42713ce88d9 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:40.558265 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3c7b4-1bbc-45a2-921a-11308778f13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:40.558892 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3c7b4-1bbc-45a2-921a-11308778f13c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:40.559166 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3c7b4-1bbc-45a2-921a-11308778f13c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:40.559432 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3c7b4-1bbc-45a2-921a-11308778f13c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:40.571305 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3c7b4-1bbc-45a2-921a-11308778f13c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:40.573095 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3c7b4-1bbc-45a2-921a-11308778f13c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:40.585483 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 382/760] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:40 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:29:40.591139 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87737a9-e392-4c70-8325-d51f0f0a89db admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:40.604690 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87737a9-e392-4c70-8325-d51f0f0a89db admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:40.613297 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e4fb6-93be-40e7-a446-1f51e66d6dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:40.614075 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e4fb6-93be-40e7-a446-1f51e66d6dcb admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:40.614349 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e4fb6-93be-40e7-a446-1f51e66d6dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:40.614616 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e4fb6-93be-40e7-a446-1f51e66d6dcb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:40.627544 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e4fb6-93be-40e7-a446-1f51e66d6dcb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:40.629394 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e4fb6-93be-40e7-a446-1f51e66d6dcb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:40.649882 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-b41e4fb6-93be-40e7-a446-1f51e66d6dcb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:40.651056 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 379/761] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:40.657383 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3c7b4-1bbc-45a2-921a-11308778f13c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:40.666235 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3c7b4-1bbc-45a2-921a-11308778f13c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:40.675443 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b8e8e-3ae6-43e7-80ff-873b8d0cf0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:40.676109 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b8e8e-3ae6-43e7-80ff-873b8d0cf0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:40.676385 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b8e8e-3ae6-43e7-80ff-873b8d0cf0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:40.676656 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b8e8e-3ae6-43e7-80ff-873b8d0cf0c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:40.677378 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b8e8e-3ae6-43e7-80ff-873b8d0cf0c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:40.677677 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b8e8e-3ae6-43e7-80ff-873b8d0cf0c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:40.679231 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b8e8e-3ae6-43e7-80ff-873b8d0cf0c0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:40.695186 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 383/762] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:40.700988 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e4fb6-93be-40e7-a446-1f51e66d6dcb admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:40.716808 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e4fb6-93be-40e7-a446-1f51e66d6dcb admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:40.725247 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df0350-8e65-4506-9c30-4e4e00ec6a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:40.726023 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df0350-8e65-4506-9c30-4e4e00ec6a6c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:40.726301 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df0350-8e65-4506-9c30-4e4e00ec6a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:40.726579 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df0350-8e65-4506-9c30-4e4e00ec6a6c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:40.737007 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df0350-8e65-4506-9c30-4e4e00ec6a6c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:40.738962 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df0350-8e65-4506-9c30-4e4e00ec6a6c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:40.755785 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-70df0350-8e65-4506-9c30-4e4e00ec6a6c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:40.756983 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 380/763] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:40.764009 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b8e8e-3ae6-43e7-80ff-873b8d0cf0c0 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:40.777332 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b8e8e-3ae6-43e7-80ff-873b8d0cf0c0 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:40.782810 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431cfa2-bba9-4e0e-b9e9-6b4bf8786f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:40.783513 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431cfa2-bba9-4e0e-b9e9-6b4bf8786f63 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:40.783822 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431cfa2-bba9-4e0e-b9e9-6b4bf8786f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:40.784145 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431cfa2-bba9-4e0e-b9e9-6b4bf8786f63 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:40.784948 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431cfa2-bba9-4e0e-b9e9-6b4bf8786f63 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:40.785257 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431cfa2-bba9-4e0e-b9e9-6b4bf8786f63 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:40.787130 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431cfa2-bba9-4e0e-b9e9-6b4bf8786f63 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:40.802989 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 384/764] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:40.808880 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df0350-8e65-4506-9c30-4e4e00ec6a6c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:40.824898 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df0350-8e65-4506-9c30-4e4e00ec6a6c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:40.831920 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2536e9b-6371-432d-bfc4-1ec327ef3ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:40.832554 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2536e9b-6371-432d-bfc4-1ec327ef3ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:40.832831 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2536e9b-6371-432d-bfc4-1ec327ef3ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:40.833100 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2536e9b-6371-432d-bfc4-1ec327ef3ab2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:40.833929 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2536e9b-6371-432d-bfc4-1ec327ef3ab2 admin admin] RBAC: Adding query filter params (role.id=e6d18df5c4e74dfd8ebd9c636f45936e, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=00fd3c05cd8e4167946a1f567df2cc6a) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:40.834230 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2536e9b-6371-432d-bfc4-1ec327ef3ab2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:40.836067 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2536e9b-6371-432d-bfc4-1ec327ef3ab2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:40.848199 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 381/765] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:29:40 2022] GET /identity/v3/role_assignments?user.id=00fd3c05cd8e4167946a1f567df2cc6a&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=e6d18df5c4e74dfd8ebd9c636f45936e => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:41.479011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b59706-098a-48a5-be61-7c57940335d3 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:41.479707 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b59706-098a-48a5-be61-7c57940335d3 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:41.479707 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b59706-098a-48a5-be61-7c57940335d3 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:41.481590 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 385/766] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:41.487026 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b842d-da1d-47c8-9eae-e9adf1bc8617 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:41.487573 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b842d-da1d-47c8-9eae-e9adf1bc8617 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:41.487573 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b842d-da1d-47c8-9eae-e9adf1bc8617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:41.506833 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-bb7b842d-da1d-47c8-9eae-e9adf1bc8617 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:41.508057 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-bb7b842d-da1d-47c8-9eae-e9adf1bc8617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:41.516629 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 382/767] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:41 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:29:41.533321 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d4fae-ad13-43c2-8d65-b119103dfe54 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:41.533652 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d4fae-ad13-43c2-8d65-b119103dfe54 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:41.533857 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d4fae-ad13-43c2-8d65-b119103dfe54 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:41.536009 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 386/768] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:41.541947 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2d6f5-d919-4a21-8707-0e3a2b7ed257 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:41.542237 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2d6f5-d919-4a21-8707-0e3a2b7ed257 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:41.542516 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2d6f5-d919-4a21-8707-0e3a2b7ed257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:41.563621 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-26a2d6f5-d919-4a21-8707-0e3a2b7ed257 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:41.564757 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-26a2d6f5-d919-4a21-8707-0e3a2b7ed257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:41.568139 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d4fae-ad13-43c2-8d65-b119103dfe54 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:41.573037 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 383/769] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:41 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:29:41.589836 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d4fae-ad13-43c2-8d65-b119103dfe54 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:41.598153 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c2f66-9564-449d-b9a4-7ab2dcdaef8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:41.598926 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c2f66-9564-449d-b9a4-7ab2dcdaef8c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:41.599209 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c2f66-9564-449d-b9a4-7ab2dcdaef8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:41.599483 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c2f66-9564-449d-b9a4-7ab2dcdaef8c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:41.620359 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c2f66-9564-449d-b9a4-7ab2dcdaef8c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:41.628083 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-921c2f66-9564-449d-b9a4-7ab2dcdaef8c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 08 16:29:41.629642 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 387/770] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:29:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:41.633551 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2d6f5-d919-4a21-8707-0e3a2b7ed257 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:41.635167 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c2f66-9564-449d-b9a4-7ab2dcdaef8c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:41.644293 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2d6f5-d919-4a21-8707-0e3a2b7ed257 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:41.653391 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e71479-c9f4-4ae6-8534-d9dc26e2f22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:41.654177 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e71479-c9f4-4ae6-8534-d9dc26e2f22e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:41.655060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c2f66-9564-449d-b9a4-7ab2dcdaef8c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:41.656609 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e71479-c9f4-4ae6-8534-d9dc26e2f22e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:41.656895 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e71479-c9f4-4ae6-8534-d9dc26e2f22e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:41.666304 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6fefb-23e3-4420-8d33-c13809c5431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:41.666954 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6fefb-23e3-4420-8d33-c13809c5431a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:41.668266 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6fefb-23e3-4420-8d33-c13809c5431a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:41.669657 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6fefb-23e3-4420-8d33-c13809c5431a admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:41.670483 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6fefb-23e3-4420-8d33-c13809c5431a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:41.670819 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6fefb-23e3-4420-8d33-c13809c5431a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:41.674462 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6fefb-23e3-4420-8d33-c13809c5431a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:41.677871 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e71479-c9f4-4ae6-8534-d9dc26e2f22e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:41.690377 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-e4e71479-c9f4-4ae6-8534-d9dc26e2f22e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:29:41.690377 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 384/771] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:29:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:41.692449 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 388/772] 10.222.0.35 () {56 vars in 1124 bytes} [Tue Feb 8 16:29:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:41.698097 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e71479-c9f4-4ae6-8534-d9dc26e2f22e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:41.698248 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6fefb-23e3-4420-8d33-c13809c5431a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:41.712063 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6fefb-23e3-4420-8d33-c13809c5431a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:41.716407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e71479-c9f4-4ae6-8534-d9dc26e2f22e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:41.724088 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4db38-2bd4-407a-bf10-8c0446d4ebf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:41.730577 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4db38-2bd4-407a-bf10-8c0446d4ebf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:41.730577 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4db38-2bd4-407a-bf10-8c0446d4ebf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:41.730577 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4db38-2bd4-407a-bf10-8c0446d4ebf6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:41.730886 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6db0f3-2e25-425d-946e-20dd4982d600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:41.730886 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6db0f3-2e25-425d-946e-20dd4982d600 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:41.730886 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6db0f3-2e25-425d-946e-20dd4982d600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:41.730886 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6db0f3-2e25-425d-946e-20dd4982d600 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:41.731193 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6db0f3-2e25-425d-946e-20dd4982d600 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:41.731193 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6db0f3-2e25-425d-946e-20dd4982d600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:41.731193 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6db0f3-2e25-425d-946e-20dd4982d600 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:41.740703 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4db38-2bd4-407a-bf10-8c0446d4ebf6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:41.741667 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 385/773] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:41.742635 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4db38-2bd4-407a-bf10-8c0446d4ebf6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:41.743439 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b4116-21ab-42bd-b08d-4cdd2332d103 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:41.743867 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b4116-21ab-42bd-b08d-4cdd2332d103 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:41.744244 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b4116-21ab-42bd-b08d-4cdd2332d103 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:41.746582 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 386/774] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:41.747296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b4116-21ab-42bd-b08d-4cdd2332d103 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:41.763575 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-95d4db38-2bd4-407a-bf10-8c0446d4ebf6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:41.765780 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 389/775] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:41.766456 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b4116-21ab-42bd-b08d-4cdd2332d103 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:41.767370 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf827eb-e134-4a37-8aa7-90739469253a None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:41.767789 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf827eb-e134-4a37-8aa7-90739469253a None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:41.768065 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf827eb-e134-4a37-8aa7-90739469253a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:41.771428 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06c83f-cf70-455e-b3ea-06755cb180f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:41.772234 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06c83f-cf70-455e-b3ea-06755cb180f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:41.772514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06c83f-cf70-455e-b3ea-06755cb180f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:41.772939 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06c83f-cf70-455e-b3ea-06755cb180f1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:41.786280 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06c83f-cf70-455e-b3ea-06755cb180f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:41.787038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-5cf827eb-e134-4a37-8aa7-90739469253a None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:41.788272 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06c83f-cf70-455e-b3ea-06755cb180f1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:41.788386 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5cf827eb-e134-4a37-8aa7-90739469253a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:41.796725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 390/776] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:41 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:29:41.797606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf827eb-e134-4a37-8aa7-90739469253a None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:41.810969 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf827eb-e134-4a37-8aa7-90739469253a None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:41.821626 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-1c06c83f-cf70-455e-b3ea-06755cb180f1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:41.824556 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 387/777] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:41.826273 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06c83f-cf70-455e-b3ea-06755cb180f1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:41.830341 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece39ea-2f79-4cb1-88ef-4af0af503b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:41.831053 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece39ea-2f79-4cb1-88ef-4af0af503b9b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:41.831334 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece39ea-2f79-4cb1-88ef-4af0af503b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:41.831658 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece39ea-2f79-4cb1-88ef-4af0af503b9b admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:41.832422 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece39ea-2f79-4cb1-88ef-4af0af503b9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:41.832754 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece39ea-2f79-4cb1-88ef-4af0af503b9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:41.834362 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece39ea-2f79-4cb1-88ef-4af0af503b9b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:41.846954 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06c83f-cf70-455e-b3ea-06755cb180f1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:41.851312 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 391/778] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:41.851692 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f7f99-713f-4cdc-b6b9-db152f8dbb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:41.852669 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f7f99-713f-4cdc-b6b9-db152f8dbb38 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:41.852778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece39ea-2f79-4cb1-88ef-4af0af503b9b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:41.852940 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f7f99-713f-4cdc-b6b9-db152f8dbb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:41.853218 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f7f99-713f-4cdc-b6b9-db152f8dbb38 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:41.853891 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f7f99-713f-4cdc-b6b9-db152f8dbb38 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:41.856026 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f7f99-713f-4cdc-b6b9-db152f8dbb38 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:41.864682 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece39ea-2f79-4cb1-88ef-4af0af503b9b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:41.868807 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-f16f7f99-713f-4cdc-b6b9-db152f8dbb38 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 08 16:29:41.869761 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b0d11-1b68-40f2-b74a-6fa286d58825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:41.875007 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 388/779] 10.222.0.35 () {56 vars in 1150 bytes} [Tue Feb 8 16:29:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:41.875007 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f7f99-713f-4cdc-b6b9-db152f8dbb38 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:41.875217 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b0d11-1b68-40f2-b74a-6fa286d58825 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:41.875217 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b0d11-1b68-40f2-b74a-6fa286d58825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:41.875217 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b0d11-1b68-40f2-b74a-6fa286d58825 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:41.875217 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b0d11-1b68-40f2-b74a-6fa286d58825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:41.875217 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b0d11-1b68-40f2-b74a-6fa286d58825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:41.879637 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b0d11-1b68-40f2-b74a-6fa286d58825 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:41.886744 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f7f99-713f-4cdc-b6b9-db152f8dbb38 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:41.893676 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d6fa8-bb9b-4ecd-8120-3142586bd727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:41.894471 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d6fa8-bb9b-4ecd-8120-3142586bd727 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:41.894753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d6fa8-bb9b-4ecd-8120-3142586bd727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:41.895026 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d6fa8-bb9b-4ecd-8120-3142586bd727 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:41.896501 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 392/780] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:41.897608 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b0d11-1b68-40f2-b74a-6fa286d58825 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:41.910267 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d6fa8-bb9b-4ecd-8120-3142586bd727 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:41.912144 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b0d11-1b68-40f2-b74a-6fa286d58825 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:41.912346 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d6fa8-bb9b-4ecd-8120-3142586bd727 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:41.918136 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050f474-204d-44c0-b0a0-98fe1e4da939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:41.919379 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050f474-204d-44c0-b0a0-98fe1e4da939 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:41.919920 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050f474-204d-44c0-b0a0-98fe1e4da939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:41.920427 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050f474-204d-44c0-b0a0-98fe1e4da939 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:41.922092 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050f474-204d-44c0-b0a0-98fe1e4da939 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:41.922668 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050f474-204d-44c0-b0a0-98fe1e4da939 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:41.924662 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050f474-204d-44c0-b0a0-98fe1e4da939 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:41.928263 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-169d6fa8-bb9b-4ecd-8120-3142586bd727 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 08 16:29:41.929844 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 389/781] 10.222.0.35 () {56 vars in 1138 bytes} [Tue Feb 8 16:29:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:41.934836 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 393/782] 10.222.0.35 () {56 vars in 1145 bytes} [Tue Feb 8 16:29:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:41.934979 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d6fa8-bb9b-4ecd-8120-3142586bd727 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:41.935999 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050f474-204d-44c0-b0a0-98fe1e4da939 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:41.946727 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d6fa8-bb9b-4ecd-8120-3142586bd727 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:41.949784 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050f474-204d-44c0-b0a0-98fe1e4da939 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:41.951433 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96965eeb-db0a-48c3-9864-bce52da068d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:41.952636 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96965eeb-db0a-48c3-9864-bce52da068d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:41.952983 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96965eeb-db0a-48c3-9864-bce52da068d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:41.953326 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96965eeb-db0a-48c3-9864-bce52da068d3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:41.957240 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cb312-3452-4e67-972d-a14adaea4514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:41.958101 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cb312-3452-4e67-972d-a14adaea4514 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:41.958555 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cb312-3452-4e67-972d-a14adaea4514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:41.958992 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cb312-3452-4e67-972d-a14adaea4514 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:41.960084 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08cb312-3452-4e67-972d-a14adaea4514 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:41.960569 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08cb312-3452-4e67-972d-a14adaea4514 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:41.962879 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08cb312-3452-4e67-972d-a14adaea4514 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:41.963601 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96965eeb-db0a-48c3-9864-bce52da068d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:41.966906 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96965eeb-db0a-48c3-9864-bce52da068d3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:41.984312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-96965eeb-db0a-48c3-9864-bce52da068d3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 08 16:29:41.985627 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 394/783] 10.222.0.35 () {56 vars in 1170 bytes} [Tue Feb 8 16:29:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:41.986654 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cb312-3452-4e67-972d-a14adaea4514 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:41.990078 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 390/784] 10.222.0.35 () {56 vars in 1114 bytes} [Tue Feb 8 16:29:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:41.990904 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96965eeb-db0a-48c3-9864-bce52da068d3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:41.997866 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cb312-3452-4e67-972d-a14adaea4514 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:42.002173 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96965eeb-db0a-48c3-9864-bce52da068d3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:42.004116 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e8ddf-6f1b-45d3-9c22-7f82aa52f32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:42.005232 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e8ddf-6f1b-45d3-9c22-7f82aa52f32a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.005820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e8ddf-6f1b-45d3-9c22-7f82aa52f32a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.006366 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e8ddf-6f1b-45d3-9c22-7f82aa52f32a admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.006988 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136e277-e0bc-448c-8ebb-117683e93b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:42.007431 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e8ddf-6f1b-45d3-9c22-7f82aa52f32a admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:42.007898 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e8ddf-6f1b-45d3-9c22-7f82aa52f32a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:42.008092 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136e277-e0bc-448c-8ebb-117683e93b8c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.008474 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136e277-e0bc-448c-8ebb-117683e93b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.008846 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136e277-e0bc-448c-8ebb-117683e93b8c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.010412 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e8ddf-6f1b-45d3-9c22-7f82aa52f32a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:42.016543 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 395/785] 10.222.0.35 () {56 vars in 1145 bytes} [Tue Feb 8 16:29:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:42.017752 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e8ddf-6f1b-45d3-9c22-7f82aa52f32a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:42.027666 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136e277-e0bc-448c-8ebb-117683e93b8c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:42.028660 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e8ddf-6f1b-45d3-9c22-7f82aa52f32a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:42.029836 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136e277-e0bc-448c-8ebb-117683e93b8c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:42.035079 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690caf18-6cba-49e0-b8d0-dab7558d099e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:42.035936 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690caf18-6cba-49e0-b8d0-dab7558d099e admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.036377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690caf18-6cba-49e0-b8d0-dab7558d099e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.036793 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690caf18-6cba-49e0-b8d0-dab7558d099e admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.037841 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690caf18-6cba-49e0-b8d0-dab7558d099e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:42.038732 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690caf18-6cba-49e0-b8d0-dab7558d099e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:42.041554 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690caf18-6cba-49e0-b8d0-dab7558d099e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:42.051338 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-4136e277-e0bc-448c-8ebb-117683e93b8c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:42.053446 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 391/786] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:42.054446 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136e277-e0bc-448c-8ebb-117683e93b8c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:42.062027 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 396/787] 10.222.0.35 () {56 vars in 1154 bytes} [Tue Feb 8 16:29:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:42.063075 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690caf18-6cba-49e0-b8d0-dab7558d099e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:42.069484 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136e277-e0bc-448c-8ebb-117683e93b8c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:42.074469 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690caf18-6cba-49e0-b8d0-dab7558d099e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:42.074946 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7ae2f-7eb7-4b2d-85ba-0f02b93cab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:42.075660 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7ae2f-7eb7-4b2d-85ba-0f02b93cab20 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.076113 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7ae2f-7eb7-4b2d-85ba-0f02b93cab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.076398 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7ae2f-7eb7-4b2d-85ba-0f02b93cab20 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.077394 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7ae2f-7eb7-4b2d-85ba-0f02b93cab20 admin admin] RBAC: Adding query filter params (interface=public, service_id=ce469e5384e74f2aa4dab648808faf1e, region_id=RegionOne) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:42.077771 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7ae2f-7eb7-4b2d-85ba-0f02b93cab20 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:42.078858 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-7cb7ae2f-7eb7-4b2d-85ba-0f02b93cab20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:29:42.078858 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Feb 08 16:29:42.078858 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: Feb 08 16:29:42.079888 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7ae2f-7eb7-4b2d-85ba-0f02b93cab20 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:42.081153 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e04594-ee36-4151-beea-bfd909d422f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:42.082230 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e04594-ee36-4151-beea-bfd909d422f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.082686 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e04594-ee36-4151-beea-bfd909d422f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.083185 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e04594-ee36-4151-beea-bfd909d422f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.084192 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e04594-ee36-4151-beea-bfd909d422f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:42.084671 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e04594-ee36-4151-beea-bfd909d422f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:42.087363 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e04594-ee36-4151-beea-bfd909d422f2 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:42.088251 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 392/788] 10.222.0.35 () {56 vars in 1272 bytes} [Tue Feb 8 16:29:42 2022] GET /identity/v3/endpoints?service_id=ce469e5384e74f2aa4dab648808faf1e&interface=public®ion_id=RegionOne => generated 194 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:42.093110 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7ae2f-7eb7-4b2d-85ba-0f02b93cab20 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:42.105596 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 397/789] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:42.106760 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e04594-ee36-4151-beea-bfd909d422f2 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:42.107002 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7ae2f-7eb7-4b2d-85ba-0f02b93cab20 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:42.112506 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a8516-8b76-4fbf-b378-e1f200a62b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:42.113215 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a8516-8b76-4fbf-b378-e1f200a62b3c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.113570 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a8516-8b76-4fbf-b378-e1f200a62b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.113919 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a8516-8b76-4fbf-b378-e1f200a62b3c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.120246 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e04594-ee36-4151-beea-bfd909d422f2 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:42.123456 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a8516-8b76-4fbf-b378-e1f200a62b3c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:42.125653 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a8516-8b76-4fbf-b378-e1f200a62b3c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:42.126795 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7289b4d-0213-42ef-877a-c76584b79a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:42.127678 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7289b4d-0213-42ef-877a-c76584b79a25 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.128152 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7289b4d-0213-42ef-877a-c76584b79a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.128595 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7289b4d-0213-42ef-877a-c76584b79a25 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.129587 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7289b4d-0213-42ef-877a-c76584b79a25 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:42.132334 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7289b4d-0213-42ef-877a-c76584b79a25 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:42.136321 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 393/790] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:42 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:29:42.138763 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 398/791] 10.222.0.35 () {56 vars in 1108 bytes} [Tue Feb 8 16:29:42 2022] GET /identity/v3/services => generated 772 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:42.144507 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a8516-8b76-4fbf-b378-e1f200a62b3c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:42.144696 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7289b4d-0213-42ef-877a-c76584b79a25 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:42.161749 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a8516-8b76-4fbf-b378-e1f200a62b3c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:42.164915 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7289b4d-0213-42ef-877a-c76584b79a25 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:42.173133 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae99a5-fae2-43ac-af7a-211300edfe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:42.173958 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae99a5-fae2-43ac-af7a-211300edfe5e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.174241 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae99a5-fae2-43ac-af7a-211300edfe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.174515 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae99a5-fae2-43ac-af7a-211300edfe5e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.175810 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707826a7-0c09-4449-a0ca-436c73025d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:42.176601 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707826a7-0c09-4449-a0ca-436c73025d78 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.176951 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707826a7-0c09-4449-a0ca-436c73025d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.177222 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707826a7-0c09-4449-a0ca-436c73025d78 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.195473 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae99a5-fae2-43ac-af7a-211300edfe5e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:42.197579 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae99a5-fae2-43ac-af7a-211300edfe5e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:42.202123 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707826a7-0c09-4449-a0ca-436c73025d78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:42.204403 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707826a7-0c09-4449-a0ca-436c73025d78 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:42.227322 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-ceae99a5-fae2-43ac-af7a-211300edfe5e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:42.228153 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-707826a7-0c09-4449-a0ca-436c73025d78 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:42.228796 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 394/792] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:42.233971 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 399/793] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:42.236882 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae99a5-fae2-43ac-af7a-211300edfe5e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:42.238214 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707826a7-0c09-4449-a0ca-436c73025d78 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:42.259088 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae99a5-fae2-43ac-af7a-211300edfe5e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:42.260865 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707826a7-0c09-4449-a0ca-436c73025d78 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:42.271798 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4f760-5e29-4645-adeb-db3909a3ab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:42.273017 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4f760-5e29-4645-adeb-db3909a3ab4c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.273522 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4f760-5e29-4645-adeb-db3909a3ab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.274048 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4f760-5e29-4645-adeb-db3909a3ab4c admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.275009 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4f760-5e29-4645-adeb-db3909a3ab4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:42.275555 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4f760-5e29-4645-adeb-db3909a3ab4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:42.277697 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4f760-5e29-4645-adeb-db3909a3ab4c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:42.284520 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f1b75-0b18-45d8-971b-02070b70194a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:42.285194 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f1b75-0b18-45d8-971b-02070b70194a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.285477 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f1b75-0b18-45d8-971b-02070b70194a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.285751 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f1b75-0b18-45d8-971b-02070b70194a admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.286562 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f1b75-0b18-45d8-971b-02070b70194a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:42.286875 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f1b75-0b18-45d8-971b-02070b70194a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:42.296190 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f1b75-0b18-45d8-971b-02070b70194a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:42.306947 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 400/794] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:42.314051 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4f760-5e29-4645-adeb-db3909a3ab4c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:42.319235 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 395/795] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:42.325490 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f1b75-0b18-45d8-971b-02070b70194a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:42.336945 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4f760-5e29-4645-adeb-db3909a3ab4c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:42.345943 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f1b75-0b18-45d8-971b-02070b70194a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:42.348350 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32652cc8-509c-4f33-912f-9dd0cbd320c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:42.349378 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32652cc8-509c-4f33-912f-9dd0cbd320c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.349940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32652cc8-509c-4f33-912f-9dd0cbd320c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.351141 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32652cc8-509c-4f33-912f-9dd0cbd320c3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.357983 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e70e2-60a8-42b1-8f3a-d2da168e68e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:42.359142 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e70e2-60a8-42b1-8f3a-d2da168e68e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.359527 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e70e2-60a8-42b1-8f3a-d2da168e68e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.359941 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e70e2-60a8-42b1-8f3a-d2da168e68e0 admin admin] PATH_INFO: `/v3/projects/6b01069799b34858bbebc201a3f2046d/users/9761863f36284bd4be1ce29c86b631cc/roles/54ef06f5478a48d08a2c08df2500fe6f` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.361515 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32652cc8-509c-4f33-912f-9dd0cbd320c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:42.363719 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32652cc8-509c-4f33-912f-9dd0cbd320c3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:42.377881 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e70e2-60a8-42b1-8f3a-d2da168e68e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b01069799b34858bbebc201a3f2046d, user_id=9761863f36284bd4be1ce29c86b631cc, role_id=54ef06f5478a48d08a2c08df2500fe6f)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:42.380753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e70e2-60a8-42b1-8f3a-d2da168e68e0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:42.383901 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-32652cc8-509c-4f33-912f-9dd0cbd320c3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:42.390925 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 401/796] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:42.392716 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32652cc8-509c-4f33-912f-9dd0cbd320c3 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:42.404436 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32652cc8-509c-4f33-912f-9dd0cbd320c3 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:42.407368 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 396/797] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:29:42 2022] PUT /identity/v3/projects/6b01069799b34858bbebc201a3f2046d/users/9761863f36284bd4be1ce29c86b631cc/roles/54ef06f5478a48d08a2c08df2500fe6f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:29:42.474210 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28046792-52a3-466b-919b-f39800d69522 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.474415 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc270f-ae01-4f31-ba5e-614468a164af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:42.474741 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28046792-52a3-466b-919b-f39800d69522 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.474929 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc270f-ae01-4f31-ba5e-614468a164af admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.475200 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28046792-52a3-466b-919b-f39800d69522 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.475287 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc270f-ae01-4f31-ba5e-614468a164af admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.475476 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc270f-ae01-4f31-ba5e-614468a164af admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.476336 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc270f-ae01-4f31-ba5e-614468a164af admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:42.476647 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc270f-ae01-4f31-ba5e-614468a164af admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:42.477791 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 397/798] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:42.478756 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc270f-ae01-4f31-ba5e-614468a164af admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:42.486570 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7ed1e-cebb-4bdb-b84e-a7c598a10b9c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.486993 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7ed1e-cebb-4bdb-b84e-a7c598a10b9c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.487359 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7ed1e-cebb-4bdb-b84e-a7c598a10b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.493235 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 402/799] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:42.500519 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc270f-ae01-4f31-ba5e-614468a164af admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:42.511105 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc270f-ae01-4f31-ba5e-614468a164af admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:42.523514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-8de7ed1e-cebb-4bdb-b84e-a7c598a10b9c None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:42.524407 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8ebb9-9f42-4e9f-8a9c-c8a33cc5b6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:42.526411 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8ebb9-9f42-4e9f-8a9c-c8a33cc5b6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.526767 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8ebb9-9f42-4e9f-8a9c-c8a33cc5b6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.527113 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8ebb9-9f42-4e9f-8a9c-c8a33cc5b6e6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.527513 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-8de7ed1e-cebb-4bdb-b84e-a7c598a10b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:42.528277 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8ebb9-9f42-4e9f-8a9c-c8a33cc5b6e6 admin admin] RBAC: Adding query filter params (role.id=e6d18df5c4e74dfd8ebd9c636f45936e, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=ccb02e5d8ef14f8f85bbacfa5b1f5be3) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:42.529650 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8ebb9-9f42-4e9f-8a9c-c8a33cc5b6e6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:42.533275 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8ebb9-9f42-4e9f-8a9c-c8a33cc5b6e6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:42.549310 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 398/800] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:42 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:29:42.552835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 403/801] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:29:42 2022] GET /identity/v3/role_assignments?user.id=ccb02e5d8ef14f8f85bbacfa5b1f5be3&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=e6d18df5c4e74dfd8ebd9c636f45936e => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:42.585624 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7ed1e-cebb-4bdb-b84e-a7c598a10b9c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:42.599799 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7ed1e-cebb-4bdb-b84e-a7c598a10b9c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:42.610576 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cea23-d5f4-409b-a191-7abf43b5245d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:42.611433 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cea23-d5f4-409b-a191-7abf43b5245d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.611718 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cea23-d5f4-409b-a191-7abf43b5245d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.612073 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cea23-d5f4-409b-a191-7abf43b5245d admin admin] PATH_INFO: `/v3/services/network` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.612784 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cea23-d5f4-409b-a191-7abf43b5245d admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:42.615375 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cea23-d5f4-409b-a191-7abf43b5245d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:42.628279 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-572cea23-d5f4-409b-a191-7abf43b5245d admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 08 16:29:42.630148 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 399/802] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:42 2022] GET /identity/v3/services/network => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:42.635285 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8ebb9-9f42-4e9f-8a9c-c8a33cc5b6e6 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:42.647542 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8ebb9-9f42-4e9f-8a9c-c8a33cc5b6e6 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:42.652610 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588dbed-c8a1-48e9-a112-aa5f80bf7680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:42.653406 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588dbed-c8a1-48e9-a112-aa5f80bf7680 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.653692 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588dbed-c8a1-48e9-a112-aa5f80bf7680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.653978 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588dbed-c8a1-48e9-a112-aa5f80bf7680 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.654768 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588dbed-c8a1-48e9-a112-aa5f80bf7680 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:42.655779 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588dbed-c8a1-48e9-a112-aa5f80bf7680 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:42.657543 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588dbed-c8a1-48e9-a112-aa5f80bf7680 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:42.662871 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 404/803] 10.222.0.35 () {56 vars in 1133 bytes} [Tue Feb 8 16:29:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:42.668619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cea23-d5f4-409b-a191-7abf43b5245d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:42.679317 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cea23-d5f4-409b-a191-7abf43b5245d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:42.684289 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d5e3a-e314-44ea-aa6a-a1701452c7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:42.684966 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d5e3a-e314-44ea-aa6a-a1701452c7ce admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.685245 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d5e3a-e314-44ea-aa6a-a1701452c7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.685520 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d5e3a-e314-44ea-aa6a-a1701452c7ce admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.686769 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d5e3a-e314-44ea-aa6a-a1701452c7ce admin admin] RBAC: Adding query filter params (type=network) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:42.687290 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d5e3a-e314-44ea-aa6a-a1701452c7ce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:42.688985 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d5e3a-e314-44ea-aa6a-a1701452c7ce admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:42.695091 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 400/804] 10.222.0.35 () {56 vars in 1133 bytes} [Tue Feb 8 16:29:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:42.700956 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588dbed-c8a1-48e9-a112-aa5f80bf7680 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:42.713202 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588dbed-c8a1-48e9-a112-aa5f80bf7680 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:42.719091 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc053df1-191c-48c2-a8c6-b3bd0e93a819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:42.719931 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc053df1-191c-48c2-a8c6-b3bd0e93a819 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.720282 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc053df1-191c-48c2-a8c6-b3bd0e93a819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.720627 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc053df1-191c-48c2-a8c6-b3bd0e93a819 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.721667 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc053df1-191c-48c2-a8c6-b3bd0e93a819 admin admin] RBAC: Adding query filter params (interface=public, service_id=f94c40adf35b46e59e37373b5a7b637c, region_id=RegionOne) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:42.722048 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc053df1-191c-48c2-a8c6-b3bd0e93a819 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:42.723178 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING py.warnings [None req-cc053df1-191c-48c2-a8c6-b3bd0e93a819 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:29:42.723178 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: warnings.warn(msg) Feb 08 16:29:42.723178 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: Feb 08 16:29:42.724269 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc053df1-191c-48c2-a8c6-b3bd0e93a819 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:42.734298 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 405/805] 10.222.0.35 () {56 vars in 1272 bytes} [Tue Feb 8 16:29:42 2022] GET /identity/v3/endpoints?service_id=f94c40adf35b46e59e37373b5a7b637c&interface=public®ion_id=RegionOne => generated 194 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:42.741014 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d5e3a-e314-44ea-aa6a-a1701452c7ce admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:42.755913 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d5e3a-e314-44ea-aa6a-a1701452c7ce admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:42.760892 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02b4fc-84aa-4a65-a081-a9edbf8aa4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:42.761789 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02b4fc-84aa-4a65-a081-a9edbf8aa4ef admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:42.762216 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02b4fc-84aa-4a65-a081-a9edbf8aa4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:42.762636 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02b4fc-84aa-4a65-a081-a9edbf8aa4ef admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:42.763474 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02b4fc-84aa-4a65-a081-a9edbf8aa4ef admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:42.766707 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02b4fc-84aa-4a65-a081-a9edbf8aa4ef admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:42.773362 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 401/806] 10.222.0.35 () {56 vars in 1108 bytes} [Tue Feb 8 16:29:42 2022] GET /identity/v3/services => generated 772 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:43.748590 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27036f2-93b4-4108-af08-6a1fb8a4d7ab None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:43.749939 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27036f2-93b4-4108-af08-6a1fb8a4d7ab None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:43.749939 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27036f2-93b4-4108-af08-6a1fb8a4d7ab None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:43.751614 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 406/807] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:43.757256 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979f7df-0c17-4e7f-b651-627d45cd6e85 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:43.757751 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979f7df-0c17-4e7f-b651-627d45cd6e85 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:43.757899 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979f7df-0c17-4e7f-b651-627d45cd6e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:43.781747 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-9979f7df-0c17-4e7f-b651-627d45cd6e85 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:43.783264 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9979f7df-0c17-4e7f-b651-627d45cd6e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:43.794018 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 402/808] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:43 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:29:43.817440 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27036f2-93b4-4108-af08-6a1fb8a4d7ab None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:43.837738 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27036f2-93b4-4108-af08-6a1fb8a4d7ab None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:43.845809 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4142a57-367e-4e6d-9f45-6052d4b4bccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:43.846599 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4142a57-367e-4e6d-9f45-6052d4b4bccd admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:43.846878 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4142a57-367e-4e6d-9f45-6052d4b4bccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:43.847148 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4142a57-367e-4e6d-9f45-6052d4b4bccd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:43.867589 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4142a57-367e-4e6d-9f45-6052d4b4bccd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:43.874607 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-e4142a57-367e-4e6d-9f45-6052d4b4bccd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:29:43.876180 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 407/809] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:29:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:43.882060 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979f7df-0c17-4e7f-b651-627d45cd6e85 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:43.896984 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979f7df-0c17-4e7f-b651-627d45cd6e85 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:43.903979 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11b932-1881-4a2c-8ccf-fe19da4f7847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:43.904873 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11b932-1881-4a2c-8ccf-fe19da4f7847 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:43.905909 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11b932-1881-4a2c-8ccf-fe19da4f7847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:43.906373 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11b932-1881-4a2c-8ccf-fe19da4f7847 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:43.907329 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11b932-1881-4a2c-8ccf-fe19da4f7847 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:43.907854 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11b932-1881-4a2c-8ccf-fe19da4f7847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:43.909631 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11b932-1881-4a2c-8ccf-fe19da4f7847 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:43.923634 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 403/810] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:43.928862 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4142a57-367e-4e6d-9f45-6052d4b4bccd admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:43.944095 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4142a57-367e-4e6d-9f45-6052d4b4bccd admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:43.953161 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3594f02-3dc5-44eb-a75b-76f7eb949c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:43.953975 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3594f02-3dc5-44eb-a75b-76f7eb949c60 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:43.954253 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3594f02-3dc5-44eb-a75b-76f7eb949c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:43.954524 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3594f02-3dc5-44eb-a75b-76f7eb949c60 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:43.970254 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3594f02-3dc5-44eb-a75b-76f7eb949c60 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:43.972144 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3594f02-3dc5-44eb-a75b-76f7eb949c60 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:43.998050 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-c3594f02-3dc5-44eb-a75b-76f7eb949c60 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:43.999680 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 408/811] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:44.005217 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11b932-1881-4a2c-8ccf-fe19da4f7847 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:44.021593 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11b932-1881-4a2c-8ccf-fe19da4f7847 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:44.037239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479089b-77b1-41ee-ae3d-4a3c7beb6316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:44.038203 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479089b-77b1-41ee-ae3d-4a3c7beb6316 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:44.038678 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479089b-77b1-41ee-ae3d-4a3c7beb6316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:44.039137 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479089b-77b1-41ee-ae3d-4a3c7beb6316 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:44.040101 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479089b-77b1-41ee-ae3d-4a3c7beb6316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:44.040597 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479089b-77b1-41ee-ae3d-4a3c7beb6316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:44.042360 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479089b-77b1-41ee-ae3d-4a3c7beb6316 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:44.058557 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 404/812] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:44.064180 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3594f02-3dc5-44eb-a75b-76f7eb949c60 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:44.076788 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3594f02-3dc5-44eb-a75b-76f7eb949c60 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:44.088195 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23a28b-6a18-4136-bf40-efe31db41256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:44.089019 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23a28b-6a18-4136-bf40-efe31db41256 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:44.089298 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23a28b-6a18-4136-bf40-efe31db41256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:44.089571 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23a28b-6a18-4136-bf40-efe31db41256 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:44.109592 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23a28b-6a18-4136-bf40-efe31db41256 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:44.111647 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23a28b-6a18-4136-bf40-efe31db41256 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:44.135319 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-de23a28b-6a18-4136-bf40-efe31db41256 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 08 16:29:44.136864 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 409/813] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:29:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:44.142854 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479089b-77b1-41ee-ae3d-4a3c7beb6316 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:44.157214 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479089b-77b1-41ee-ae3d-4a3c7beb6316 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:44.167787 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5135f9-637c-4c9f-a2c3-635e2ac4fa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:44.168697 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5135f9-637c-4c9f-a2c3-635e2ac4fa4c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:44.169188 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5135f9-637c-4c9f-a2c3-635e2ac4fa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:44.169650 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5135f9-637c-4c9f-a2c3-635e2ac4fa4c admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:44.171190 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5135f9-637c-4c9f-a2c3-635e2ac4fa4c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:44.171692 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5135f9-637c-4c9f-a2c3-635e2ac4fa4c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:44.173747 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5135f9-637c-4c9f-a2c3-635e2ac4fa4c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:44.199565 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 405/814] 10.222.0.35 () {56 vars in 1156 bytes} [Tue Feb 8 16:29:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:44.204885 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23a28b-6a18-4136-bf40-efe31db41256 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:44.221520 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23a28b-6a18-4136-bf40-efe31db41256 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:44.231939 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bc275-b572-4b8e-a9df-57c646f176c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:44.232719 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bc275-b572-4b8e-a9df-57c646f176c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:44.232993 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bc275-b572-4b8e-a9df-57c646f176c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:44.233871 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bc275-b572-4b8e-a9df-57c646f176c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:44.253955 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8bc275-b572-4b8e-a9df-57c646f176c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:44.255718 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8bc275-b572-4b8e-a9df-57c646f176c7 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:44.282261 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-0d8bc275-b572-4b8e-a9df-57c646f176c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:44.283779 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 410/815] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:44.289323 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5135f9-637c-4c9f-a2c3-635e2ac4fa4c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:44.304812 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5135f9-637c-4c9f-a2c3-635e2ac4fa4c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:44.313931 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236f4f5-ddb2-466a-a949-b1b00bfe0ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:44.314645 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236f4f5-ddb2-466a-a949-b1b00bfe0ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:44.314932 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236f4f5-ddb2-466a-a949-b1b00bfe0ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:44.315209 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236f4f5-ddb2-466a-a949-b1b00bfe0ad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:44.316050 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236f4f5-ddb2-466a-a949-b1b00bfe0ad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:44.316417 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236f4f5-ddb2-466a-a949-b1b00bfe0ad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:44.318019 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236f4f5-ddb2-466a-a949-b1b00bfe0ad0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:44.335256 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 406/816] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:44.340982 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bc275-b572-4b8e-a9df-57c646f176c7 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:44.357019 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bc275-b572-4b8e-a9df-57c646f176c7 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:44.367560 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477cf9f-e879-4b92-8be8-a297a8237bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:44.368365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477cf9f-e879-4b92-8be8-a297a8237bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:44.368643 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477cf9f-e879-4b92-8be8-a297a8237bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:44.368912 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477cf9f-e879-4b92-8be8-a297a8237bd2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:44.378741 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477cf9f-e879-4b92-8be8-a297a8237bd2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:44.380728 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477cf9f-e879-4b92-8be8-a297a8237bd2 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:44.397581 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-7477cf9f-e879-4b92-8be8-a297a8237bd2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:44.399038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 411/817] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:44.404720 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236f4f5-ddb2-466a-a949-b1b00bfe0ad0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:44.419668 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236f4f5-ddb2-466a-a949-b1b00bfe0ad0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:44.431441 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e9546-bf14-4ff1-9c86-d87f24da0f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:44.432182 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e9546-bf14-4ff1-9c86-d87f24da0f1b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:44.432471 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e9546-bf14-4ff1-9c86-d87f24da0f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:44.432802 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e9546-bf14-4ff1-9c86-d87f24da0f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:44.433629 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e9546-bf14-4ff1-9c86-d87f24da0f1b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:44.434123 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e9546-bf14-4ff1-9c86-d87f24da0f1b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:44.436774 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e9546-bf14-4ff1-9c86-d87f24da0f1b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:44.451987 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 407/818] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:44.458372 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477cf9f-e879-4b92-8be8-a297a8237bd2 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:44.472896 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477cf9f-e879-4b92-8be8-a297a8237bd2 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:44.485405 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de635c7e-27f5-4a73-b686-94f943758fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:44.486291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de635c7e-27f5-4a73-b686-94f943758fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:44.486571 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de635c7e-27f5-4a73-b686-94f943758fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:44.486842 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de635c7e-27f5-4a73-b686-94f943758fcd admin admin] PATH_INFO: `/v3/projects/6b01069799b34858bbebc201a3f2046d/users/00fd3c05cd8e4167946a1f567df2cc6a/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:44.493080 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de635c7e-27f5-4a73-b686-94f943758fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b01069799b34858bbebc201a3f2046d, user_id=00fd3c05cd8e4167946a1f567df2cc6a, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:44.495831 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de635c7e-27f5-4a73-b686-94f943758fcd admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:44.519444 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 412/819] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:29:44 2022] PUT /identity/v3/projects/6b01069799b34858bbebc201a3f2046d/users/00fd3c05cd8e4167946a1f567df2cc6a/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:29:44.879177 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60e1a2-f346-4151-bac5-ffd93c15a6eb None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:44.879177 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60e1a2-f346-4151-bac5-ffd93c15a6eb None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:44.879177 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60e1a2-f346-4151-bac5-ffd93c15a6eb None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:44.880571 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 408/820] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:44.886272 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a8b96-165e-4cae-bd79-b15c6a89e80b None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:44.887114 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a8b96-165e-4cae-bd79-b15c6a89e80b None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:44.887622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a8b96-165e-4cae-bd79-b15c6a89e80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:44.907808 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-5a7a8b96-165e-4cae-bd79-b15c6a89e80b None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:44.909346 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5a7a8b96-165e-4cae-bd79-b15c6a89e80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:44.988049 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 413/821] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:44 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:29:45.012061 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60e1a2-f346-4151-bac5-ffd93c15a6eb None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:45.025802 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60e1a2-f346-4151-bac5-ffd93c15a6eb None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:45.031711 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406806f3-816c-417d-b65d-d050f2886eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:45.032821 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406806f3-816c-417d-b65d-d050f2886eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.033339 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406806f3-816c-417d-b65d-d050f2886eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.033838 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406806f3-816c-417d-b65d-d050f2886eb9 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.034702 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406806f3-816c-417d-b65d-d050f2886eb9 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:45.036595 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406806f3-816c-417d-b65d-d050f2886eb9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:45.049581 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-406806f3-816c-417d-b65d-d050f2886eb9 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 08 16:29:45.051431 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 409/822] 10.222.0.35 () {56 vars in 1150 bytes} [Tue Feb 8 16:29:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:45.057607 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a8b96-165e-4cae-bd79-b15c6a89e80b None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:45.067320 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a8b96-165e-4cae-bd79-b15c6a89e80b None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:45.072233 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f773fd0-720e-4332-bb5e-3754c83bab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:45.073146 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f773fd0-720e-4332-bb5e-3754c83bab31 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.073657 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f773fd0-720e-4332-bb5e-3754c83bab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.074132 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f773fd0-720e-4332-bb5e-3754c83bab31 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.075085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f773fd0-720e-4332-bb5e-3754c83bab31 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:45.075592 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f773fd0-720e-4332-bb5e-3754c83bab31 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:45.077940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f773fd0-720e-4332-bb5e-3754c83bab31 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:45.083331 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 414/823] 10.222.0.35 () {56 vars in 1145 bytes} [Tue Feb 8 16:29:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:45.089105 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406806f3-816c-417d-b65d-d050f2886eb9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:45.100988 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406806f3-816c-417d-b65d-d050f2886eb9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:45.105930 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8912c4-5a36-4019-a8b6-eb42334903a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:45.106873 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8912c4-5a36-4019-a8b6-eb42334903a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.107404 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8912c4-5a36-4019-a8b6-eb42334903a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.107917 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8912c4-5a36-4019-a8b6-eb42334903a1 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.109849 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8912c4-5a36-4019-a8b6-eb42334903a1 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:45.110417 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8912c4-5a36-4019-a8b6-eb42334903a1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:45.112309 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8912c4-5a36-4019-a8b6-eb42334903a1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:45.118281 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 410/824] 10.222.0.35 () {56 vars in 1145 bytes} [Tue Feb 8 16:29:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:45.123929 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f773fd0-720e-4332-bb5e-3754c83bab31 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:45.138984 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f773fd0-720e-4332-bb5e-3754c83bab31 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:45.145949 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af515f8-2c12-4500-9ce7-709b96246756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:45.147040 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af515f8-2c12-4500-9ce7-709b96246756 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.147568 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af515f8-2c12-4500-9ce7-709b96246756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.148080 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af515f8-2c12-4500-9ce7-709b96246756 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.149122 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af515f8-2c12-4500-9ce7-709b96246756 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:45.150421 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING py.warnings [None req-5af515f8-2c12-4500-9ce7-709b96246756 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:29:45.150421 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: warnings.warn(msg) Feb 08 16:29:45.150421 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: Feb 08 16:29:45.151771 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af515f8-2c12-4500-9ce7-709b96246756 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:45.195026 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 415/825] 10.222.0.35 () {60 vars in 1165 bytes} [Tue Feb 8 16:29:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:29:45.292910 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e50fe-e7a0-4ece-8e23-e37323f77a91 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.293571 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e50fe-e7a0-4ece-8e23-e37323f77a91 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.294143 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e50fe-e7a0-4ece-8e23-e37323f77a91 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.297152 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 411/826] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:45.303085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b29703-cd86-4683-89e1-290a1a23a35d None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.303661 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b29703-cd86-4683-89e1-290a1a23a35d None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.304173 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b29703-cd86-4683-89e1-290a1a23a35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.329032 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-89b29703-cd86-4683-89e1-290a1a23a35d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:45.330616 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-89b29703-cd86-4683-89e1-290a1a23a35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:45.350194 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 416/827] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:45 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:29:45.392894 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e50fe-e7a0-4ece-8e23-e37323f77a91 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:45.411166 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e50fe-e7a0-4ece-8e23-e37323f77a91 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:45.416944 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7267e2d-a3f9-48bc-8255-f1ebcd9a3e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:45.418211 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7267e2d-a3f9-48bc-8255-f1ebcd9a3e9b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.418708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7267e2d-a3f9-48bc-8255-f1ebcd9a3e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.419183 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7267e2d-a3f9-48bc-8255-f1ebcd9a3e9b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.440398 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7267e2d-a3f9-48bc-8255-f1ebcd9a3e9b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:45.447812 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-d7267e2d-a3f9-48bc-8255-f1ebcd9a3e9b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 08 16:29:45.449568 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 412/828] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:29:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:45.455954 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b29703-cd86-4683-89e1-290a1a23a35d None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:45.469064 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ebf74-235b-4a3a-9e1f-72cb08206473 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.469594 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b29703-cd86-4683-89e1-290a1a23a35d None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:45.469905 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ebf74-235b-4a3a-9e1f-72cb08206473 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.470476 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ebf74-235b-4a3a-9e1f-72cb08206473 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.472875 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 413/829] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:45.478096 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2aa616-63fc-44b9-9939-30e20efc97b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:45.478758 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2aa616-63fc-44b9-9939-30e20efc97b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.479039 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2aa616-63fc-44b9-9939-30e20efc97b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.479314 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2aa616-63fc-44b9-9939-30e20efc97b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.479581 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f99f2-f154-499c-ad5e-1122bb437a89 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.480087 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f99f2-f154-499c-ad5e-1122bb437a89 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.480214 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2aa616-63fc-44b9-9939-30e20efc97b4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:45.480395 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2aa616-63fc-44b9-9939-30e20efc97b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:45.480975 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f99f2-f154-499c-ad5e-1122bb437a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.481976 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2aa616-63fc-44b9-9939-30e20efc97b4 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:45.494307 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 417/830] 10.222.0.35 () {56 vars in 1124 bytes} [Tue Feb 8 16:29:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:45.500786 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2aa616-63fc-44b9-9939-30e20efc97b4 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:45.507116 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-548f99f2-f154-499c-ad5e-1122bb437a89 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:45.508566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-548f99f2-f154-499c-ad5e-1122bb437a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:45.510827 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2aa616-63fc-44b9-9939-30e20efc97b4 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:45.516015 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7291c-03df-4554-80fb-4b94de9ebfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:45.516763 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7291c-03df-4554-80fb-4b94de9ebfda admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.517309 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7291c-03df-4554-80fb-4b94de9ebfda admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.517573 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7291c-03df-4554-80fb-4b94de9ebfda admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.519380 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 414/831] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:45 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:29:45.528129 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7291c-03df-4554-80fb-4b94de9ebfda admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:45.529988 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7291c-03df-4554-80fb-4b94de9ebfda admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:45.543552 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f99f2-f154-499c-ad5e-1122bb437a89 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:45.548366 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-b4c7291c-03df-4554-80fb-4b94de9ebfda admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:45.550147 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 418/832] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:45.555500 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7291c-03df-4554-80fb-4b94de9ebfda admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:45.557397 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f99f2-f154-499c-ad5e-1122bb437a89 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:45.563837 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95992df-78a3-44e2-955f-2fe5bac54a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:45.565004 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95992df-78a3-44e2-955f-2fe5bac54a4c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.565543 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95992df-78a3-44e2-955f-2fe5bac54a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.566090 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95992df-78a3-44e2-955f-2fe5bac54a4c admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.566588 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7291c-03df-4554-80fb-4b94de9ebfda admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:45.567317 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95992df-78a3-44e2-955f-2fe5bac54a4c admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:45.570172 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95992df-78a3-44e2-955f-2fe5bac54a4c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:45.572768 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e470a4-b08f-4f17-b191-6d5a1b13a8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:45.573330 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e470a4-b08f-4f17-b191-6d5a1b13a8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.573612 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e470a4-b08f-4f17-b191-6d5a1b13a8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.573886 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e470a4-b08f-4f17-b191-6d5a1b13a8a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.574889 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e470a4-b08f-4f17-b191-6d5a1b13a8a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:45.575009 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e470a4-b08f-4f17-b191-6d5a1b13a8a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:45.576637 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e470a4-b08f-4f17-b191-6d5a1b13a8a4 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:45.586110 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-b95992df-78a3-44e2-955f-2fe5bac54a4c admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 08 16:29:45.591947 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 419/833] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:45.592534 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 415/834] 10.222.0.35 () {56 vars in 1153 bytes} [Tue Feb 8 16:29:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:45.595599 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e470a4-b08f-4f17-b191-6d5a1b13a8a4 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:45.596819 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95992df-78a3-44e2-955f-2fe5bac54a4c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:45.609478 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e470a4-b08f-4f17-b191-6d5a1b13a8a4 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:45.610006 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95992df-78a3-44e2-955f-2fe5bac54a4c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:45.615025 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764fb0f-e14b-4479-a9b2-2ef7698e5c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:45.615461 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261bc67-a26d-4967-a292-03a2a42f9417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:45.615848 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764fb0f-e14b-4479-a9b2-2ef7698e5c41 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.616130 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764fb0f-e14b-4479-a9b2-2ef7698e5c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.616399 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764fb0f-e14b-4479-a9b2-2ef7698e5c41 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.617200 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261bc67-a26d-4967-a292-03a2a42f9417 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.617689 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261bc67-a26d-4967-a292-03a2a42f9417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.618202 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261bc67-a26d-4967-a292-03a2a42f9417 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.619380 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261bc67-a26d-4967-a292-03a2a42f9417 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:45.619929 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261bc67-a26d-4967-a292-03a2a42f9417 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:45.622357 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261bc67-a26d-4967-a292-03a2a42f9417 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:45.627980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764fb0f-e14b-4479-a9b2-2ef7698e5c41 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:45.629012 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 420/835] 10.222.0.35 () {56 vars in 1147 bytes} [Tue Feb 8 16:29:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:45.631887 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764fb0f-e14b-4479-a9b2-2ef7698e5c41 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:45.636035 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261bc67-a26d-4967-a292-03a2a42f9417 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:45.648643 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261bc67-a26d-4967-a292-03a2a42f9417 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:45.649877 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-5764fb0f-e14b-4479-a9b2-2ef7698e5c41 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 08 16:29:45.651932 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 416/836] 10.222.0.35 () {56 vars in 1138 bytes} [Tue Feb 8 16:29:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:45.657190 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48f7d0-9d49-49df-ac16-8da4b095cf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:45.657977 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48f7d0-9d49-49df-ac16-8da4b095cf29 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.658354 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48f7d0-9d49-49df-ac16-8da4b095cf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.658722 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48f7d0-9d49-49df-ac16-8da4b095cf29 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.659303 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764fb0f-e14b-4479-a9b2-2ef7698e5c41 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:45.659622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48f7d0-9d49-49df-ac16-8da4b095cf29 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:45.660049 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48f7d0-9d49-49df-ac16-8da4b095cf29 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:45.661855 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48f7d0-9d49-49df-ac16-8da4b095cf29 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:45.667784 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 421/837] 10.222.0.35 () {56 vars in 1147 bytes} [Tue Feb 8 16:29:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:45.675128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764fb0f-e14b-4479-a9b2-2ef7698e5c41 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:45.680417 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9f80c-3600-4155-addf-1868f6533534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:45.681397 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9f80c-3600-4155-addf-1868f6533534 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.681819 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9f80c-3600-4155-addf-1868f6533534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.682301 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9f80c-3600-4155-addf-1868f6533534 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.683307 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9f80c-3600-4155-addf-1868f6533534 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:45.683849 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9f80c-3600-4155-addf-1868f6533534 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:45.686011 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9f80c-3600-4155-addf-1868f6533534 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:45.709287 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 417/838] 10.222.0.35 () {56 vars in 1170 bytes} [Tue Feb 8 16:29:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:45.715190 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48f7d0-9d49-49df-ac16-8da4b095cf29 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:45.734747 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48f7d0-9d49-49df-ac16-8da4b095cf29 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:45.743897 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92323c4-e65b-4b6f-a2a7-a02b32719b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:45.744644 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92323c4-e65b-4b6f-a2a7-a02b32719b12 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.744989 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92323c4-e65b-4b6f-a2a7-a02b32719b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.745329 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92323c4-e65b-4b6f-a2a7-a02b32719b12 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.760042 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92323c4-e65b-4b6f-a2a7-a02b32719b12 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:45.761953 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92323c4-e65b-4b6f-a2a7-a02b32719b12 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:45.778188 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 422/839] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:45 2022] GET /identity/v3/auth/tokens => generated 1303 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:29:45.784770 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9f80c-3600-4155-addf-1868f6533534 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:45.801876 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9f80c-3600-4155-addf-1868f6533534 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:45.810555 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dba6eb-95c1-4efc-949d-59b4ed397a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:45.812521 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dba6eb-95c1-4efc-949d-59b4ed397a1d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.813024 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dba6eb-95c1-4efc-949d-59b4ed397a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.813514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dba6eb-95c1-4efc-949d-59b4ed397a1d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.830180 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dba6eb-95c1-4efc-949d-59b4ed397a1d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:45.832411 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dba6eb-95c1-4efc-949d-59b4ed397a1d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:45.853268 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-e0dba6eb-95c1-4efc-949d-59b4ed397a1d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:45.854793 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 418/840] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:45.860929 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92323c4-e65b-4b6f-a2a7-a02b32719b12 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:45.872057 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae26b0c-60ab-4b69-83b2-d471044f95a4 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.872383 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae26b0c-60ab-4b69-83b2-d471044f95a4 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.872615 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae26b0c-60ab-4b69-83b2-d471044f95a4 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.872982 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92323c4-e65b-4b6f-a2a7-a02b32719b12 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:45.875414 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 419/841] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:29:45.878245 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7e63e-adf5-499f-8e94-527de45e8ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:45.878908 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7e63e-adf5-499f-8e94-527de45e8ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.879186 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7e63e-adf5-499f-8e94-527de45e8ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.879592 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7e63e-adf5-499f-8e94-527de45e8ae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.880223 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7e63e-adf5-499f-8e94-527de45e8ae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:45.880523 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7e63e-adf5-499f-8e94-527de45e8ae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:45.880899 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d475b27-2dbb-47c0-a59c-2cf096121daa None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.881366 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d475b27-2dbb-47c0-a59c-2cf096121daa None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.881572 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d475b27-2dbb-47c0-a59c-2cf096121daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.882098 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7e63e-adf5-499f-8e94-527de45e8ae3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:45.896930 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 423/842] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:45.914000 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7e63e-adf5-499f-8e94-527de45e8ae3 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:45.916860 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-4d475b27-2dbb-47c0-a59c-2cf096121daa None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:45.918097 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4d475b27-2dbb-47c0-a59c-2cf096121daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:45.925095 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7e63e-adf5-499f-8e94-527de45e8ae3 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:45.930325 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ef9d7-6698-44a1-9fc4-b21e88dd3df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:45.931164 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ef9d7-6698-44a1-9fc4-b21e88dd3df2 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.931438 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ef9d7-6698-44a1-9fc4-b21e88dd3df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.931772 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ef9d7-6698-44a1-9fc4-b21e88dd3df2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.934331 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 420/843] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:45 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:29:45.940332 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ef9d7-6698-44a1-9fc4-b21e88dd3df2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:45.942341 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ef9d7-6698-44a1-9fc4-b21e88dd3df2 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:45.958363 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-4d9ef9d7-6698-44a1-9fc4-b21e88dd3df2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:45.959984 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 424/844] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:45.961311 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d475b27-2dbb-47c0-a59c-2cf096121daa None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:45.965421 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ef9d7-6698-44a1-9fc4-b21e88dd3df2 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:45.978104 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ef9d7-6698-44a1-9fc4-b21e88dd3df2 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:45.980984 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d475b27-2dbb-47c0-a59c-2cf096121daa None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:45.985164 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575684c3-5623-4bb8-a68d-306b58c0286a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:45.985164 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575684c3-5623-4bb8-a68d-306b58c0286a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.985164 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575684c3-5623-4bb8-a68d-306b58c0286a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.985164 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575684c3-5623-4bb8-a68d-306b58c0286a admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:45.985498 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575684c3-5623-4bb8-a68d-306b58c0286a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:45.985739 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575684c3-5623-4bb8-a68d-306b58c0286a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:45.987786 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575684c3-5623-4bb8-a68d-306b58c0286a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:45.998338 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece4a65-d2de-4a28-aadf-e24cba3a4e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:45.999173 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece4a65-d2de-4a28-aadf-e24cba3a4e83 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:45.999447 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece4a65-d2de-4a28-aadf-e24cba3a4e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:45.999719 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece4a65-d2de-4a28-aadf-e24cba3a4e83 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:46.000420 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece4a65-d2de-4a28-aadf-e24cba3a4e83 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:46.002021 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece4a65-d2de-4a28-aadf-e24cba3a4e83 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:46.006611 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 425/845] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:46.013386 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575684c3-5623-4bb8-a68d-306b58c0286a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:46.018631 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-0ece4a65-d2de-4a28-aadf-e24cba3a4e83 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 08 16:29:46.030837 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 421/846] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:45 2022] GET /identity/v3/services/network => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:46.032870 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece4a65-d2de-4a28-aadf-e24cba3a4e83 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:46.036026 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575684c3-5623-4bb8-a68d-306b58c0286a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:46.047305 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b116fbc-338b-4995-9b82-73e7909c5c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:46.047977 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b116fbc-338b-4995-9b82-73e7909c5c2c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:46.048258 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b116fbc-338b-4995-9b82-73e7909c5c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:46.048528 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b116fbc-338b-4995-9b82-73e7909c5c2c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:46.049372 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b116fbc-338b-4995-9b82-73e7909c5c2c admin admin] RBAC: Adding query filter params (role.id=54ef06f5478a48d08a2c08df2500fe6f, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=9761863f36284bd4be1ce29c86b631cc) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:46.049681 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b116fbc-338b-4995-9b82-73e7909c5c2c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:46.051517 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b116fbc-338b-4995-9b82-73e7909c5c2c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:46.055527 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece4a65-d2de-4a28-aadf-e24cba3a4e83 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:46.061999 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 426/847] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:29:46 2022] GET /identity/v3/role_assignments?user.id=9761863f36284bd4be1ce29c86b631cc&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=54ef06f5478a48d08a2c08df2500fe6f => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:46.064322 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa7325-cd70-4aec-823f-507f1cd76b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:46.064973 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa7325-cd70-4aec-823f-507f1cd76b94 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:46.065253 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa7325-cd70-4aec-823f-507f1cd76b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:46.065526 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa7325-cd70-4aec-823f-507f1cd76b94 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:46.066243 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa7325-cd70-4aec-823f-507f1cd76b94 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:46.066545 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa7325-cd70-4aec-823f-507f1cd76b94 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:46.068179 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa7325-cd70-4aec-823f-507f1cd76b94 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:46.073474 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 422/848] 10.222.0.35 () {56 vars in 1133 bytes} [Tue Feb 8 16:29:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:46.080124 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b116fbc-338b-4995-9b82-73e7909c5c2c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:46.090172 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b116fbc-338b-4995-9b82-73e7909c5c2c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:46.095823 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89314c63-2e41-41f2-b9ac-c9fb9ceae2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:46.096553 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89314c63-2e41-41f2-b9ac-c9fb9ceae2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:46.096834 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89314c63-2e41-41f2-b9ac-c9fb9ceae2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:46.097207 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89314c63-2e41-41f2-b9ac-c9fb9ceae2c4 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:46.097945 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89314c63-2e41-41f2-b9ac-c9fb9ceae2c4 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:46.098298 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89314c63-2e41-41f2-b9ac-c9fb9ceae2c4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:46.100015 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89314c63-2e41-41f2-b9ac-c9fb9ceae2c4 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:46.106317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 427/849] 10.222.0.35 () {56 vars in 1133 bytes} [Tue Feb 8 16:29:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:46.112971 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa7325-cd70-4aec-823f-507f1cd76b94 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:46.126635 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa7325-cd70-4aec-823f-507f1cd76b94 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:46.134617 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbd0b8-2e30-46f7-9081-0a8aa40f5914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:46.135283 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbd0b8-2e30-46f7-9081-0a8aa40f5914 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:46.135603 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbd0b8-2e30-46f7-9081-0a8aa40f5914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:46.135908 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbd0b8-2e30-46f7-9081-0a8aa40f5914 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:46.136743 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbd0b8-2e30-46f7-9081-0a8aa40f5914 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:46.137908 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-adfbd0b8-2e30-46f7-9081-0a8aa40f5914 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:29:46.137908 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Feb 08 16:29:46.137908 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: Feb 08 16:29:46.138865 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbd0b8-2e30-46f7-9081-0a8aa40f5914 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:46.188811 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 423/850] 10.222.0.35 () {60 vars in 1165 bytes} [Tue Feb 8 16:29:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:29:47.360731 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aeb20-a1ad-4550-a5d8-d6a0e22f7f42 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:47.361393 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aeb20-a1ad-4550-a5d8-d6a0e22f7f42 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:47.361393 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aeb20-a1ad-4550-a5d8-d6a0e22f7f42 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:47.363389 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 428/851] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:47.368978 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cce447-1989-4dd2-a51e-f7d139677be3 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:47.369468 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cce447-1989-4dd2-a51e-f7d139677be3 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:47.369630 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cce447-1989-4dd2-a51e-f7d139677be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:47.387797 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-98cce447-1989-4dd2-a51e-f7d139677be3 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:47.388995 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-98cce447-1989-4dd2-a51e-f7d139677be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:47.411642 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 424/852] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:47 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:29:47.435408 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54aeb20-a1ad-4550-a5d8-d6a0e22f7f42 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:47.448492 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54aeb20-a1ad-4550-a5d8-d6a0e22f7f42 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:47.454218 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7525c-cadf-4a2a-a775-76b13d18eda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:47.454997 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7525c-cadf-4a2a-a775-76b13d18eda5 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:47.455278 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7525c-cadf-4a2a-a775-76b13d18eda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:47.455552 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7525c-cadf-4a2a-a775-76b13d18eda5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:47.466612 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7525c-cadf-4a2a-a775-76b13d18eda5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:47.474299 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-4eb7525c-cadf-4a2a-a775-76b13d18eda5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:29:47.479861 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 429/853] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:29:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:47.481765 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cce447-1989-4dd2-a51e-f7d139677be3 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:47.490990 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cce447-1989-4dd2-a51e-f7d139677be3 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:47.495604 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c73a99-a49d-4615-984d-32ca58a4161f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:47.496303 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c73a99-a49d-4615-984d-32ca58a4161f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:47.496583 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c73a99-a49d-4615-984d-32ca58a4161f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:47.496856 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c73a99-a49d-4615-984d-32ca58a4161f admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:47.497619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c73a99-a49d-4615-984d-32ca58a4161f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:47.497922 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c73a99-a49d-4615-984d-32ca58a4161f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:47.500149 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c73a99-a49d-4615-984d-32ca58a4161f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:47.509916 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 425/854] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:29:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:47.516085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7525c-cadf-4a2a-a775-76b13d18eda5 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:47.527073 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7525c-cadf-4a2a-a775-76b13d18eda5 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:47.531821 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbc947-b2bb-4ddc-bca3-359e69565621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:47.532602 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbc947-b2bb-4ddc-bca3-359e69565621 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:47.532878 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbc947-b2bb-4ddc-bca3-359e69565621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:47.533149 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbc947-b2bb-4ddc-bca3-359e69565621 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:47.544187 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbc947-b2bb-4ddc-bca3-359e69565621 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:47.546721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbc947-b2bb-4ddc-bca3-359e69565621 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:47.565573 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-37cbc947-b2bb-4ddc-bca3-359e69565621 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:47.567008 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 430/855] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:47.572535 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c73a99-a49d-4615-984d-32ca58a4161f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:47.583159 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c73a99-a49d-4615-984d-32ca58a4161f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:47.587781 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1980e-5e72-41f2-9731-ca0fb5d844b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:47.588439 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1980e-5e72-41f2-9731-ca0fb5d844b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:47.588716 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1980e-5e72-41f2-9731-ca0fb5d844b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:47.588995 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1980e-5e72-41f2-9731-ca0fb5d844b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:47.589721 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1980e-5e72-41f2-9731-ca0fb5d844b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:47.590022 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1980e-5e72-41f2-9731-ca0fb5d844b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:47.591769 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1980e-5e72-41f2-9731-ca0fb5d844b0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:47.604967 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 426/856] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:47.610459 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbc947-b2bb-4ddc-bca3-359e69565621 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:47.620314 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbc947-b2bb-4ddc-bca3-359e69565621 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:47.624863 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce60939-e624-4b64-a869-a95ed6886dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:47.625635 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce60939-e624-4b64-a869-a95ed6886dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:47.625912 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce60939-e624-4b64-a869-a95ed6886dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:47.626185 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce60939-e624-4b64-a869-a95ed6886dd2 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:47.633824 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce60939-e624-4b64-a869-a95ed6886dd2 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:47.635828 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce60939-e624-4b64-a869-a95ed6886dd2 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:47.650690 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-5ce60939-e624-4b64-a869-a95ed6886dd2 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 08 16:29:47.652240 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 431/857] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:29:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:47.658742 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1980e-5e72-41f2-9731-ca0fb5d844b0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:47.669337 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1980e-5e72-41f2-9731-ca0fb5d844b0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:47.675214 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba7ca6-e3a6-443a-8302-a5fad414973b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:47.675928 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba7ca6-e3a6-443a-8302-a5fad414973b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:47.676210 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba7ca6-e3a6-443a-8302-a5fad414973b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:47.676482 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba7ca6-e3a6-443a-8302-a5fad414973b admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:47.677340 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba7ca6-e3a6-443a-8302-a5fad414973b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:47.677642 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba7ca6-e3a6-443a-8302-a5fad414973b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:47.679521 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba7ca6-e3a6-443a-8302-a5fad414973b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:47.699562 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 427/858] 10.222.0.35 () {56 vars in 1156 bytes} [Tue Feb 8 16:29:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:47.705679 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce60939-e624-4b64-a869-a95ed6886dd2 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:47.715471 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce60939-e624-4b64-a869-a95ed6886dd2 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:47.720670 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae2c90-5828-4079-8400-fae7e93db59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:47.721304 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae2c90-5828-4079-8400-fae7e93db59b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:47.721578 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae2c90-5828-4079-8400-fae7e93db59b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:47.721850 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae2c90-5828-4079-8400-fae7e93db59b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:47.729908 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae2c90-5828-4079-8400-fae7e93db59b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:47.731650 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae2c90-5828-4079-8400-fae7e93db59b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:47.741123 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 432/859] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:47 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:29:47.746762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba7ca6-e3a6-443a-8302-a5fad414973b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:47.756703 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba7ca6-e3a6-443a-8302-a5fad414973b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:47.761354 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a67bb-9e07-4bff-af0e-07313aab1a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:47.762127 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a67bb-9e07-4bff-af0e-07313aab1a0f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:47.762405 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a67bb-9e07-4bff-af0e-07313aab1a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:47.762679 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a67bb-9e07-4bff-af0e-07313aab1a0f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:47.774184 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a67bb-9e07-4bff-af0e-07313aab1a0f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:47.776063 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a67bb-9e07-4bff-af0e-07313aab1a0f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:47.793651 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-0c8a67bb-9e07-4bff-af0e-07313aab1a0f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:47.795146 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 428/860] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:47.800852 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae2c90-5828-4079-8400-fae7e93db59b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:47.809954 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae2c90-5828-4079-8400-fae7e93db59b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:47.814708 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ab1ea-033b-40d2-8500-1bca92b1e64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:47.815351 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ab1ea-033b-40d2-8500-1bca92b1e64f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:47.815684 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ab1ea-033b-40d2-8500-1bca92b1e64f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:47.815936 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ab1ea-033b-40d2-8500-1bca92b1e64f admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:47.816663 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ab1ea-033b-40d2-8500-1bca92b1e64f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:47.816964 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ab1ea-033b-40d2-8500-1bca92b1e64f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:47.818522 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ab1ea-033b-40d2-8500-1bca92b1e64f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:47.830923 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 433/861] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:47.836511 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a67bb-9e07-4bff-af0e-07313aab1a0f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:47.847124 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a67bb-9e07-4bff-af0e-07313aab1a0f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:47.853848 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4ec5b-e20d-4da4-ab25-9f7260eb1531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:47.853848 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4ec5b-e20d-4da4-ab25-9f7260eb1531 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:47.853848 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4ec5b-e20d-4da4-ab25-9f7260eb1531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:47.853848 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4ec5b-e20d-4da4-ab25-9f7260eb1531 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:47.862116 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4ec5b-e20d-4da4-ab25-9f7260eb1531 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:47.864708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4ec5b-e20d-4da4-ab25-9f7260eb1531 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:47.879551 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-86a4ec5b-e20d-4da4-ab25-9f7260eb1531 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:47.881605 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 429/862] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:47.890376 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ab1ea-033b-40d2-8500-1bca92b1e64f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:47.898488 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ab1ea-033b-40d2-8500-1bca92b1e64f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:47.903171 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827e30d-9df1-4900-9205-fbb9885426d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:47.903840 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827e30d-9df1-4900-9205-fbb9885426d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:47.904124 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827e30d-9df1-4900-9205-fbb9885426d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:47.904395 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827e30d-9df1-4900-9205-fbb9885426d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:47.905837 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827e30d-9df1-4900-9205-fbb9885426d2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:47.906144 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827e30d-9df1-4900-9205-fbb9885426d2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:47.908006 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827e30d-9df1-4900-9205-fbb9885426d2 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:47.921448 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 434/863] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:47.927342 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4ec5b-e20d-4da4-ab25-9f7260eb1531 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:47.942004 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4ec5b-e20d-4da4-ab25-9f7260eb1531 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:47.946482 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952956e9-5f23-40d6-b2c4-494a199392e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:47.947118 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952956e9-5f23-40d6-b2c4-494a199392e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:47.947395 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952956e9-5f23-40d6-b2c4-494a199392e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:47.947671 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952956e9-5f23-40d6-b2c4-494a199392e8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:47.948586 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952956e9-5f23-40d6-b2c4-494a199392e8 admin admin] RBAC: Adding query filter params (role.id=e6d18df5c4e74dfd8ebd9c636f45936e, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=00fd3c05cd8e4167946a1f567df2cc6a) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:47.948894 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952956e9-5f23-40d6-b2c4-494a199392e8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:47.950715 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952956e9-5f23-40d6-b2c4-494a199392e8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:47.957500 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 430/864] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:29:47 2022] GET /identity/v3/role_assignments?user.id=00fd3c05cd8e4167946a1f567df2cc6a&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=e6d18df5c4e74dfd8ebd9c636f45936e => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:47.966471 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b546d-071c-4878-8680-1ece017206f0 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:47.966775 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b546d-071c-4878-8680-1ece017206f0 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:47.967036 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b546d-071c-4878-8680-1ece017206f0 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:47.969850 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 435/865] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:47.975780 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88781bb4-f3ec-4854-8811-f78f76e09929 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:47.976101 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88781bb4-f3ec-4854-8811-f78f76e09929 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:47.976342 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88781bb4-f3ec-4854-8811-f78f76e09929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:47.996058 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-88781bb4-f3ec-4854-8811-f78f76e09929 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:47.997280 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-88781bb4-f3ec-4854-8811-f78f76e09929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:48.005904 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 431/866] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:47 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:29:48.029492 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b546d-071c-4878-8680-1ece017206f0 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:48.043515 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b546d-071c-4878-8680-1ece017206f0 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:48.049222 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b094fc-fcf0-4932-a2c7-b15dd2b1f1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:48.050078 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b094fc-fcf0-4932-a2c7-b15dd2b1f1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:48.050359 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b094fc-fcf0-4932-a2c7-b15dd2b1f1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:48.050635 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b094fc-fcf0-4932-a2c7-b15dd2b1f1e2 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:48.051367 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b094fc-fcf0-4932-a2c7-b15dd2b1f1e2 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:48.053134 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b094fc-fcf0-4932-a2c7-b15dd2b1f1e2 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:48.065822 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-a6b094fc-fcf0-4932-a2c7-b15dd2b1f1e2 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 08 16:29:48.071914 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 436/867] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:29:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:48.073515 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88781bb4-f3ec-4854-8811-f78f76e09929 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:48.083530 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88781bb4-f3ec-4854-8811-f78f76e09929 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:48.088281 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d57934-e60c-4e68-b3bc-eb44c4df5588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:48.088946 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d57934-e60c-4e68-b3bc-eb44c4df5588 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:48.089228 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d57934-e60c-4e68-b3bc-eb44c4df5588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:48.089505 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d57934-e60c-4e68-b3bc-eb44c4df5588 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:48.090236 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d57934-e60c-4e68-b3bc-eb44c4df5588 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:48.090540 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d57934-e60c-4e68-b3bc-eb44c4df5588 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:48.092202 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d57934-e60c-4e68-b3bc-eb44c4df5588 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:48.103137 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 432/868] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:29:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:48.104649 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b094fc-fcf0-4932-a2c7-b15dd2b1f1e2 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:48.116069 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b094fc-fcf0-4932-a2c7-b15dd2b1f1e2 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:48.120916 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff412521-3481-4251-b926-3c43f2d5e129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:48.121582 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff412521-3481-4251-b926-3c43f2d5e129 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:48.121865 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff412521-3481-4251-b926-3c43f2d5e129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:48.122139 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff412521-3481-4251-b926-3c43f2d5e129 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:48.122944 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff412521-3481-4251-b926-3c43f2d5e129 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:48.123250 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff412521-3481-4251-b926-3c43f2d5e129 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:48.125241 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff412521-3481-4251-b926-3c43f2d5e129 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:48.130685 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 437/869] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:29:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:48.162316 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa1a09-3455-44a9-b446-0e629987f074 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:48.162624 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa1a09-3455-44a9-b446-0e629987f074 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:48.162864 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa1a09-3455-44a9-b446-0e629987f074 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:48.165064 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 433/870] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:48.171496 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74c022-ff30-4631-9b7a-9a0efd56c749 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:48.171887 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74c022-ff30-4631-9b7a-9a0efd56c749 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:48.172097 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74c022-ff30-4631-9b7a-9a0efd56c749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:48.191235 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-0c74c022-ff30-4631-9b7a-9a0efd56c749 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:48.192519 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-0c74c022-ff30-4631-9b7a-9a0efd56c749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:48.202002 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 438/871] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:48 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:29:48.226984 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa1a09-3455-44a9-b446-0e629987f074 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:48.240862 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa1a09-3455-44a9-b446-0e629987f074 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:48.245696 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93200aea-afa7-483a-b026-bcec909badf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:48.246356 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93200aea-afa7-483a-b026-bcec909badf5 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:48.246687 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93200aea-afa7-483a-b026-bcec909badf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:48.246969 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93200aea-afa7-483a-b026-bcec909badf5 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:48.247732 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93200aea-afa7-483a-b026-bcec909badf5 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:48.250200 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93200aea-afa7-483a-b026-bcec909badf5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:48.276302 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 434/872] 10.222.0.35 () {60 vars in 1162 bytes} [Tue Feb 8 16:29:48 2022] POST /identity/v3/services => generated 269 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:29:48.682631 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71266ef4-25b6-4433-ba41-34ee0737b817 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:48.683377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71266ef4-25b6-4433-ba41-34ee0737b817 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:48.683377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71266ef4-25b6-4433-ba41-34ee0737b817 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:48.685199 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 439/873] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:48.691072 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10260519-2d9e-4499-8c04-30fc552a6636 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:48.691547 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10260519-2d9e-4499-8c04-30fc552a6636 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:48.691720 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10260519-2d9e-4499-8c04-30fc552a6636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:48.710180 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-10260519-2d9e-4499-8c04-30fc552a6636 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:48.711368 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-10260519-2d9e-4499-8c04-30fc552a6636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:48.727849 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 435/874] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:48 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:29:48.751917 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71266ef4-25b6-4433-ba41-34ee0737b817 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:48.765224 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71266ef4-25b6-4433-ba41-34ee0737b817 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:48.769999 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff98de-694b-42d4-8f7e-d76f1533ee9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:48.770782 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff98de-694b-42d4-8f7e-d76f1533ee9c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:48.771059 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff98de-694b-42d4-8f7e-d76f1533ee9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:48.771329 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff98de-694b-42d4-8f7e-d76f1533ee9c admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:48.781999 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff98de-694b-42d4-8f7e-d76f1533ee9c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:48.789163 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-d5ff98de-694b-42d4-8f7e-d76f1533ee9c admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 08 16:29:48.790598 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 440/875] 10.222.0.35 () {56 vars in 1141 bytes} [Tue Feb 8 16:29:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:48.797041 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10260519-2d9e-4499-8c04-30fc552a6636 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:48.806245 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10260519-2d9e-4499-8c04-30fc552a6636 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:48.810840 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729dd05c-8f1e-4f2f-be6c-23d1145507ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:48.812134 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dd05c-8f1e-4f2f-be6c-23d1145507ab admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:48.812404 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dd05c-8f1e-4f2f-be6c-23d1145507ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:48.812671 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dd05c-8f1e-4f2f-be6c-23d1145507ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:48.813425 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729dd05c-8f1e-4f2f-be6c-23d1145507ab admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:48.813722 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729dd05c-8f1e-4f2f-be6c-23d1145507ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:48.815322 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729dd05c-8f1e-4f2f-be6c-23d1145507ab admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:48.824233 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 436/876] 10.222.0.35 () {56 vars in 1136 bytes} [Tue Feb 8 16:29:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:48.830469 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff98de-694b-42d4-8f7e-d76f1533ee9c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:48.840271 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff98de-694b-42d4-8f7e-d76f1533ee9c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:48.844948 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a19c2f-7fa9-4807-8286-340c285282a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:48.845772 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a19c2f-7fa9-4807-8286-340c285282a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:48.846050 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a19c2f-7fa9-4807-8286-340c285282a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:48.846321 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a19c2f-7fa9-4807-8286-340c285282a1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:48.857175 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a19c2f-7fa9-4807-8286-340c285282a1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:48.859097 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a19c2f-7fa9-4807-8286-340c285282a1 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:48.876136 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-72a19c2f-7fa9-4807-8286-340c285282a1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:48.877616 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 441/877] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:48.883126 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729dd05c-8f1e-4f2f-be6c-23d1145507ab admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:48.893950 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729dd05c-8f1e-4f2f-be6c-23d1145507ab admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:48.898558 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08240b0-2f27-48cd-bfdf-f237f3094727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:48.899195 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08240b0-2f27-48cd-bfdf-f237f3094727 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:48.899518 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08240b0-2f27-48cd-bfdf-f237f3094727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:48.899824 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08240b0-2f27-48cd-bfdf-f237f3094727 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:48.900714 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08240b0-2f27-48cd-bfdf-f237f3094727 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:48.901022 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08240b0-2f27-48cd-bfdf-f237f3094727 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:48.902683 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08240b0-2f27-48cd-bfdf-f237f3094727 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:48.917708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 437/878] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:48.923150 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a19c2f-7fa9-4807-8286-340c285282a1 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:48.933009 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a19c2f-7fa9-4807-8286-340c285282a1 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:48.938139 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2178b-da79-4ca3-80c8-ab1173c70d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:48.938930 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2178b-da79-4ca3-80c8-ab1173c70d93 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:48.939204 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2178b-da79-4ca3-80c8-ab1173c70d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:48.939472 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2178b-da79-4ca3-80c8-ab1173c70d93 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:48.947654 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2178b-da79-4ca3-80c8-ab1173c70d93 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:48.949764 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2178b-da79-4ca3-80c8-ab1173c70d93 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:48.964272 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-29e2178b-da79-4ca3-80c8-ab1173c70d93 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 08 16:29:48.965751 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 442/879] 10.222.0.35 () {56 vars in 1138 bytes} [Tue Feb 8 16:29:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:48.971938 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08240b0-2f27-48cd-bfdf-f237f3094727 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:48.981662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08240b0-2f27-48cd-bfdf-f237f3094727 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:48.987257 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e55447-7aa7-4d93-8e88-d0288405ed9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:48.987955 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e55447-7aa7-4d93-8e88-d0288405ed9f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:48.988288 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e55447-7aa7-4d93-8e88-d0288405ed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:48.988561 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e55447-7aa7-4d93-8e88-d0288405ed9f admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:48.989463 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e55447-7aa7-4d93-8e88-d0288405ed9f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:48.989766 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e55447-7aa7-4d93-8e88-d0288405ed9f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:48.991718 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e55447-7aa7-4d93-8e88-d0288405ed9f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:49.011697 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 438/880] 10.222.0.35 () {56 vars in 1170 bytes} [Tue Feb 8 16:29:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:49.018162 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2178b-da79-4ca3-80c8-ab1173c70d93 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:49.027948 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2178b-da79-4ca3-80c8-ab1173c70d93 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:49.033118 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46709a-50a0-4d66-bf51-e5fa82289248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:49.033788 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46709a-50a0-4d66-bf51-e5fa82289248 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:49.034063 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46709a-50a0-4d66-bf51-e5fa82289248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:49.034386 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46709a-50a0-4d66-bf51-e5fa82289248 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:49.042515 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46709a-50a0-4d66-bf51-e5fa82289248 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:49.044324 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46709a-50a0-4d66-bf51-e5fa82289248 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:49.053884 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 443/881] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:49 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:29:49.059341 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e55447-7aa7-4d93-8e88-d0288405ed9f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:49.069315 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e55447-7aa7-4d93-8e88-d0288405ed9f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:49.073973 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e82b7-260d-49fd-9fd6-6a4cdf5acbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:49.074802 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e82b7-260d-49fd-9fd6-6a4cdf5acbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:49.075075 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e82b7-260d-49fd-9fd6-6a4cdf5acbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:49.075393 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e82b7-260d-49fd-9fd6-6a4cdf5acbe6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:49.086619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e82b7-260d-49fd-9fd6-6a4cdf5acbe6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:49.088535 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e82b7-260d-49fd-9fd6-6a4cdf5acbe6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:49.223081 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-b51e82b7-260d-49fd-9fd6-6a4cdf5acbe6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:49.224514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 439/882] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:49.229947 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46709a-50a0-4d66-bf51-e5fa82289248 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:49.239015 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46709a-50a0-4d66-bf51-e5fa82289248 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:49.243497 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66d450-353e-414b-a819-76d5b45d9aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:49.244175 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66d450-353e-414b-a819-76d5b45d9aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:49.244450 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66d450-353e-414b-a819-76d5b45d9aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:49.244720 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66d450-353e-414b-a819-76d5b45d9aa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:49.245440 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66d450-353e-414b-a819-76d5b45d9aa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:49.245739 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66d450-353e-414b-a819-76d5b45d9aa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:49.247309 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66d450-353e-414b-a819-76d5b45d9aa5 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:49.261963 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 444/883] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:49.268859 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e82b7-260d-49fd-9fd6-6a4cdf5acbe6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:49.278588 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e82b7-260d-49fd-9fd6-6a4cdf5acbe6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:49.283963 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2d2e7-380e-46e5-907f-3287da35e8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:49.284736 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2d2e7-380e-46e5-907f-3287da35e8da admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:49.285013 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2d2e7-380e-46e5-907f-3287da35e8da admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:49.285280 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2d2e7-380e-46e5-907f-3287da35e8da admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:49.292433 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2d2e7-380e-46e5-907f-3287da35e8da admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:49.294375 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2d2e7-380e-46e5-907f-3287da35e8da admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:49.308939 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-7fd2d2e7-380e-46e5-907f-3287da35e8da admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:49.310440 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 440/884] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:49.316882 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66d450-353e-414b-a819-76d5b45d9aa5 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:49.326536 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66d450-353e-414b-a819-76d5b45d9aa5 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:49.331534 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43059446-707c-4103-b813-309d09f6aed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:49.332207 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43059446-707c-4103-b813-309d09f6aed9 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:49.332485 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43059446-707c-4103-b813-309d09f6aed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:49.332753 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43059446-707c-4103-b813-309d09f6aed9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:49.333539 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43059446-707c-4103-b813-309d09f6aed9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:49.333889 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43059446-707c-4103-b813-309d09f6aed9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:49.335788 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43059446-707c-4103-b813-309d09f6aed9 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:49.348968 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 445/885] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:49.355036 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2d2e7-380e-46e5-907f-3287da35e8da admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:49.365488 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2d2e7-380e-46e5-907f-3287da35e8da admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:49.370179 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6fa4a-b752-4f43-b1e7-a1ff9d9deba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:49.370869 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6fa4a-b752-4f43-b1e7-a1ff9d9deba8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:49.371144 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6fa4a-b752-4f43-b1e7-a1ff9d9deba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:49.371407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6fa4a-b752-4f43-b1e7-a1ff9d9deba8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:49.372328 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6fa4a-b752-4f43-b1e7-a1ff9d9deba8 admin admin] RBAC: Adding query filter params (role.id=347979f7c2ac478c96b4781b6eea1a29, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=9761863f36284bd4be1ce29c86b631cc) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:49.372630 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6fa4a-b752-4f43-b1e7-a1ff9d9deba8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:49.375093 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6fa4a-b752-4f43-b1e7-a1ff9d9deba8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:49.381491 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 441/886] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:29:49 2022] GET /identity/v3/role_assignments?user.id=9761863f36284bd4be1ce29c86b631cc&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=347979f7c2ac478c96b4781b6eea1a29 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:50.403546 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a06f1-290f-465d-8252-01127d5f287d None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:50.404109 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a06f1-290f-465d-8252-01127d5f287d None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:50.404109 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a06f1-290f-465d-8252-01127d5f287d None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:50.406334 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 446/887] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:50.411916 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e9a75-867a-4d59-8780-60be69896b9d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:50.412357 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e9a75-867a-4d59-8780-60be69896b9d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:50.412450 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e9a75-867a-4d59-8780-60be69896b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:50.431288 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-621e9a75-867a-4d59-8780-60be69896b9d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:50.432533 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-621e9a75-867a-4d59-8780-60be69896b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:50.440984 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 442/888] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:50 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:29:50.464605 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a06f1-290f-465d-8252-01127d5f287d None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:50.477671 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a06f1-290f-465d-8252-01127d5f287d None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:50.482083 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66d529-07d4-4802-b69c-7767fffed997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:50.482997 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66d529-07d4-4802-b69c-7767fffed997 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:50.483433 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66d529-07d4-4802-b69c-7767fffed997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:50.483764 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66d529-07d4-4802-b69c-7767fffed997 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:50.484438 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66d529-07d4-4802-b69c-7767fffed997 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:50.486025 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66d529-07d4-4802-b69c-7767fffed997 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:50.498210 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-8f66d529-07d4-4802-b69c-7767fffed997 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 08 16:29:50.500338 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 447/889] 10.222.0.35 () {56 vars in 1147 bytes} [Tue Feb 8 16:29:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:50.504638 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674c280-f077-423d-9e56-9875a4437cf0 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:50.505634 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674c280-f077-423d-9e56-9875a4437cf0 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:50.506124 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674c280-f077-423d-9e56-9875a4437cf0 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:50.506353 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66d529-07d4-4802-b69c-7767fffed997 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:50.510000 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 443/890] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:50.515608 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b8d3c-51e3-4046-ace9-025c7e370b9f None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:50.516256 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b8d3c-51e3-4046-ace9-025c7e370b9f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:50.516735 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b8d3c-51e3-4046-ace9-025c7e370b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:50.517722 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66d529-07d4-4802-b69c-7767fffed997 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:50.522363 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6fdc2-41c9-41f1-93bf-25011adef639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:50.522988 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6fdc2-41c9-41f1-93bf-25011adef639 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:50.523264 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6fdc2-41c9-41f1-93bf-25011adef639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:50.523536 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6fdc2-41c9-41f1-93bf-25011adef639 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:50.524288 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6fdc2-41c9-41f1-93bf-25011adef639 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:50.524590 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6fdc2-41c9-41f1-93bf-25011adef639 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:50.527357 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6fdc2-41c9-41f1-93bf-25011adef639 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:50.533237 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 448/891] 10.222.0.35 () {56 vars in 1143 bytes} [Tue Feb 8 16:29:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:50.538652 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6fdc2-41c9-41f1-93bf-25011adef639 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:50.540358 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e19b8d3c-51e3-4046-ace9-025c7e370b9f None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:50.541765 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e19b8d3c-51e3-4046-ace9-025c7e370b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:50.549211 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6fdc2-41c9-41f1-93bf-25011adef639 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:50.559296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 444/892] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:50 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:29:50.561883 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c5261-82c9-4ef2-979b-c99a9c1811bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:50.562480 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c5261-82c9-4ef2-979b-c99a9c1811bd admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:50.562761 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c5261-82c9-4ef2-979b-c99a9c1811bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:50.563028 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c5261-82c9-4ef2-979b-c99a9c1811bd admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:50.563741 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c5261-82c9-4ef2-979b-c99a9c1811bd admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:50.564083 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c5261-82c9-4ef2-979b-c99a9c1811bd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:50.565654 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c5261-82c9-4ef2-979b-c99a9c1811bd admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:50.570789 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 449/893] 10.222.0.35 () {56 vars in 1143 bytes} [Tue Feb 8 16:29:50 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:50.579595 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b8d3c-51e3-4046-ace9-025c7e370b9f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:50.589409 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b8d3c-51e3-4046-ace9-025c7e370b9f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:50.595342 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6924b9-6619-4b61-8470-589cf0742d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:50.596415 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6924b9-6619-4b61-8470-589cf0742d6b admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:50.596972 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6924b9-6619-4b61-8470-589cf0742d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:50.597493 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6924b9-6619-4b61-8470-589cf0742d6b admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:50.598532 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6924b9-6619-4b61-8470-589cf0742d6b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:50.600449 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6924b9-6619-4b61-8470-589cf0742d6b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:50.624227 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 445/894] 10.222.0.35 () {60 vars in 1162 bytes} [Tue Feb 8 16:29:50 2022] POST /identity/v3/services => generated 251 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:29:50.629712 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dae5d-d922-413e-b243-4f26d6890a6a None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:50.630053 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dae5d-d922-413e-b243-4f26d6890a6a None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:50.630279 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dae5d-d922-413e-b243-4f26d6890a6a None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:50.632545 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 450/895] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:50.638733 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fef636-7fa5-423b-b561-862c554fde10 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:50.639582 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fef636-7fa5-423b-b561-862c554fde10 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:50.640116 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fef636-7fa5-423b-b561-862c554fde10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:50.661637 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c9fef636-7fa5-423b-b561-862c554fde10 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:50.663083 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c9fef636-7fa5-423b-b561-862c554fde10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:50.683429 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 446/896] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:50 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:29:50.709514 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dae5d-d922-413e-b243-4f26d6890a6a None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:50.724913 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dae5d-d922-413e-b243-4f26d6890a6a None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:50.730668 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda012c-1ac4-455b-b954-b5ac7717c3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:50.731919 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda012c-1ac4-455b-b954-b5ac7717c3cf admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:50.732441 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda012c-1ac4-455b-b954-b5ac7717c3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:50.732925 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda012c-1ac4-455b-b954-b5ac7717c3cf admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:50.734041 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda012c-1ac4-455b-b954-b5ac7717c3cf admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:50.736044 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda012c-1ac4-455b-b954-b5ac7717c3cf admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:50.749495 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-9eda012c-1ac4-455b-b954-b5ac7717c3cf admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 08 16:29:50.751429 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 451/897] 10.222.0.35 () {56 vars in 1153 bytes} [Tue Feb 8 16:29:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:50.758084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fef636-7fa5-423b-b561-862c554fde10 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:50.771414 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fef636-7fa5-423b-b561-862c554fde10 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:50.776816 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d014b-c0a8-4a9b-be01-bb1c6a79d3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:50.777845 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d014b-c0a8-4a9b-be01-bb1c6a79d3ad admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:50.778348 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d014b-c0a8-4a9b-be01-bb1c6a79d3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:50.778836 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d014b-c0a8-4a9b-be01-bb1c6a79d3ad admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:50.780532 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d014b-c0a8-4a9b-be01-bb1c6a79d3ad admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:50.781035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d014b-c0a8-4a9b-be01-bb1c6a79d3ad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:50.782877 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d014b-c0a8-4a9b-be01-bb1c6a79d3ad admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:50.788886 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 447/898] 10.222.0.35 () {56 vars in 1147 bytes} [Tue Feb 8 16:29:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:50.795183 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda012c-1ac4-455b-b954-b5ac7717c3cf admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:50.807523 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda012c-1ac4-455b-b954-b5ac7717c3cf admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:50.813880 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be59ab4-9a82-4d93-a34d-da7ccad0acbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:50.814809 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be59ab4-9a82-4d93-a34d-da7ccad0acbc admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:50.815291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be59ab4-9a82-4d93-a34d-da7ccad0acbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:50.815815 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be59ab4-9a82-4d93-a34d-da7ccad0acbc admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:50.816775 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be59ab4-9a82-4d93-a34d-da7ccad0acbc admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:50.817257 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be59ab4-9a82-4d93-a34d-da7ccad0acbc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:50.819252 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be59ab4-9a82-4d93-a34d-da7ccad0acbc admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:50.825824 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 452/899] 10.222.0.35 () {56 vars in 1147 bytes} [Tue Feb 8 16:29:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:50.832076 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d014b-c0a8-4a9b-be01-bb1c6a79d3ad admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:50.842126 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d014b-c0a8-4a9b-be01-bb1c6a79d3ad admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:50.847477 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c7bb9-659e-4950-bae1-e31bb22b58fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:50.848226 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c7bb9-659e-4950-bae1-e31bb22b58fe admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:50.848588 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c7bb9-659e-4950-bae1-e31bb22b58fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:50.848935 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c7bb9-659e-4950-bae1-e31bb22b58fe admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:50.849878 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c7bb9-659e-4950-bae1-e31bb22b58fe admin admin] RBAC: Adding query filter params (interface=public, service_id=d0f7cae1f2e64e4e994b510cb1cc5f9e, region_id=RegionOne) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:50.850250 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c7bb9-659e-4950-bae1-e31bb22b58fe admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:50.851944 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c7bb9-659e-4950-bae1-e31bb22b58fe admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:50.859377 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 448/900] 10.222.0.35 () {56 vars in 1272 bytes} [Tue Feb 8 16:29:50 2022] GET /identity/v3/endpoints?service_id=d0f7cae1f2e64e4e994b510cb1cc5f9e&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:50.864852 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be59ab4-9a82-4d93-a34d-da7ccad0acbc admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:50.875099 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be59ab4-9a82-4d93-a34d-da7ccad0acbc admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:50.880042 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121b5ac-c8a5-4cfd-9841-e3d877d42ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:50.880854 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121b5ac-c8a5-4cfd-9841-e3d877d42ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:50.881237 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121b5ac-c8a5-4cfd-9841-e3d877d42ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:50.881614 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121b5ac-c8a5-4cfd-9841-e3d877d42ce1 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:50.882407 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121b5ac-c8a5-4cfd-9841-e3d877d42ce1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:50.884116 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121b5ac-c8a5-4cfd-9841-e3d877d42ce1 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:50.892132 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 453/901] 10.222.0.35 () {56 vars in 1108 bytes} [Tue Feb 8 16:29:50 2022] GET /identity/v3/services => generated 1268 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:29:51.641705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69dd16-4344-4344-a1c9-f79274eac37e None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:51.642474 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69dd16-4344-4344-a1c9-f79274eac37e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:51.642474 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69dd16-4344-4344-a1c9-f79274eac37e None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:51.644437 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 449/902] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:51.649863 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6964a-c999-4944-a984-e6163fd18fd6 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:51.650263 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6964a-c999-4944-a984-e6163fd18fd6 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:51.650460 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6964a-c999-4944-a984-e6163fd18fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:51.668090 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-62e6964a-c999-4944-a984-e6163fd18fd6 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:51.669253 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-62e6964a-c999-4944-a984-e6163fd18fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:51.677800 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 454/903] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:51 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:29:51.701288 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69dd16-4344-4344-a1c9-f79274eac37e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:51.716052 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69dd16-4344-4344-a1c9-f79274eac37e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:51.721190 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57691329-3046-4a23-9473-6641c6ea2778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:51.722039 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57691329-3046-4a23-9473-6641c6ea2778 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:51.722321 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57691329-3046-4a23-9473-6641c6ea2778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:51.722596 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57691329-3046-4a23-9473-6641c6ea2778 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:51.734157 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57691329-3046-4a23-9473-6641c6ea2778 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:51.741559 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-57691329-3046-4a23-9473-6641c6ea2778 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 08 16:29:51.743152 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 450/904] 10.222.0.35 () {56 vars in 1141 bytes} [Tue Feb 8 16:29:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:51.749238 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6964a-c999-4944-a984-e6163fd18fd6 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:51.758428 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6964a-c999-4944-a984-e6163fd18fd6 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:51.762945 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353ba06-b2b6-4a51-bdde-35e377624d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:51.763597 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353ba06-b2b6-4a51-bdde-35e377624d0a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:51.763904 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353ba06-b2b6-4a51-bdde-35e377624d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:51.764903 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353ba06-b2b6-4a51-bdde-35e377624d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:51.765874 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353ba06-b2b6-4a51-bdde-35e377624d0a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:51.766176 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353ba06-b2b6-4a51-bdde-35e377624d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:51.768042 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353ba06-b2b6-4a51-bdde-35e377624d0a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:51.778149 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 455/905] 10.222.0.35 () {56 vars in 1136 bytes} [Tue Feb 8 16:29:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:51.784090 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57691329-3046-4a23-9473-6641c6ea2778 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:51.795506 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57691329-3046-4a23-9473-6641c6ea2778 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:51.800397 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d043962-3d80-424b-a0fc-7c578d214448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:51.801187 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d043962-3d80-424b-a0fc-7c578d214448 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:51.801467 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d043962-3d80-424b-a0fc-7c578d214448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:51.801740 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d043962-3d80-424b-a0fc-7c578d214448 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:51.813963 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d043962-3d80-424b-a0fc-7c578d214448 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:51.815962 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d043962-3d80-424b-a0fc-7c578d214448 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:51.834527 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-1d043962-3d80-424b-a0fc-7c578d214448 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:51.836173 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 451/906] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:51.841526 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353ba06-b2b6-4a51-bdde-35e377624d0a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:51.851809 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353ba06-b2b6-4a51-bdde-35e377624d0a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:51.856474 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc506a10-897c-4f1e-a7a0-5c2b86a0db9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:51.857136 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc506a10-897c-4f1e-a7a0-5c2b86a0db9f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:51.857412 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc506a10-897c-4f1e-a7a0-5c2b86a0db9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:51.857683 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc506a10-897c-4f1e-a7a0-5c2b86a0db9f admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:51.858450 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc506a10-897c-4f1e-a7a0-5c2b86a0db9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:51.858789 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc506a10-897c-4f1e-a7a0-5c2b86a0db9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:51.860444 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc506a10-897c-4f1e-a7a0-5c2b86a0db9f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:51.873038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 456/907] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:51.879258 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d043962-3d80-424b-a0fc-7c578d214448 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:51.890576 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d043962-3d80-424b-a0fc-7c578d214448 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:51.895462 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af94335-8e0d-4295-bf68-7055df38f856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:51.896229 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af94335-8e0d-4295-bf68-7055df38f856 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:51.896515 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af94335-8e0d-4295-bf68-7055df38f856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:51.896788 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af94335-8e0d-4295-bf68-7055df38f856 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:51.904643 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af94335-8e0d-4295-bf68-7055df38f856 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:51.906686 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af94335-8e0d-4295-bf68-7055df38f856 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:51.921038 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-0af94335-8e0d-4295-bf68-7055df38f856 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 08 16:29:51.922203 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 452/908] 10.222.0.35 () {56 vars in 1138 bytes} [Tue Feb 8 16:29:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:51.927959 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc506a10-897c-4f1e-a7a0-5c2b86a0db9f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:51.939046 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc506a10-897c-4f1e-a7a0-5c2b86a0db9f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:51.943552 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc6855-73e6-4622-b265-5066c34edb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:51.944224 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc6855-73e6-4622-b265-5066c34edb1f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:51.944502 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc6855-73e6-4622-b265-5066c34edb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:51.944827 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc6855-73e6-4622-b265-5066c34edb1f admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:51.945668 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc6855-73e6-4622-b265-5066c34edb1f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:51.946019 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc6855-73e6-4622-b265-5066c34edb1f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:51.947910 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc6855-73e6-4622-b265-5066c34edb1f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:51.967927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 457/909] 10.222.0.35 () {56 vars in 1170 bytes} [Tue Feb 8 16:29:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:51.973190 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af94335-8e0d-4295-bf68-7055df38f856 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:51.983396 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af94335-8e0d-4295-bf68-7055df38f856 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:51.987994 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdac345-24b9-457e-aad8-a83584308c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:51.988759 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdac345-24b9-457e-aad8-a83584308c0c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:51.989034 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdac345-24b9-457e-aad8-a83584308c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:51.989300 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdac345-24b9-457e-aad8-a83584308c0c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:52.000145 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdac345-24b9-457e-aad8-a83584308c0c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:52.002030 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdac345-24b9-457e-aad8-a83584308c0c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:52.019653 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-1fdac345-24b9-457e-aad8-a83584308c0c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:52.021180 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 453/910] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:52.026667 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc6855-73e6-4622-b265-5066c34edb1f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:52.037848 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc6855-73e6-4622-b265-5066c34edb1f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:52.042700 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab967a-6ddb-4c7f-a568-4895a9ac3f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:52.043572 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab967a-6ddb-4c7f-a568-4895a9ac3f72 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:52.044045 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab967a-6ddb-4c7f-a568-4895a9ac3f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:52.044531 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab967a-6ddb-4c7f-a568-4895a9ac3f72 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:52.045987 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab967a-6ddb-4c7f-a568-4895a9ac3f72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:52.046507 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab967a-6ddb-4c7f-a568-4895a9ac3f72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:52.048333 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab967a-6ddb-4c7f-a568-4895a9ac3f72 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:52.060140 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 458/911] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:52.066327 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdac345-24b9-457e-aad8-a83584308c0c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:52.077773 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdac345-24b9-457e-aad8-a83584308c0c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:52.083391 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47847a-f016-4ed7-b035-c72559873d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:52.084490 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47847a-f016-4ed7-b035-c72559873d49 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:52.084992 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47847a-f016-4ed7-b035-c72559873d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:52.085435 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47847a-f016-4ed7-b035-c72559873d49 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:52.094295 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47847a-f016-4ed7-b035-c72559873d49 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:52.096692 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47847a-f016-4ed7-b035-c72559873d49 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:52.111813 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-3f47847a-f016-4ed7-b035-c72559873d49 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:52.113690 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 454/912] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:52.119516 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab967a-6ddb-4c7f-a568-4895a9ac3f72 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:52.130465 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab967a-6ddb-4c7f-a568-4895a9ac3f72 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:52.135377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6bf17-e6ed-4a85-b7d1-2f0cc4354287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:52.136298 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6bf17-e6ed-4a85-b7d1-2f0cc4354287 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:52.136750 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6bf17-e6ed-4a85-b7d1-2f0cc4354287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:52.137192 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6bf17-e6ed-4a85-b7d1-2f0cc4354287 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:52.138198 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6bf17-e6ed-4a85-b7d1-2f0cc4354287 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:52.138674 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6bf17-e6ed-4a85-b7d1-2f0cc4354287 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:52.141254 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6bf17-e6ed-4a85-b7d1-2f0cc4354287 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:52.154695 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 459/913] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:52.161184 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47847a-f016-4ed7-b035-c72559873d49 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:52.171898 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47847a-f016-4ed7-b035-c72559873d49 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:52.176674 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f702118-2c75-44ff-bc3a-4084cf1eaef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:52.177721 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f702118-2c75-44ff-bc3a-4084cf1eaef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:52.178171 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f702118-2c75-44ff-bc3a-4084cf1eaef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:52.178612 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f702118-2c75-44ff-bc3a-4084cf1eaef0 admin admin] PATH_INFO: `/v3/projects/6b01069799b34858bbebc201a3f2046d/users/9761863f36284bd4be1ce29c86b631cc/roles/347979f7c2ac478c96b4781b6eea1a29` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:52.181115 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f702118-2c75-44ff-bc3a-4084cf1eaef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b01069799b34858bbebc201a3f2046d, user_id=9761863f36284bd4be1ce29c86b631cc, role_id=347979f7c2ac478c96b4781b6eea1a29)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:52.184148 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f702118-2c75-44ff-bc3a-4084cf1eaef0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:52.199941 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 455/914] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:29:52 2022] PUT /identity/v3/projects/6b01069799b34858bbebc201a3f2046d/users/9761863f36284bd4be1ce29c86b631cc/roles/347979f7c2ac478c96b4781b6eea1a29 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:29:52.946374 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a359d-d258-406a-afe8-16a8b8454449 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:52.947269 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a359d-d258-406a-afe8-16a8b8454449 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:52.947787 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a359d-d258-406a-afe8-16a8b8454449 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:52.949755 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 460/915] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:52.955517 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea3435-0a7b-4193-9c58-3d1e57b8fc4c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:52.955965 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea3435-0a7b-4193-9c58-3d1e57b8fc4c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:52.956168 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea3435-0a7b-4193-9c58-3d1e57b8fc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:52.975398 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2bea3435-0a7b-4193-9c58-3d1e57b8fc4c None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:52.976735 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2bea3435-0a7b-4193-9c58-3d1e57b8fc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:53.008959 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce159a0-7682-4d0d-9b01-1e0301455749 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:53.009589 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce159a0-7682-4d0d-9b01-1e0301455749 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:53.010075 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce159a0-7682-4d0d-9b01-1e0301455749 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:53.012304 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 461/916] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:29:53.018154 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502e031-04b7-4b7c-826e-f4b32798cba1 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:53.018692 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502e031-04b7-4b7c-826e-f4b32798cba1 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:53.019158 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502e031-04b7-4b7c-826e-f4b32798cba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:53.037409 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-c502e031-04b7-4b7c-826e-f4b32798cba1 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:53.039021 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-c502e031-04b7-4b7c-826e-f4b32798cba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:53.040577 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 456/917] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:52 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:29:53.050226 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 462/918] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:53 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:29:53.064459 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea3435-0a7b-4193-9c58-3d1e57b8fc4c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:53.073627 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea3435-0a7b-4193-9c58-3d1e57b8fc4c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:53.074303 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502e031-04b7-4b7c-826e-f4b32798cba1 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:53.079060 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9ddbc-fde0-46ed-bd60-f7cc1577df3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:53.079728 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9ddbc-fde0-46ed-bd60-f7cc1577df3f admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:53.080102 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9ddbc-fde0-46ed-bd60-f7cc1577df3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:53.080279 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9ddbc-fde0-46ed-bd60-f7cc1577df3f admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:53.081031 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9ddbc-fde0-46ed-bd60-f7cc1577df3f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:53.082628 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9ddbc-fde0-46ed-bd60-f7cc1577df3f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:53.085653 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502e031-04b7-4b7c-826e-f4b32798cba1 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:53.091011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49b5d3-8da2-4189-8135-08885831b573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:53.092167 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49b5d3-8da2-4189-8135-08885831b573 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:53.093165 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49b5d3-8da2-4189-8135-08885831b573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:53.093629 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49b5d3-8da2-4189-8135-08885831b573 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:53.094487 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49b5d3-8da2-4189-8135-08885831b573 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:53.096351 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49b5d3-8da2-4189-8135-08885831b573 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:53.100158 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 457/919] 10.222.0.35 () {60 vars in 1162 bytes} [Tue Feb 8 16:29:53 2022] POST /identity/v3/services => generated 241 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:29:53.108911 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-1b49b5d3-8da2-4189-8135-08885831b573 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 08 16:29:53.110851 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 463/920] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:29:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:53.117234 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9ddbc-fde0-46ed-bd60-f7cc1577df3f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:53.138378 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9ddbc-fde0-46ed-bd60-f7cc1577df3f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:53.144400 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4825b-1bf5-4c78-bfcc-b518709214ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:53.145447 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4825b-1bf5-4c78-bfcc-b518709214ee admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:53.145923 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4825b-1bf5-4c78-bfcc-b518709214ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:53.146406 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4825b-1bf5-4c78-bfcc-b518709214ee admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:53.147431 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4825b-1bf5-4c78-bfcc-b518709214ee admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:53.147983 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4825b-1bf5-4c78-bfcc-b518709214ee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:53.149918 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4825b-1bf5-4c78-bfcc-b518709214ee admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:53.156284 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 458/921] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:29:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:53.162439 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49b5d3-8da2-4189-8135-08885831b573 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:53.173427 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49b5d3-8da2-4189-8135-08885831b573 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:53.178717 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51fb24-18be-4a72-9d68-fa0bf797b7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:53.179764 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51fb24-18be-4a72-9d68-fa0bf797b7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:53.180239 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51fb24-18be-4a72-9d68-fa0bf797b7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:53.180742 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51fb24-18be-4a72-9d68-fa0bf797b7b7 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:53.181694 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51fb24-18be-4a72-9d68-fa0bf797b7b7 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:53.182202 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51fb24-18be-4a72-9d68-fa0bf797b7b7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:53.184135 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51fb24-18be-4a72-9d68-fa0bf797b7b7 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:53.191071 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 464/922] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:29:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:53.197446 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4825b-1bf5-4c78-bfcc-b518709214ee admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:53.208922 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4825b-1bf5-4c78-bfcc-b518709214ee admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:53.213980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4351b5-1fac-4ebf-be99-22b77a8fad53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:53.214932 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4351b5-1fac-4ebf-be99-22b77a8fad53 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:53.215389 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4351b5-1fac-4ebf-be99-22b77a8fad53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:53.215867 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4351b5-1fac-4ebf-be99-22b77a8fad53 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:53.216983 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4351b5-1fac-4ebf-be99-22b77a8fad53 admin admin] RBAC: Adding query filter params (interface=public, service_id=c0164c3db8f54628902021d70cbe81d3, region_id=RegionOne) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:53.218049 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4351b5-1fac-4ebf-be99-22b77a8fad53 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:53.220142 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4351b5-1fac-4ebf-be99-22b77a8fad53 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:53.226491 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 459/923] 10.222.0.35 () {56 vars in 1272 bytes} [Tue Feb 8 16:29:53 2022] GET /identity/v3/endpoints?service_id=c0164c3db8f54628902021d70cbe81d3&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:53.232419 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51fb24-18be-4a72-9d68-fa0bf797b7b7 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:53.243930 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51fb24-18be-4a72-9d68-fa0bf797b7b7 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:53.249772 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa40c15-b5e3-4c01-9780-c9c78fa353e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:53.250836 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa40c15-b5e3-4c01-9780-c9c78fa353e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:53.251289 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa40c15-b5e3-4c01-9780-c9c78fa353e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:53.251731 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa40c15-b5e3-4c01-9780-c9c78fa353e2 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:53.252610 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa40c15-b5e3-4c01-9780-c9c78fa353e2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:53.254290 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa40c15-b5e3-4c01-9780-c9c78fa353e2 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:53.267390 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 465/924] 10.222.0.35 () {56 vars in 1108 bytes} [Tue Feb 8 16:29:53 2022] GET /identity/v3/services => generated 1497 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:29:53.269179 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a139400-4b8d-41fe-b25e-7f03570824dd None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:53.269703 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a139400-4b8d-41fe-b25e-7f03570824dd None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:53.270245 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a139400-4b8d-41fe-b25e-7f03570824dd None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:53.272754 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 460/925] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:53.279043 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baae96f-bbaa-4ce9-85bd-c541514c3b9f None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:53.279344 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baae96f-bbaa-4ce9-85bd-c541514c3b9f None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:53.280152 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baae96f-bbaa-4ce9-85bd-c541514c3b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:53.301595 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-2baae96f-bbaa-4ce9-85bd-c541514c3b9f None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:53.302818 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-2baae96f-bbaa-4ce9-85bd-c541514c3b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:53.311351 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 466/926] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:53 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:29:53.335606 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a139400-4b8d-41fe-b25e-7f03570824dd None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:53.349237 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a139400-4b8d-41fe-b25e-7f03570824dd None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:53.354159 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682cfee-9544-4c32-8167-224485a0e799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:53.354967 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682cfee-9544-4c32-8167-224485a0e799 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:53.355255 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682cfee-9544-4c32-8167-224485a0e799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:53.355522 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682cfee-9544-4c32-8167-224485a0e799 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:53.356236 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682cfee-9544-4c32-8167-224485a0e799 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:53.358582 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682cfee-9544-4c32-8167-224485a0e799 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:53.371024 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-9682cfee-9544-4c32-8167-224485a0e799 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 08 16:29:53.372647 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 461/927] 10.222.0.35 () {56 vars in 1153 bytes} [Tue Feb 8 16:29:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:53.378787 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baae96f-bbaa-4ce9-85bd-c541514c3b9f None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:53.388430 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baae96f-bbaa-4ce9-85bd-c541514c3b9f None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:53.394018 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb0e84-705f-4b17-b4b7-ea9c9b41ed51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:53.394699 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb0e84-705f-4b17-b4b7-ea9c9b41ed51 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:53.394981 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb0e84-705f-4b17-b4b7-ea9c9b41ed51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:53.395258 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb0e84-705f-4b17-b4b7-ea9c9b41ed51 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:53.396042 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb0e84-705f-4b17-b4b7-ea9c9b41ed51 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:53.396375 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb0e84-705f-4b17-b4b7-ea9c9b41ed51 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:53.397995 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb0e84-705f-4b17-b4b7-ea9c9b41ed51 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:53.408001 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 467/928] 10.222.0.35 () {56 vars in 1147 bytes} [Tue Feb 8 16:29:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:53.410245 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682cfee-9544-4c32-8167-224485a0e799 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:53.421501 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682cfee-9544-4c32-8167-224485a0e799 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:53.426821 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebe3dc-a86d-4d25-a8f7-a9a16d970e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:53.427564 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebe3dc-a86d-4d25-a8f7-a9a16d970e35 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:53.427886 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebe3dc-a86d-4d25-a8f7-a9a16d970e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:53.428167 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebe3dc-a86d-4d25-a8f7-a9a16d970e35 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:53.428984 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebe3dc-a86d-4d25-a8f7-a9a16d970e35 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:53.429407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebe3dc-a86d-4d25-a8f7-a9a16d970e35 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:53.431278 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebe3dc-a86d-4d25-a8f7-a9a16d970e35 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:53.438075 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 462/929] 10.222.0.35 () {56 vars in 1147 bytes} [Tue Feb 8 16:29:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:53.443654 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb0e84-705f-4b17-b4b7-ea9c9b41ed51 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:53.455446 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb0e84-705f-4b17-b4b7-ea9c9b41ed51 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:53.460721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33bae1-64f9-45be-be50-829d675d5f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:53.461484 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33bae1-64f9-45be-be50-829d675d5f9e admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:53.461770 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33bae1-64f9-45be-be50-829d675d5f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:53.462049 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33bae1-64f9-45be-be50-829d675d5f9e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:53.462894 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33bae1-64f9-45be-be50-829d675d5f9e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:53.464620 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33bae1-64f9-45be-be50-829d675d5f9e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:53.486855 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 468/930] 10.222.0.35 () {60 vars in 1165 bytes} [Tue Feb 8 16:29:53 2022] POST /identity/v3/endpoints => generated 347 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:29:54.571534 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851752ec-6c80-4d60-a524-b4c749f83ff2 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:54.572077 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851752ec-6c80-4d60-a524-b4c749f83ff2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:54.572077 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851752ec-6c80-4d60-a524-b4c749f83ff2 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:54.574087 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 463/931] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:54.580422 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394b5fe-6306-4f83-8b9b-ef50d98a8a02 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:54.580837 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394b5fe-6306-4f83-8b9b-ef50d98a8a02 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:54.581026 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394b5fe-6306-4f83-8b9b-ef50d98a8a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:54.599681 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-5394b5fe-6306-4f83-8b9b-ef50d98a8a02 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:54.600896 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5394b5fe-6306-4f83-8b9b-ef50d98a8a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:54.621897 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 469/932] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:54 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:29:54.647489 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851752ec-6c80-4d60-a524-b4c749f83ff2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:54.660483 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851752ec-6c80-4d60-a524-b4c749f83ff2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:54.665076 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1781fa0-4f6e-4d8f-a22c-e45d66b7e957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:54.665874 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1781fa0-4f6e-4d8f-a22c-e45d66b7e957 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:54.666150 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1781fa0-4f6e-4d8f-a22c-e45d66b7e957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:54.666426 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1781fa0-4f6e-4d8f-a22c-e45d66b7e957 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:54.679952 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1781fa0-4f6e-4d8f-a22c-e45d66b7e957 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:29:54.688365 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-f1781fa0-4f6e-4d8f-a22c-e45d66b7e957 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 08 16:29:54.694522 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 464/933] 10.222.0.35 () {56 vars in 1141 bytes} [Tue Feb 8 16:29:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:54.695901 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394b5fe-6306-4f83-8b9b-ef50d98a8a02 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:54.705679 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394b5fe-6306-4f83-8b9b-ef50d98a8a02 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:54.710253 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74cdac-401b-4f41-ad4a-d84ff7bdd17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:54.710906 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74cdac-401b-4f41-ad4a-d84ff7bdd17d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:54.711223 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74cdac-401b-4f41-ad4a-d84ff7bdd17d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:54.711495 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74cdac-401b-4f41-ad4a-d84ff7bdd17d admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:54.712282 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74cdac-401b-4f41-ad4a-d84ff7bdd17d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:54.712588 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74cdac-401b-4f41-ad4a-d84ff7bdd17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:54.714167 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74cdac-401b-4f41-ad4a-d84ff7bdd17d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:54.722751 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 470/934] 10.222.0.35 () {56 vars in 1136 bytes} [Tue Feb 8 16:29:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:54.728180 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1781fa0-4f6e-4d8f-a22c-e45d66b7e957 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:54.737931 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1781fa0-4f6e-4d8f-a22c-e45d66b7e957 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:54.742564 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cd141-7d68-495a-9f53-db26e7d47d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:54.743330 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cd141-7d68-495a-9f53-db26e7d47d9c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:54.743612 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cd141-7d68-495a-9f53-db26e7d47d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:54.743922 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cd141-7d68-495a-9f53-db26e7d47d9c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:54.754949 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cd141-7d68-495a-9f53-db26e7d47d9c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:54.756823 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cd141-7d68-495a-9f53-db26e7d47d9c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:54.775241 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-5e2cd141-7d68-495a-9f53-db26e7d47d9c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:54.781707 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 465/935] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:54.783068 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74cdac-401b-4f41-ad4a-d84ff7bdd17d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:54.792971 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74cdac-401b-4f41-ad4a-d84ff7bdd17d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:54.797901 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38d097-1727-49b0-9677-ef45af35c2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:54.798597 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d097-1727-49b0-9677-ef45af35c2ce admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:54.798883 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d097-1727-49b0-9677-ef45af35c2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:54.799161 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d097-1727-49b0-9677-ef45af35c2ce admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:54.799935 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38d097-1727-49b0-9677-ef45af35c2ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:54.800242 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38d097-1727-49b0-9677-ef45af35c2ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:54.801823 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38d097-1727-49b0-9677-ef45af35c2ce admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:54.818775 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 471/936] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:54.820258 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cd141-7d68-495a-9f53-db26e7d47d9c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:54.830916 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cd141-7d68-495a-9f53-db26e7d47d9c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:54.835706 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25656c6-4c2a-423c-99ef-7072006367ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:54.836511 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25656c6-4c2a-423c-99ef-7072006367ff admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:54.836846 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25656c6-4c2a-423c-99ef-7072006367ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:54.837127 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25656c6-4c2a-423c-99ef-7072006367ff admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:54.844747 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25656c6-4c2a-423c-99ef-7072006367ff admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:54.846758 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25656c6-4c2a-423c-99ef-7072006367ff admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:54.861500 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-a25656c6-4c2a-423c-99ef-7072006367ff admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 08 16:29:54.862968 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 466/937] 10.222.0.35 () {56 vars in 1138 bytes} [Tue Feb 8 16:29:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:54.868824 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38d097-1727-49b0-9677-ef45af35c2ce admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:54.879416 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38d097-1727-49b0-9677-ef45af35c2ce admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:54.886515 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e253d50-244d-4604-a891-00d9119b865a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:54.887659 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e253d50-244d-4604-a891-00d9119b865a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:54.888220 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e253d50-244d-4604-a891-00d9119b865a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:54.888729 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e253d50-244d-4604-a891-00d9119b865a admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:54.891070 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e253d50-244d-4604-a891-00d9119b865a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:54.891677 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e253d50-244d-4604-a891-00d9119b865a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:54.895572 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e253d50-244d-4604-a891-00d9119b865a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:54.919876 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 472/938] 10.222.0.35 () {56 vars in 1170 bytes} [Tue Feb 8 16:29:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:54.922924 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25656c6-4c2a-423c-99ef-7072006367ff admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:54.932876 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25656c6-4c2a-423c-99ef-7072006367ff admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:54.938128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4df70-d8eb-47f7-873e-25e0a937a1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:54.938825 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4df70-d8eb-47f7-873e-25e0a937a1af admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:54.939108 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4df70-d8eb-47f7-873e-25e0a937a1af admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:54.939536 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4df70-d8eb-47f7-873e-25e0a937a1af admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:54.949018 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4df70-d8eb-47f7-873e-25e0a937a1af admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:54.950777 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4df70-d8eb-47f7-873e-25e0a937a1af admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:54.965899 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 467/939] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:29:54 2022] GET /identity/v3/auth/tokens => generated 1952 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:29:54.967677 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e253d50-244d-4604-a891-00d9119b865a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:54.977557 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e253d50-244d-4604-a891-00d9119b865a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:54.982180 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df886c4-fead-469d-b4af-c89cd5380000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:54.983158 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df886c4-fead-469d-b4af-c89cd5380000 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:54.983439 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df886c4-fead-469d-b4af-c89cd5380000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:54.983720 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df886c4-fead-469d-b4af-c89cd5380000 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:54.994085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df886c4-fead-469d-b4af-c89cd5380000 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:54.995950 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df886c4-fead-469d-b4af-c89cd5380000 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:55.013344 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-8df886c4-fead-469d-b4af-c89cd5380000 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:29:55.019863 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 473/940] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:55.021930 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4df70-d8eb-47f7-873e-25e0a937a1af admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:55.031735 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4df70-d8eb-47f7-873e-25e0a937a1af admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:55.036488 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91eac4-4724-4c0b-83f1-5ec163494bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:55.037138 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91eac4-4724-4c0b-83f1-5ec163494bea admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:55.037417 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91eac4-4724-4c0b-83f1-5ec163494bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:55.037692 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91eac4-4724-4c0b-83f1-5ec163494bea admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:55.038424 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91eac4-4724-4c0b-83f1-5ec163494bea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:55.038728 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91eac4-4724-4c0b-83f1-5ec163494bea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:55.040343 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91eac4-4724-4c0b-83f1-5ec163494bea admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:55.057825 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 468/941] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:55.060587 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df886c4-fead-469d-b4af-c89cd5380000 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:55.071188 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df886c4-fead-469d-b4af-c89cd5380000 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:55.076189 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359d334-ee73-4f19-b4ea-62a806eae6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:55.077840 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359d334-ee73-4f19-b4ea-62a806eae6af admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:55.078107 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359d334-ee73-4f19-b4ea-62a806eae6af admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:55.078377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359d334-ee73-4f19-b4ea-62a806eae6af admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:55.085812 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359d334-ee73-4f19-b4ea-62a806eae6af admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:55.087778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359d334-ee73-4f19-b4ea-62a806eae6af admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:55.101499 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-b359d334-ee73-4f19-b4ea-62a806eae6af admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:55.107475 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 474/942] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:55.108999 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91eac4-4724-4c0b-83f1-5ec163494bea admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:55.118964 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91eac4-4724-4c0b-83f1-5ec163494bea admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:55.123857 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ec6a3-e91e-4990-bc98-440862b491c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:55.124564 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ec6a3-e91e-4990-bc98-440862b491c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:55.124847 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ec6a3-e91e-4990-bc98-440862b491c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:55.125173 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ec6a3-e91e-4990-bc98-440862b491c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:55.126033 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ec6a3-e91e-4990-bc98-440862b491c1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:55.126347 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ec6a3-e91e-4990-bc98-440862b491c1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:55.128285 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ec6a3-e91e-4990-bc98-440862b491c1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:55.146705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 469/943] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:29:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:55.148065 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359d334-ee73-4f19-b4ea-62a806eae6af admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:55.160751 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359d334-ee73-4f19-b4ea-62a806eae6af admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:55.165469 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f5eb2-7055-4d72-94e3-e3aad94c4e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:55.166170 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f5eb2-7055-4d72-94e3-e3aad94c4e47 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:55.166450 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f5eb2-7055-4d72-94e3-e3aad94c4e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:55.166724 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f5eb2-7055-4d72-94e3-e3aad94c4e47 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:55.167676 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f5eb2-7055-4d72-94e3-e3aad94c4e47 admin admin] RBAC: Adding query filter params (role.id=347979f7c2ac478c96b4781b6eea1a29, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=9761863f36284bd4be1ce29c86b631cc) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:55.168020 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f5eb2-7055-4d72-94e3-e3aad94c4e47 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:55.170230 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f5eb2-7055-4d72-94e3-e3aad94c4e47 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:55.183945 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 475/944] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:29:55 2022] GET /identity/v3/role_assignments?user.id=9761863f36284bd4be1ce29c86b631cc&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=347979f7c2ac478c96b4781b6eea1a29 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:55.548476 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab97fe3-9dde-4951-8483-757679ebe30e None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:55.548773 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab97fe3-9dde-4951-8483-757679ebe30e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:55.549058 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab97fe3-9dde-4951-8483-757679ebe30e None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:55.550846 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 470/945] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:55.556528 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae49849-687c-4a73-aeee-de5144d2394a None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:55.556813 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae49849-687c-4a73-aeee-de5144d2394a None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:55.557082 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae49849-687c-4a73-aeee-de5144d2394a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:55.577616 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-4ae49849-687c-4a73-aeee-de5144d2394a None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:55.579400 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-4ae49849-687c-4a73-aeee-de5144d2394a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:55.581206 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e493b0-d355-45ce-b0b4-476e531b4fdf None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:55.581652 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e493b0-d355-45ce-b0b4-476e531b4fdf None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:55.581865 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e493b0-d355-45ce-b0b4-476e531b4fdf None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:55.584043 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 471/946] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:55.588201 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 476/947] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:55 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:29:55.590059 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73241a-6c2e-4b77-9640-4852c5da8788 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:55.590430 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73241a-6c2e-4b77-9640-4852c5da8788 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:55.590739 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73241a-6c2e-4b77-9640-4852c5da8788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:55.616322 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-af73241a-6c2e-4b77-9640-4852c5da8788 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:55.617697 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-af73241a-6c2e-4b77-9640-4852c5da8788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:55.619043 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae49849-687c-4a73-aeee-de5144d2394a None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:55.625923 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 472/948] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:55 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:29:55.629998 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae49849-687c-4a73-aeee-de5144d2394a None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:55.634162 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a508d-b3e3-4946-a58c-abacc944cafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:55.634960 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a508d-b3e3-4946-a58c-abacc944cafb admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:55.635292 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a508d-b3e3-4946-a58c-abacc944cafb admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:55.635569 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a508d-b3e3-4946-a58c-abacc944cafb admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:55.636266 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a508d-b3e3-4946-a58c-abacc944cafb admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:55.637857 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a508d-b3e3-4946-a58c-abacc944cafb admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:55.649629 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-8b2a508d-b3e3-4946-a58c-abacc944cafb admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 08 16:29:55.651196 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 477/949] 10.222.0.35 () {56 vars in 1147 bytes} [Tue Feb 8 16:29:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:55.653831 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73241a-6c2e-4b77-9640-4852c5da8788 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:55.660398 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a508d-b3e3-4946-a58c-abacc944cafb admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:55.664035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73241a-6c2e-4b77-9640-4852c5da8788 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:55.668790 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03b091-34c5-43f2-980b-145bb5fe193c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:55.669790 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03b091-34c5-43f2-980b-145bb5fe193c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:55.670816 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a508d-b3e3-4946-a58c-abacc944cafb admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:55.671257 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03b091-34c5-43f2-980b-145bb5fe193c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:55.671809 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03b091-34c5-43f2-980b-145bb5fe193c admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:55.672783 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03b091-34c5-43f2-980b-145bb5fe193c admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:55.674782 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03b091-34c5-43f2-980b-145bb5fe193c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:55.675411 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e917c-fe57-429d-a4ca-4f0318d3961f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:55.676083 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e917c-fe57-429d-a4ca-4f0318d3961f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:55.676362 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e917c-fe57-429d-a4ca-4f0318d3961f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:55.676637 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e917c-fe57-429d-a4ca-4f0318d3961f admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:55.677345 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e917c-fe57-429d-a4ca-4f0318d3961f admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:55.677652 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e917c-fe57-429d-a4ca-4f0318d3961f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:55.679240 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e917c-fe57-429d-a4ca-4f0318d3961f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:55.684503 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 478/950] 10.222.0.35 () {56 vars in 1143 bytes} [Tue Feb 8 16:29:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:55.688636 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-2e03b091-34c5-43f2-980b-145bb5fe193c admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 08 16:29:55.690051 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e917c-fe57-429d-a4ca-4f0318d3961f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:55.690635 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 473/951] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:29:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:55.695946 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03b091-34c5-43f2-980b-145bb5fe193c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:55.705345 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e917c-fe57-429d-a4ca-4f0318d3961f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:55.706027 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03b091-34c5-43f2-980b-145bb5fe193c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:55.710296 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab4f54-7cfb-4968-8d88-b68cbca1af0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:55.710933 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab4f54-7cfb-4968-8d88-b68cbca1af0e admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:55.711219 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab4f54-7cfb-4968-8d88-b68cbca1af0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:55.711496 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab4f54-7cfb-4968-8d88-b68cbca1af0e admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:55.712007 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdca7bf-7f53-4061-a5dd-90a247a846d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:55.712243 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab4f54-7cfb-4968-8d88-b68cbca1af0e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:55.712547 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab4f54-7cfb-4968-8d88-b68cbca1af0e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:55.713271 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdca7bf-7f53-4061-a5dd-90a247a846d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:55.713753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdca7bf-7f53-4061-a5dd-90a247a846d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:55.714118 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab4f54-7cfb-4968-8d88-b68cbca1af0e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:55.714451 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdca7bf-7f53-4061-a5dd-90a247a846d8 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:55.715344 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdca7bf-7f53-4061-a5dd-90a247a846d8 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:55.715907 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdca7bf-7f53-4061-a5dd-90a247a846d8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:55.718443 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdca7bf-7f53-4061-a5dd-90a247a846d8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:55.720291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 479/952] 10.222.0.35 () {56 vars in 1143 bytes} [Tue Feb 8 16:29:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:55.727096 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 474/953] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:29:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:55.728324 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab4f54-7cfb-4968-8d88-b68cbca1af0e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:55.734297 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdca7bf-7f53-4061-a5dd-90a247a846d8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:55.738670 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab4f54-7cfb-4968-8d88-b68cbca1af0e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:55.744334 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdca7bf-7f53-4061-a5dd-90a247a846d8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:55.744682 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22b189-2815-4e88-8c17-f3c89b2f6d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:55.745746 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22b189-2815-4e88-8c17-f3c89b2f6d48 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:55.746295 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22b189-2815-4e88-8c17-f3c89b2f6d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:55.746721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22b189-2815-4e88-8c17-f3c89b2f6d48 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:55.747699 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22b189-2815-4e88-8c17-f3c89b2f6d48 admin admin] RBAC: Adding query filter params (interface=public, service_id=8535b52a894541c6a357eb65c19f3a3b, region_id=RegionOne) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:55.748914 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22b189-2815-4e88-8c17-f3c89b2f6d48 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:55.749974 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1b501-df46-48aa-afcb-daa07e6003cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:55.750702 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1b501-df46-48aa-afcb-daa07e6003cb admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:55.751079 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1b501-df46-48aa-afcb-daa07e6003cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:55.751244 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22b189-2815-4e88-8c17-f3c89b2f6d48 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:55.751532 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1b501-df46-48aa-afcb-daa07e6003cb admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:55.752374 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1b501-df46-48aa-afcb-daa07e6003cb admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:55.752769 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1b501-df46-48aa-afcb-daa07e6003cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:55.754422 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1b501-df46-48aa-afcb-daa07e6003cb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:55.758386 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 480/954] 10.222.0.35 () {56 vars in 1272 bytes} [Tue Feb 8 16:29:55 2022] GET /identity/v3/endpoints?service_id=8535b52a894541c6a357eb65c19f3a3b&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:55.761177 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 475/955] 10.222.0.35 () {56 vars in 1135 bytes} [Tue Feb 8 16:29:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:55.768914 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22b189-2815-4e88-8c17-f3c89b2f6d48 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:55.770145 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1b501-df46-48aa-afcb-daa07e6003cb admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:55.781698 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1b501-df46-48aa-afcb-daa07e6003cb admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:55.781847 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22b189-2815-4e88-8c17-f3c89b2f6d48 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:55.786828 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e509ad-7711-4b5f-b4bf-009a2b7c31ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:55.787423 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d81ddc-8c63-40d8-b6c9-3ba35f32402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:55.787540 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e509ad-7711-4b5f-b4bf-009a2b7c31ae admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:55.787823 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e509ad-7711-4b5f-b4bf-009a2b7c31ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:55.788212 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e509ad-7711-4b5f-b4bf-009a2b7c31ae admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:55.788830 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d81ddc-8c63-40d8-b6c9-3ba35f32402b admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:55.789011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e509ad-7711-4b5f-b4bf-009a2b7c31ae admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:55.789467 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d81ddc-8c63-40d8-b6c9-3ba35f32402b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:55.789939 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d81ddc-8c63-40d8-b6c9-3ba35f32402b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:55.790626 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e509ad-7711-4b5f-b4bf-009a2b7c31ae admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:55.791084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d81ddc-8c63-40d8-b6c9-3ba35f32402b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:55.792882 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d81ddc-8c63-40d8-b6c9-3ba35f32402b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:55.803854 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 481/956] 10.222.0.35 () {56 vars in 1108 bytes} [Tue Feb 8 16:29:55 2022] GET /identity/v3/services => generated 1497 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:29:55.827203 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 476/957] 10.222.0.35 () {60 vars in 1165 bytes} [Tue Feb 8 16:29:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:29:55.881322 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dc308-b847-4f5d-a7aa-77d31213a066 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:55.881607 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dc308-b847-4f5d-a7aa-77d31213a066 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:55.881929 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dc308-b847-4f5d-a7aa-77d31213a066 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:55.883987 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 482/958] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:55.893488 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834e951-0215-4539-b9c1-23b2bcc8ef24 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:55.893488 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834e951-0215-4539-b9c1-23b2bcc8ef24 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:55.893488 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834e951-0215-4539-b9c1-23b2bcc8ef24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:55.913366 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2834e951-0215-4539-b9c1-23b2bcc8ef24 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:55.914983 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2834e951-0215-4539-b9c1-23b2bcc8ef24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:55.936362 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 477/959] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:55 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:29:55.961314 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dc308-b847-4f5d-a7aa-77d31213a066 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:55.977081 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dc308-b847-4f5d-a7aa-77d31213a066 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:55.982694 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb35244-17fd-4a24-948f-073ca4a6779d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:55.983868 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb35244-17fd-4a24-948f-073ca4a6779d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:55.984338 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb35244-17fd-4a24-948f-073ca4a6779d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:55.984801 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb35244-17fd-4a24-948f-073ca4a6779d admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:55.985667 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb35244-17fd-4a24-948f-073ca4a6779d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:55.987600 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb35244-17fd-4a24-948f-073ca4a6779d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:56.000333 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-dcb35244-17fd-4a24-948f-073ca4a6779d admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 08 16:29:56.002321 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 483/960] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:29:56.008872 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834e951-0215-4539-b9c1-23b2bcc8ef24 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:56.019531 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834e951-0215-4539-b9c1-23b2bcc8ef24 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:56.024633 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85125ed2-87a8-400a-8f92-74afb37c2b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:56.025533 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85125ed2-87a8-400a-8f92-74afb37c2b4b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:56.025977 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85125ed2-87a8-400a-8f92-74afb37c2b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:56.026409 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85125ed2-87a8-400a-8f92-74afb37c2b4b admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:56.027260 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85125ed2-87a8-400a-8f92-74afb37c2b4b admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:56.027616 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85125ed2-87a8-400a-8f92-74afb37c2b4b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:56.030164 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85125ed2-87a8-400a-8f92-74afb37c2b4b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:56.036924 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 478/961] 10.222.0.35 () {56 vars in 1133 bytes} [Tue Feb 8 16:29:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:56.042772 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb35244-17fd-4a24-948f-073ca4a6779d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:56.053996 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb35244-17fd-4a24-948f-073ca4a6779d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:56.059644 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9f9ef-1a70-4e11-9b45-4991ed63f75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:56.060446 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9f9ef-1a70-4e11-9b45-4991ed63f75f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:56.060871 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9f9ef-1a70-4e11-9b45-4991ed63f75f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:56.061230 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9f9ef-1a70-4e11-9b45-4991ed63f75f admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:56.062038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9f9ef-1a70-4e11-9b45-4991ed63f75f admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:56.062439 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9f9ef-1a70-4e11-9b45-4991ed63f75f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:56.064297 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9f9ef-1a70-4e11-9b45-4991ed63f75f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:56.069374 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 484/962] 10.222.0.35 () {56 vars in 1133 bytes} [Tue Feb 8 16:29:56 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:57.597668 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba6718-a571-4256-880e-1e2bab137bbe None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:57.598157 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba6718-a571-4256-880e-1e2bab137bbe None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:57.598157 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba6718-a571-4256-880e-1e2bab137bbe None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:57.600307 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 479/963] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:57.605713 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93402a72-dd41-4d9b-892a-d6a8314a71a7 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:57.606508 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93402a72-dd41-4d9b-892a-d6a8314a71a7 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:57.606970 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93402a72-dd41-4d9b-892a-d6a8314a71a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:57.624856 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-93402a72-dd41-4d9b-892a-d6a8314a71a7 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:57.626382 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-93402a72-dd41-4d9b-892a-d6a8314a71a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:57.634896 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 485/964] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:57 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:29:57.659345 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba6718-a571-4256-880e-1e2bab137bbe None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:57.672016 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba6718-a571-4256-880e-1e2bab137bbe None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:57.676548 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70047c1-6d48-4f35-b604-221e3834ca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:57.677321 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70047c1-6d48-4f35-b604-221e3834ca14 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:57.677603 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70047c1-6d48-4f35-b604-221e3834ca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:57.677878 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70047c1-6d48-4f35-b604-221e3834ca14 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:57.678546 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70047c1-6d48-4f35-b604-221e3834ca14 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:57.680238 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70047c1-6d48-4f35-b604-221e3834ca14 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:57.692040 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-c70047c1-6d48-4f35-b604-221e3834ca14 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 08 16:29:57.698493 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 480/965] 10.222.0.35 () {56 vars in 1126 bytes} [Tue Feb 8 16:29:57 2022] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:57.699861 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93402a72-dd41-4d9b-892a-d6a8314a71a7 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:57.709718 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93402a72-dd41-4d9b-892a-d6a8314a71a7 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:57.714437 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59611150-c192-4559-b251-d2f5e781ddc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:57.715092 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59611150-c192-4559-b251-d2f5e781ddc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:57.715372 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59611150-c192-4559-b251-d2f5e781ddc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:57.715648 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59611150-c192-4559-b251-d2f5e781ddc9 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:57.716412 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59611150-c192-4559-b251-d2f5e781ddc9 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:57.716770 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59611150-c192-4559-b251-d2f5e781ddc9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:57.719049 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59611150-c192-4559-b251-d2f5e781ddc9 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:57.727866 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 486/966] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:57.730123 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70047c1-6d48-4f35-b604-221e3834ca14 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:57.740740 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70047c1-6d48-4f35-b604-221e3834ca14 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:57.745435 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b246fc-92c9-4010-9e82-6bbd4b51879f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:57.746083 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b246fc-92c9-4010-9e82-6bbd4b51879f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:57.746365 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b246fc-92c9-4010-9e82-6bbd4b51879f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:57.746641 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b246fc-92c9-4010-9e82-6bbd4b51879f admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:57.747363 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b246fc-92c9-4010-9e82-6bbd4b51879f admin admin] RBAC: Adding query filter params (type=image) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:57.747928 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b246fc-92c9-4010-9e82-6bbd4b51879f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:57.750258 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b246fc-92c9-4010-9e82-6bbd4b51879f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:57.759866 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 481/967] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:29:57 2022] GET /identity/v3/services?type=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:58.125936 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60685bd-9e8b-441a-9884-dd656045363a None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:58.126326 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60685bd-9e8b-441a-9884-dd656045363a None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:58.126512 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60685bd-9e8b-441a-9884-dd656045363a None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:58.128564 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 487/968] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:29:58.133992 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d4d48-2286-4bc2-80d6-2f4fac672fca None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:58.134282 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d4d48-2286-4bc2-80d6-2f4fac672fca None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:58.134561 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d4d48-2286-4bc2-80d6-2f4fac672fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:58.152635 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-7b5d4d48-2286-4bc2-80d6-2f4fac672fca None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:58.153857 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7b5d4d48-2286-4bc2-80d6-2f4fac672fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:58.161980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 482/969] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:58 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:29:58.186122 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60685bd-9e8b-441a-9884-dd656045363a None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:58.198435 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60685bd-9e8b-441a-9884-dd656045363a None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:58.203477 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8dac2-6c06-413d-94c8-5a4de1e8b31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:58.207799 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8dac2-6c06-413d-94c8-5a4de1e8b31c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:58.207799 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8dac2-6c06-413d-94c8-5a4de1e8b31c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:58.207799 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8dac2-6c06-413d-94c8-5a4de1e8b31c admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:58.207799 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8dac2-6c06-413d-94c8-5a4de1e8b31c admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:58.208623 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8db60-df89-4871-88d4-7409eeb10b2e None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:58.208623 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8db60-df89-4871-88d4-7409eeb10b2e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:58.208623 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8db60-df89-4871-88d4-7409eeb10b2e None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:58.209034 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8dac2-6c06-413d-94c8-5a4de1e8b31c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:58.209843 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 483/970] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:29:58.214793 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a587c-446e-4674-9301-06e41de768a5 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:58.215143 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a587c-446e-4674-9301-06e41de768a5 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:58.215485 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a587c-446e-4674-9301-06e41de768a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:58.220269 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-20e8dac2-6c06-413d-94c8-5a4de1e8b31c admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 08 16:29:58.221955 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 488/971] 10.222.0.35 () {56 vars in 1147 bytes} [Tue Feb 8 16:29:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:58.228164 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8dac2-6c06-413d-94c8-5a4de1e8b31c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:58.234981 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-321a587c-446e-4674-9301-06e41de768a5 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:58.236282 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-321a587c-446e-4674-9301-06e41de768a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:58.238419 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8dac2-6c06-413d-94c8-5a4de1e8b31c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:58.243183 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ebfe7-328a-4c50-9c57-500efbb10326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:58.244077 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ebfe7-328a-4c50-9c57-500efbb10326 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:58.244539 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ebfe7-328a-4c50-9c57-500efbb10326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:58.244692 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 484/972] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:58 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:29:58.245120 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ebfe7-328a-4c50-9c57-500efbb10326 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:58.246051 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ebfe7-328a-4c50-9c57-500efbb10326 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:58.246530 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ebfe7-328a-4c50-9c57-500efbb10326 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:58.248345 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ebfe7-328a-4c50-9c57-500efbb10326 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:58.253761 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 489/973] 10.222.0.35 () {56 vars in 1143 bytes} [Tue Feb 8 16:29:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:29:58.259425 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a587c-446e-4674-9301-06e41de768a5 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:58.269854 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a587c-446e-4674-9301-06e41de768a5 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:58.274564 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508783bf-cbbe-44ea-a163-446f9020ebce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:58.275278 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508783bf-cbbe-44ea-a163-446f9020ebce admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:58.275646 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508783bf-cbbe-44ea-a163-446f9020ebce admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:58.276010 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508783bf-cbbe-44ea-a163-446f9020ebce admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:58.276792 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508783bf-cbbe-44ea-a163-446f9020ebce admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:58.277162 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508783bf-cbbe-44ea-a163-446f9020ebce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:58.278814 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508783bf-cbbe-44ea-a163-446f9020ebce admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:58.279283 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ebfe7-328a-4c50-9c57-500efbb10326 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:58.285202 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 485/974] 10.222.0.35 () {56 vars in 1143 bytes} [Tue Feb 8 16:29:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:58.291156 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508783bf-cbbe-44ea-a163-446f9020ebce admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:58.292946 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ebfe7-328a-4c50-9c57-500efbb10326 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:58.299273 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529a3ae-3267-45b4-b994-e93d7013df6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:58.300370 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529a3ae-3267-45b4-b994-e93d7013df6f admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:58.300759 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529a3ae-3267-45b4-b994-e93d7013df6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:58.301102 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529a3ae-3267-45b4-b994-e93d7013df6f admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:58.301933 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529a3ae-3267-45b4-b994-e93d7013df6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:58.302950 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508783bf-cbbe-44ea-a163-446f9020ebce admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:58.303960 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529a3ae-3267-45b4-b994-e93d7013df6f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:58.305524 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.common [None req-6529a3ae-3267-45b4-b994-e93d7013df6f admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 08 16:29:58.308674 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088c1e5-e473-4004-9207-778cac453efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:58.309510 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088c1e5-e473-4004-9207-778cac453efc admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:58.309964 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088c1e5-e473-4004-9207-778cac453efc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:58.311288 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088c1e5-e473-4004-9207-778cac453efc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:58.319771 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088c1e5-e473-4004-9207-778cac453efc admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:58.319771 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088c1e5-e473-4004-9207-778cac453efc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:58.327838 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.sql.core [None req-6529a3ae-3267-45b4-b994-e93d7013df6f admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 08 16:29:58.327838 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 08 16:29:58.327838 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [parameters: {'id': 'b88a0fd86e874c699236e33e95421e91', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 08 16:29:58.327838 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79340) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 08 16:29:58.335500 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-6529a3ae-3267-45b4-b994-e93d7013df6f admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b88a0fd86e874c699236e33e95421e91.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b88a0fd86e874c699236e33e95421e91. Feb 08 16:29:58.339778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 490/975] 10.222.0.35 () {60 vars in 1161 bytes} [Tue Feb 8 16:29:58 2022] POST /identity/v3/projects => generated 262 bytes in 59 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:58.339991 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 486/976] 10.222.0.35 () {60 vars in 1165 bytes} [Tue Feb 8 16:29:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:29:58.348025 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529a3ae-3267-45b4-b994-e93d7013df6f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:58.359722 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529a3ae-3267-45b4-b994-e93d7013df6f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:58.380537 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc3089-7928-4fe7-8a37-316cfd68be69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:58.381361 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc3089-7928-4fe7-8a37-316cfd68be69 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:58.381643 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc3089-7928-4fe7-8a37-316cfd68be69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:58.381917 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc3089-7928-4fe7-8a37-316cfd68be69 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:58.391472 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc3089-7928-4fe7-8a37-316cfd68be69 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:58.392392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d06cd1-25ec-4b66-82c2-0befaa66cd22 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:58.392739 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d06cd1-25ec-4b66-82c2-0befaa66cd22 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:58.393016 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d06cd1-25ec-4b66-82c2-0befaa66cd22 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:58.393954 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc3089-7928-4fe7-8a37-316cfd68be69 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:58.395037 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 487/977] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:29:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:29:58.401758 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac5aba-e8d0-48ea-9de9-f0e2ef4a6db3 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:58.402073 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac5aba-e8d0-48ea-9de9-f0e2ef4a6db3 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:58.402299 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac5aba-e8d0-48ea-9de9-f0e2ef4a6db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:58.409329 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-93bc3089-7928-4fe7-8a37-316cfd68be69 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:29:58.410923 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 491/978] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:29:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:29:58.416530 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc3089-7928-4fe7-8a37-316cfd68be69 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:58.422650 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-3cac5aba-e8d0-48ea-9de9-f0e2ef4a6db3 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:29:58.423888 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3cac5aba-e8d0-48ea-9de9-f0e2ef4a6db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:29:58.429138 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc3089-7928-4fe7-8a37-316cfd68be69 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:58.438087 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 488/979] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:29:58 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:29:58.440497 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59302e86-caa3-4bde-b2ed-fa245387e990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:58.441541 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59302e86-caa3-4bde-b2ed-fa245387e990 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:58.442023 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59302e86-caa3-4bde-b2ed-fa245387e990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:58.442560 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59302e86-caa3-4bde-b2ed-fa245387e990 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:58.443603 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59302e86-caa3-4bde-b2ed-fa245387e990 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:29:58.444166 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59302e86-caa3-4bde-b2ed-fa245387e990 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:58.446486 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59302e86-caa3-4bde-b2ed-fa245387e990 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:58.456324 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac5aba-e8d0-48ea-9de9-f0e2ef4a6db3 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:29:58.468892 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac5aba-e8d0-48ea-9de9-f0e2ef4a6db3 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:29:58.469090 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 492/980] 10.222.0.35 () {56 vars in 1133 bytes} [Tue Feb 8 16:29:58 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:29:58.479438 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314e74b-1260-4663-abd5-d404c46066aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:29:58.480150 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314e74b-1260-4663-abd5-d404c46066aa admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:29:58.480476 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314e74b-1260-4663-abd5-d404c46066aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:29:58.480751 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314e74b-1260-4663-abd5-d404c46066aa admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:29:58.481592 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314e74b-1260-4663-abd5-d404c46066aa admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:29:58.484313 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314e74b-1260-4663-abd5-d404c46066aa admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:29:58.503896 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 489/981] 10.222.0.35 () {60 vars in 1162 bytes} [Tue Feb 8 16:29:58 2022] POST /identity/v3/services => generated 242 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:30:00.120435 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31a8f1-7e34-40a9-b2d7-eb006d473b28 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:00.121289 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31a8f1-7e34-40a9-b2d7-eb006d473b28 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:00.121738 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31a8f1-7e34-40a9-b2d7-eb006d473b28 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:00.124113 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 493/982] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:00.130279 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477d01a-82dc-4063-87d3-fa01d450713a None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:00.131130 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477d01a-82dc-4063-87d3-fa01d450713a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:00.131632 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477d01a-82dc-4063-87d3-fa01d450713a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:00.150510 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-6477d01a-82dc-4063-87d3-fa01d450713a None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:00.151706 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6477d01a-82dc-4063-87d3-fa01d450713a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:00.170753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 490/983] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:00 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:00.193927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31a8f1-7e34-40a9-b2d7-eb006d473b28 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:00.207203 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31a8f1-7e34-40a9-b2d7-eb006d473b28 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:00.212106 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227380a7-dc8c-4fc2-9e04-d1456644336e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:00.213032 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227380a7-dc8c-4fc2-9e04-d1456644336e admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:00.213518 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227380a7-dc8c-4fc2-9e04-d1456644336e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:00.213994 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227380a7-dc8c-4fc2-9e04-d1456644336e admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:00.214954 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227380a7-dc8c-4fc2-9e04-d1456644336e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:00.217709 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227380a7-dc8c-4fc2-9e04-d1456644336e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:00.239906 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 494/984] 10.222.0.35 () {60 vars in 1162 bytes} [Tue Feb 8 16:30:00 2022] POST /identity/v3/services => generated 242 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:30:00.686565 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7795b00-6274-4895-b993-f23297c5fe2e None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:00.686955 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7795b00-6274-4895-b993-f23297c5fe2e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:00.687133 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7795b00-6274-4895-b993-f23297c5fe2e None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:00.689176 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 491/985] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:00.694785 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ddf19-6f20-4ee8-a568-91ce76999881 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:00.695073 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ddf19-6f20-4ee8-a568-91ce76999881 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:00.695351 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ddf19-6f20-4ee8-a568-91ce76999881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:00.714726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-236ddf19-6f20-4ee8-a568-91ce76999881 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:00.716763 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-236ddf19-6f20-4ee8-a568-91ce76999881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:00.734919 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 495/986] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:00 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:30:00.758063 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7795b00-6274-4895-b993-f23297c5fe2e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:00.771660 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7795b00-6274-4895-b993-f23297c5fe2e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:00.776189 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635a521-ae33-47c1-92d8-3b85af76a446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:00.776976 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635a521-ae33-47c1-92d8-3b85af76a446 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:00.777254 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635a521-ae33-47c1-92d8-3b85af76a446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:00.777524 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635a521-ae33-47c1-92d8-3b85af76a446 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:00.778191 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635a521-ae33-47c1-92d8-3b85af76a446 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:00.780595 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635a521-ae33-47c1-92d8-3b85af76a446 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:00.791849 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-a635a521-ae33-47c1-92d8-3b85af76a446 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 08 16:30:00.793311 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 492/987] 10.222.0.35 () {56 vars in 1147 bytes} [Tue Feb 8 16:30:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:00.800021 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ddf19-6f20-4ee8-a568-91ce76999881 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:00.809087 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ddf19-6f20-4ee8-a568-91ce76999881 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:00.814374 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89b795-19bc-4476-a2ad-7f718fc73364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:00.815029 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89b795-19bc-4476-a2ad-7f718fc73364 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:00.815308 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89b795-19bc-4476-a2ad-7f718fc73364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:00.815582 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89b795-19bc-4476-a2ad-7f718fc73364 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:00.816336 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89b795-19bc-4476-a2ad-7f718fc73364 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:00.816641 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89b795-19bc-4476-a2ad-7f718fc73364 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:00.818234 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89b795-19bc-4476-a2ad-7f718fc73364 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:00.823677 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 496/988] 10.222.0.35 () {56 vars in 1143 bytes} [Tue Feb 8 16:30:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:00.829961 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635a521-ae33-47c1-92d8-3b85af76a446 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:00.839776 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635a521-ae33-47c1-92d8-3b85af76a446 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:00.845540 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bff9b-4ba2-4d7b-a66b-0fd35779e63f None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:00.845826 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bff9b-4ba2-4d7b-a66b-0fd35779e63f None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:00.846102 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bff9b-4ba2-4d7b-a66b-0fd35779e63f None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:00.846685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f8913-f11e-43c2-94bd-e2717a89a259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:00.847569 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f8913-f11e-43c2-94bd-e2717a89a259 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:00.848074 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f8913-f11e-43c2-94bd-e2717a89a259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:00.848207 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 497/989] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:30:00.848616 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f8913-f11e-43c2-94bd-e2717a89a259 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:00.849343 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f8913-f11e-43c2-94bd-e2717a89a259 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:00.849653 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f8913-f11e-43c2-94bd-e2717a89a259 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:00.851430 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f8913-f11e-43c2-94bd-e2717a89a259 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:00.856923 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e1a20-e4a6-4488-8735-7d8d9b83d871 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:00.857229 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 493/990] 10.222.0.35 () {56 vars in 1143 bytes} [Tue Feb 8 16:30:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:00.857641 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e1a20-e4a6-4488-8735-7d8d9b83d871 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:00.857921 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e1a20-e4a6-4488-8735-7d8d9b83d871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:00.864747 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f8913-f11e-43c2-94bd-e2717a89a259 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:00.875163 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f8913-f11e-43c2-94bd-e2717a89a259 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:00.877309 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-d64e1a20-e4a6-4488-8735-7d8d9b83d871 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:00.878480 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d64e1a20-e4a6-4488-8735-7d8d9b83d871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:00.879884 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49ae27-004f-4112-ab5a-f4ac17334dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:00.880547 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49ae27-004f-4112-ab5a-f4ac17334dee admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:00.880805 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49ae27-004f-4112-ab5a-f4ac17334dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:00.881077 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49ae27-004f-4112-ab5a-f4ac17334dee admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:00.881905 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49ae27-004f-4112-ab5a-f4ac17334dee admin admin] RBAC: Adding query filter params (interface=admin, service_id=8535b52a894541c6a357eb65c19f3a3b, region_id=RegionOne) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:00.882207 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49ae27-004f-4112-ab5a-f4ac17334dee admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:00.883823 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49ae27-004f-4112-ab5a-f4ac17334dee admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:00.887917 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 498/991] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:00 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:30:00.888079 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cad936-365a-47c3-b650-b82919b53f20 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:00.888385 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cad936-365a-47c3-b650-b82919b53f20 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:00.888688 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cad936-365a-47c3-b650-b82919b53f20 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:00.890999 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 494/992] 10.222.0.35 () {56 vars in 1270 bytes} [Tue Feb 8 16:30:00 2022] GET /identity/v3/endpoints?service_id=8535b52a894541c6a357eb65c19f3a3b&interface=admin®ion_id=RegionOne => generated 193 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:30:00.895668 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 499/993] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:00.896739 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cad936-365a-47c3-b650-b82919b53f20 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:00.897420 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa45bf1-c6da-4b05-8baf-1be0d23b7e77 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:00.897886 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa45bf1-c6da-4b05-8baf-1be0d23b7e77 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:00.898338 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa45bf1-c6da-4b05-8baf-1be0d23b7e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:00.909335 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cad936-365a-47c3-b650-b82919b53f20 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:00.914051 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415f25a-ef0c-4e65-87b8-c2e5c8eed2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:00.914692 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415f25a-ef0c-4e65-87b8-c2e5c8eed2ee admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:00.914974 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415f25a-ef0c-4e65-87b8-c2e5c8eed2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:00.915248 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415f25a-ef0c-4e65-87b8-c2e5c8eed2ee admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:00.915968 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415f25a-ef0c-4e65-87b8-c2e5c8eed2ee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:00.917542 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415f25a-ef0c-4e65-87b8-c2e5c8eed2ee admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:00.918687 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-cfa45bf1-c6da-4b05-8baf-1be0d23b7e77 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:00.919942 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cfa45bf1-c6da-4b05-8baf-1be0d23b7e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:00.925008 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 500/994] 10.222.0.35 () {56 vars in 1108 bytes} [Tue Feb 8 16:30:00 2022] GET /identity/v3/services => generated 1957 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:30:00.925768 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415f25a-ef0c-4e65-87b8-c2e5c8eed2ee admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:00.952575 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415f25a-ef0c-4e65-87b8-c2e5c8eed2ee admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:00.959424 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 495/995] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:00 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:00.968681 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b42ee3-3edb-400a-bb0b-7512e8bb0bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:00.969878 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b42ee3-3edb-400a-bb0b-7512e8bb0bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:00.970382 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b42ee3-3edb-400a-bb0b-7512e8bb0bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:00.970868 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b42ee3-3edb-400a-bb0b-7512e8bb0bb4 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:00.972247 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b42ee3-3edb-400a-bb0b-7512e8bb0bb4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:00.974324 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b42ee3-3edb-400a-bb0b-7512e8bb0bb4 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:00.990087 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa45bf1-c6da-4b05-8baf-1be0d23b7e77 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:00.992683 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-c1b42ee3-3edb-400a-bb0b-7512e8bb0bb4 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 08 16:30:00.994172 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 501/996] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:30:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:01.006235 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b42ee3-3edb-400a-bb0b-7512e8bb0bb4 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:01.006425 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa45bf1-c6da-4b05-8baf-1be0d23b7e77 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:01.018378 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47231aac-e7c3-4122-8b1f-3518f7d2783a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:01.020837 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47231aac-e7c3-4122-8b1f-3518f7d2783a admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:01.021132 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47231aac-e7c3-4122-8b1f-3518f7d2783a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:01.021412 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47231aac-e7c3-4122-8b1f-3518f7d2783a admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:01.022516 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47231aac-e7c3-4122-8b1f-3518f7d2783a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:01.025832 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47231aac-e7c3-4122-8b1f-3518f7d2783a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:01.028655 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b42ee3-3edb-400a-bb0b-7512e8bb0bb4 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:01.032485 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.common [None req-47231aac-e7c3-4122-8b1f-3518f7d2783a admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 08 16:30:01.036353 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4651f-a727-4d95-a676-d833d423fb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:01.037246 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4651f-a727-4d95-a676-d833d423fb33 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:01.037980 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4651f-a727-4d95-a676-d833d423fb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:01.038475 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4651f-a727-4d95-a676-d833d423fb33 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:01.043963 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4651f-a727-4d95-a676-d833d423fb33 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:01.044444 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4651f-a727-4d95-a676-d833d423fb33 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:01.046102 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4651f-a727-4d95-a676-d833d423fb33 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:01.053430 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.sql.core [None req-47231aac-e7c3-4122-8b1f-3518f7d2783a admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 08 16:30:01.053430 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 08 16:30:01.053430 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [parameters: {'user_id': 'cc31b2a26ad9420e945fc1420c989120', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 08 16:30:01.053430 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79339) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 08 16:30:01.070120 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 502/997] 10.222.0.35 () {56 vars in 1133 bytes} [Tue Feb 8 16:30:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:01.071465 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4651f-a727-4d95-a676-d833d423fb33 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:01.076590 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-47231aac-e7c3-4122-8b1f-3518f7d2783a admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 08 16:30:01.078956 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 496/998] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:30:00 2022] POST /identity/v3/users => generated 160 bytes in 89 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:01.085492 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47231aac-e7c3-4122-8b1f-3518f7d2783a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:01.092468 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4651f-a727-4d95-a676-d833d423fb33 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:01.104436 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47231aac-e7c3-4122-8b1f-3518f7d2783a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:01.107274 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dd70a-8d68-4961-9a04-1850a94d9158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:01.108522 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dd70a-8d68-4961-9a04-1850a94d9158 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:01.108855 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dd70a-8d68-4961-9a04-1850a94d9158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:01.109213 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dd70a-8d68-4961-9a04-1850a94d9158 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:01.111214 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dd70a-8d68-4961-9a04-1850a94d9158 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:01.112041 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dd70a-8d68-4961-9a04-1850a94d9158 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:01.113664 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dd70a-8d68-4961-9a04-1850a94d9158 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:01.118878 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc524a3-f536-4fe9-829b-f46f97ef233a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:01.121011 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc524a3-f536-4fe9-829b-f46f97ef233a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:01.121290 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc524a3-f536-4fe9-829b-f46f97ef233a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:01.121616 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc524a3-f536-4fe9-829b-f46f97ef233a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:01.128343 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 503/999] 10.222.0.35 () {56 vars in 1133 bytes} [Tue Feb 8 16:30:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:01.135017 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dd70a-8d68-4961-9a04-1850a94d9158 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:01.141075 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc524a3-f536-4fe9-829b-f46f97ef233a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:01.143586 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc524a3-f536-4fe9-829b-f46f97ef233a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:01.151569 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dd70a-8d68-4961-9a04-1850a94d9158 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:01.156259 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77560330-0c67-4dfd-a697-4095b36aa350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:01.157127 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77560330-0c67-4dfd-a697-4095b36aa350 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:01.157565 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77560330-0c67-4dfd-a697-4095b36aa350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:01.157834 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77560330-0c67-4dfd-a697-4095b36aa350 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:01.158707 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77560330-0c67-4dfd-a697-4095b36aa350 admin admin] RBAC: Adding query filter params (interface=public, service_id=a87c996220f04a86bb27625b36e3c7f6, region_id=RegionOne) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:01.159014 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77560330-0c67-4dfd-a697-4095b36aa350 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:01.160616 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77560330-0c67-4dfd-a697-4095b36aa350 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:01.162417 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-dbc524a3-f536-4fe9-829b-f46f97ef233a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 08 16:30:01.164064 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 497/1000] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:30:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:30:01.167497 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 504/1001] 10.222.0.35 () {56 vars in 1272 bytes} [Tue Feb 8 16:30:01 2022] GET /identity/v3/endpoints?service_id=a87c996220f04a86bb27625b36e3c7f6&interface=public®ion_id=RegionOne => generated 194 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:01.171833 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc524a3-f536-4fe9-829b-f46f97ef233a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:01.175090 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77560330-0c67-4dfd-a697-4095b36aa350 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:01.181722 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc524a3-f536-4fe9-829b-f46f97ef233a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:01.189075 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77560330-0c67-4dfd-a697-4095b36aa350 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:01.190345 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07843e7-b4a9-4be3-893c-f06b2b876fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:01.191428 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07843e7-b4a9-4be3-893c-f06b2b876fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:01.191955 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07843e7-b4a9-4be3-893c-f06b2b876fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:01.192466 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07843e7-b4a9-4be3-893c-f06b2b876fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:01.193638 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07843e7-b4a9-4be3-893c-f06b2b876fe3 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:01.194140 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07843e7-b4a9-4be3-893c-f06b2b876fe3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:01.194750 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff368b4-ef6e-4f22-966c-f21a0aee66ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:01.195565 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff368b4-ef6e-4f22-966c-f21a0aee66ed admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:01.196015 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff368b4-ef6e-4f22-966c-f21a0aee66ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:01.196446 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff368b4-ef6e-4f22-966c-f21a0aee66ed admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:01.197090 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07843e7-b4a9-4be3-893c-f06b2b876fe3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:01.197333 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff368b4-ef6e-4f22-966c-f21a0aee66ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:01.199173 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff368b4-ef6e-4f22-966c-f21a0aee66ed admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:01.207219 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 505/1002] 10.222.0.35 () {56 vars in 1108 bytes} [Tue Feb 8 16:30:01 2022] GET /identity/v3/services => generated 1957 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:30:01.248859 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 498/1003] 10.222.0.35 () {56 vars in 1122 bytes} [Tue Feb 8 16:30:01 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:02.633897 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7577f5-cbd9-41bc-97bc-752c702f3045 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:02.634396 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7577f5-cbd9-41bc-97bc-752c702f3045 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:02.634396 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7577f5-cbd9-41bc-97bc-752c702f3045 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:02.636159 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 506/1004] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:02.641486 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80a407-6366-46fc-8a9a-0b1f4c2e31b6 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:02.642162 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80a407-6366-46fc-8a9a-0b1f4c2e31b6 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:02.642337 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80a407-6366-46fc-8a9a-0b1f4c2e31b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:02.660245 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ef80a407-6366-46fc-8a9a-0b1f4c2e31b6 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:02.661753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ef80a407-6366-46fc-8a9a-0b1f4c2e31b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:02.669562 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 499/1005] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:02 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:02.693749 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7577f5-cbd9-41bc-97bc-752c702f3045 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:02.706223 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7577f5-cbd9-41bc-97bc-752c702f3045 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:02.710761 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69958da1-6f5c-482c-9098-8d143c573c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:02.711668 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69958da1-6f5c-482c-9098-8d143c573c4b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:02.711982 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69958da1-6f5c-482c-9098-8d143c573c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:02.712262 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69958da1-6f5c-482c-9098-8d143c573c4b admin admin] PATH_INFO: `/v3/services/image` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:02.712925 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69958da1-6f5c-482c-9098-8d143c573c4b admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:02.714505 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69958da1-6f5c-482c-9098-8d143c573c4b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:02.725265 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-69958da1-6f5c-482c-9098-8d143c573c4b admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 08 16:30:02.726731 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 507/1006] 10.222.0.35 () {56 vars in 1126 bytes} [Tue Feb 8 16:30:02 2022] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:02.732969 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80a407-6366-46fc-8a9a-0b1f4c2e31b6 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:02.742385 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80a407-6366-46fc-8a9a-0b1f4c2e31b6 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:02.746952 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4154b-9617-49fa-89a4-9450864bc07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:02.747599 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4154b-9617-49fa-89a4-9450864bc07a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:02.748804 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4154b-9617-49fa-89a4-9450864bc07a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:02.749096 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4154b-9617-49fa-89a4-9450864bc07a admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:02.749811 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4154b-9617-49fa-89a4-9450864bc07a admin admin] RBAC: Adding query filter params (name=image) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:02.750117 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4154b-9617-49fa-89a4-9450864bc07a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:02.751715 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4154b-9617-49fa-89a4-9450864bc07a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:02.756979 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 500/1007] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:30:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:02.762378 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69958da1-6f5c-482c-9098-8d143c573c4b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:02.772862 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69958da1-6f5c-482c-9098-8d143c573c4b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:02.777376 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be662e50-cf49-4117-8353-c1477f17dfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:02.778012 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be662e50-cf49-4117-8353-c1477f17dfbf admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:02.778292 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be662e50-cf49-4117-8353-c1477f17dfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:02.778568 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be662e50-cf49-4117-8353-c1477f17dfbf admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:02.779305 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be662e50-cf49-4117-8353-c1477f17dfbf admin admin] RBAC: Adding query filter params (type=image) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:02.779640 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be662e50-cf49-4117-8353-c1477f17dfbf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:02.781333 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be662e50-cf49-4117-8353-c1477f17dfbf admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:02.786605 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 508/1008] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:30:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:02.792448 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4154b-9617-49fa-89a4-9450864bc07a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:02.802588 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4154b-9617-49fa-89a4-9450864bc07a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:02.807127 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb54be0-e7d5-425f-b506-975d60515726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:02.807867 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb54be0-e7d5-425f-b506-975d60515726 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:02.808218 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb54be0-e7d5-425f-b506-975d60515726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:02.808579 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb54be0-e7d5-425f-b506-975d60515726 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:02.809493 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb54be0-e7d5-425f-b506-975d60515726 admin admin] RBAC: Adding query filter params (interface=public, service_id=abba27e8cc64493eac253477699d0b50, region_id=RegionOne) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:02.809807 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb54be0-e7d5-425f-b506-975d60515726 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:02.812157 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb54be0-e7d5-425f-b506-975d60515726 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:02.819785 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 501/1009] 10.222.0.35 () {56 vars in 1272 bytes} [Tue Feb 8 16:30:02 2022] GET /identity/v3/endpoints?service_id=abba27e8cc64493eac253477699d0b50&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:30:02.822716 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be662e50-cf49-4117-8353-c1477f17dfbf admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:02.832833 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be662e50-cf49-4117-8353-c1477f17dfbf admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:02.837687 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1135b0-4db9-4cb4-a418-84b0ab69e982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:02.838331 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1135b0-4db9-4cb4-a418-84b0ab69e982 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:02.838611 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1135b0-4db9-4cb4-a418-84b0ab69e982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:02.838882 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1135b0-4db9-4cb4-a418-84b0ab69e982 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:02.839572 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1135b0-4db9-4cb4-a418-84b0ab69e982 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:02.841167 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1135b0-4db9-4cb4-a418-84b0ab69e982 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:02.855817 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 509/1010] 10.222.0.35 () {56 vars in 1108 bytes} [Tue Feb 8 16:30:02 2022] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:30:03.306681 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13fb6e-e961-41bb-a6cd-86ee37a4663f None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:03.307403 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13fb6e-e961-41bb-a6cd-86ee37a4663f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:03.307927 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13fb6e-e961-41bb-a6cd-86ee37a4663f None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:03.311481 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 502/1011] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:03.316974 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51143c2d-e7e0-487a-8bfa-ef32becc0967 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:03.317266 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51143c2d-e7e0-487a-8bfa-ef32becc0967 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:03.317546 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51143c2d-e7e0-487a-8bfa-ef32becc0967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:03.336071 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-51143c2d-e7e0-487a-8bfa-ef32becc0967 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:03.337253 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-51143c2d-e7e0-487a-8bfa-ef32becc0967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:03.347224 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 510/1012] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:03 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:03.369577 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13fb6e-e961-41bb-a6cd-86ee37a4663f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:03.382044 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13fb6e-e961-41bb-a6cd-86ee37a4663f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:03.386412 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e791d3-7f19-4258-871a-9390cc473d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:03.387286 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e791d3-7f19-4258-871a-9390cc473d20 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:03.387575 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e791d3-7f19-4258-871a-9390cc473d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:03.387915 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e791d3-7f19-4258-871a-9390cc473d20 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:03.389081 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e791d3-7f19-4258-871a-9390cc473d20 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:03.390729 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e791d3-7f19-4258-871a-9390cc473d20 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:03.402159 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-d5e791d3-7f19-4258-871a-9390cc473d20 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 08 16:30:03.403499 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 503/1013] 10.222.0.35 () {56 vars in 1147 bytes} [Tue Feb 8 16:30:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:03.409871 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51143c2d-e7e0-487a-8bfa-ef32becc0967 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:03.419068 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51143c2d-e7e0-487a-8bfa-ef32becc0967 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:03.423617 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c90964-5c43-49a8-bbc8-175430369d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:03.424315 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c90964-5c43-49a8-bbc8-175430369d4f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:03.424596 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c90964-5c43-49a8-bbc8-175430369d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:03.424870 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c90964-5c43-49a8-bbc8-175430369d4f admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:03.425587 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c90964-5c43-49a8-bbc8-175430369d4f admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:03.425892 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c90964-5c43-49a8-bbc8-175430369d4f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:03.427571 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c90964-5c43-49a8-bbc8-175430369d4f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:03.432842 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 511/1014] 10.222.0.35 () {56 vars in 1143 bytes} [Tue Feb 8 16:30:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:03.438431 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e791d3-7f19-4258-871a-9390cc473d20 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:03.448199 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e791d3-7f19-4258-871a-9390cc473d20 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:03.453401 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6818c-a660-4821-90d4-d4799bb3003c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:03.454074 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6818c-a660-4821-90d4-d4799bb3003c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:03.454322 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6818c-a660-4821-90d4-d4799bb3003c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:03.454595 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6818c-a660-4821-90d4-d4799bb3003c admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:03.455305 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6818c-a660-4821-90d4-d4799bb3003c admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:03.455613 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6818c-a660-4821-90d4-d4799bb3003c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:03.457222 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6818c-a660-4821-90d4-d4799bb3003c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:03.466489 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 504/1015] 10.222.0.35 () {56 vars in 1143 bytes} [Tue Feb 8 16:30:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:03.468354 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c90964-5c43-49a8-bbc8-175430369d4f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:03.479446 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c90964-5c43-49a8-bbc8-175430369d4f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:03.484428 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612517e-7555-4ce5-8906-45f5ad44ab16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:03.485064 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612517e-7555-4ce5-8906-45f5ad44ab16 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:03.485347 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612517e-7555-4ce5-8906-45f5ad44ab16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:03.485630 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612517e-7555-4ce5-8906-45f5ad44ab16 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:03.486392 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612517e-7555-4ce5-8906-45f5ad44ab16 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:03.487989 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612517e-7555-4ce5-8906-45f5ad44ab16 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:03.504510 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 512/1016] 10.222.0.35 () {60 vars in 1165 bytes} [Tue Feb 8 16:30:03 2022] POST /identity/v3/endpoints => generated 325 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:30:03.575744 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485894b-8d9f-4bcd-9322-610b687a06b3 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:03.576638 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485894b-8d9f-4bcd-9322-610b687a06b3 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:03.577070 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485894b-8d9f-4bcd-9322-610b687a06b3 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:03.579097 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 505/1017] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:03.585104 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bf2e6-7f91-4192-a6e6-b6d67ceedc9c None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:03.585415 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bf2e6-7f91-4192-a6e6-b6d67ceedc9c None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:03.585664 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bf2e6-7f91-4192-a6e6-b6d67ceedc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:03.605822 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-598bf2e6-7f91-4192-a6e6-b6d67ceedc9c None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:03.607202 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-598bf2e6-7f91-4192-a6e6-b6d67ceedc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:03.626136 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 513/1018] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:03 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:03.650049 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485894b-8d9f-4bcd-9322-610b687a06b3 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:03.663487 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485894b-8d9f-4bcd-9322-610b687a06b3 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:03.668261 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab265575-9626-497a-a83d-5fa9b7a7bf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:03.669161 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab265575-9626-497a-a83d-5fa9b7a7bf78 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:03.670150 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab265575-9626-497a-a83d-5fa9b7a7bf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:03.670150 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab265575-9626-497a-a83d-5fa9b7a7bf78 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:03.670575 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab265575-9626-497a-a83d-5fa9b7a7bf78 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:03.672237 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab265575-9626-497a-a83d-5fa9b7a7bf78 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:03.687260 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-ab265575-9626-497a-a83d-5fa9b7a7bf78 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 08 16:30:03.688521 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 506/1019] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:30:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:03.694655 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bf2e6-7f91-4192-a6e6-b6d67ceedc9c None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:03.705295 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bf2e6-7f91-4192-a6e6-b6d67ceedc9c None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:03.709912 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeeef80-eaba-4db7-9071-cd032ea7dd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:03.710570 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeeef80-eaba-4db7-9071-cd032ea7dd3d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:03.710908 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeeef80-eaba-4db7-9071-cd032ea7dd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:03.711124 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeeef80-eaba-4db7-9071-cd032ea7dd3d admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:03.711874 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeeef80-eaba-4db7-9071-cd032ea7dd3d admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:03.712179 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeeef80-eaba-4db7-9071-cd032ea7dd3d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:03.713786 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeeef80-eaba-4db7-9071-cd032ea7dd3d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:03.718941 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 514/1020] 10.222.0.35 () {56 vars in 1133 bytes} [Tue Feb 8 16:30:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:03.725103 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab265575-9626-497a-a83d-5fa9b7a7bf78 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:03.735608 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab265575-9626-497a-a83d-5fa9b7a7bf78 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:03.740369 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0db56c-83a0-4204-9c2a-c9785001d257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:03.741014 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0db56c-83a0-4204-9c2a-c9785001d257 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:03.741299 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0db56c-83a0-4204-9c2a-c9785001d257 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:03.741664 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0db56c-83a0-4204-9c2a-c9785001d257 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:03.742395 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0db56c-83a0-4204-9c2a-c9785001d257 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:03.742698 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0db56c-83a0-4204-9c2a-c9785001d257 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:03.744307 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0db56c-83a0-4204-9c2a-c9785001d257 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:03.750355 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 507/1021] 10.222.0.35 () {56 vars in 1133 bytes} [Tue Feb 8 16:30:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:03.755816 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeeef80-eaba-4db7-9071-cd032ea7dd3d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:03.766209 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeeef80-eaba-4db7-9071-cd032ea7dd3d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:03.771087 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24867c20-9701-4d3a-9eda-0274d992f97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:03.771721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24867c20-9701-4d3a-9eda-0274d992f97d admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:03.772036 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24867c20-9701-4d3a-9eda-0274d992f97d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:03.772311 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24867c20-9701-4d3a-9eda-0274d992f97d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:03.773143 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24867c20-9701-4d3a-9eda-0274d992f97d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:03.774726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24867c20-9701-4d3a-9eda-0274d992f97d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:03.793456 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 515/1022] 10.222.0.35 () {60 vars in 1165 bytes} [Tue Feb 8 16:30:03 2022] POST /identity/v3/endpoints => generated 334 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:30:05.136671 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27af6a-8673-4e64-b187-bcbf777ca56f None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:05.137196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27af6a-8673-4e64-b187-bcbf777ca56f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:05.137196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27af6a-8673-4e64-b187-bcbf777ca56f None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:05.139151 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 508/1023] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:05.144908 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8af06d-9f3b-4b90-85c4-d6506f64f91a None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:05.145333 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8af06d-9f3b-4b90-85c4-d6506f64f91a None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:05.145531 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8af06d-9f3b-4b90-85c4-d6506f64f91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:05.162741 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-ed8af06d-9f3b-4b90-85c4-d6506f64f91a None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:05.163933 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-ed8af06d-9f3b-4b90-85c4-d6506f64f91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:05.180458 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 516/1024] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:05 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:05.204166 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27af6a-8673-4e64-b187-bcbf777ca56f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:05.215876 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27af6a-8673-4e64-b187-bcbf777ca56f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:05.221306 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26afb8-433e-4b9a-be0b-ad14af545fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:05.222067 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26afb8-433e-4b9a-be0b-ad14af545fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:05.222342 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26afb8-433e-4b9a-be0b-ad14af545fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:05.222612 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26afb8-433e-4b9a-be0b-ad14af545fa0 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:05.223265 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26afb8-433e-4b9a-be0b-ad14af545fa0 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:05.224853 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26afb8-433e-4b9a-be0b-ad14af545fa0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:05.236085 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-3f26afb8-433e-4b9a-be0b-ad14af545fa0 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 08 16:30:05.237272 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 509/1025] 10.222.0.35 () {56 vars in 1126 bytes} [Tue Feb 8 16:30:05 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:05.243134 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8af06d-9f3b-4b90-85c4-d6506f64f91a None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:05.252694 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8af06d-9f3b-4b90-85c4-d6506f64f91a None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:05.257107 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14221f72-0f35-4235-af2b-df31e14be050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:05.257744 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14221f72-0f35-4235-af2b-df31e14be050 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:05.258019 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14221f72-0f35-4235-af2b-df31e14be050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:05.258288 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14221f72-0f35-4235-af2b-df31e14be050 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:05.258989 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14221f72-0f35-4235-af2b-df31e14be050 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:05.259292 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14221f72-0f35-4235-af2b-df31e14be050 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:05.264459 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14221f72-0f35-4235-af2b-df31e14be050 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:05.270892 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 517/1026] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:30:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:05.276498 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26afb8-433e-4b9a-be0b-ad14af545fa0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:05.286324 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26afb8-433e-4b9a-be0b-ad14af545fa0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:05.290753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4502888-bf85-4871-b8e6-0694f5149617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:05.291384 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4502888-bf85-4871-b8e6-0694f5149617 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:05.291663 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4502888-bf85-4871-b8e6-0694f5149617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:05.291970 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4502888-bf85-4871-b8e6-0694f5149617 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:05.292671 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4502888-bf85-4871-b8e6-0694f5149617 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:05.292971 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4502888-bf85-4871-b8e6-0694f5149617 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:05.294538 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4502888-bf85-4871-b8e6-0694f5149617 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:05.299690 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 510/1027] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:30:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:30:05.305943 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14221f72-0f35-4235-af2b-df31e14be050 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:05.316141 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14221f72-0f35-4235-af2b-df31e14be050 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:05.320680 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fa279-a6ac-4ded-96bf-321ed27aca27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:05.321393 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fa279-a6ac-4ded-96bf-321ed27aca27 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:05.321740 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fa279-a6ac-4ded-96bf-321ed27aca27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:05.322075 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fa279-a6ac-4ded-96bf-321ed27aca27 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:05.322915 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fa279-a6ac-4ded-96bf-321ed27aca27 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:05.324587 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fa279-a6ac-4ded-96bf-321ed27aca27 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:05.343544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 518/1028] 10.222.0.35 () {60 vars in 1165 bytes} [Tue Feb 8 16:30:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:30:05.829986 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdac33f-3016-4aca-81f1-1b8e9f6bee89 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:05.830366 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdac33f-3016-4aca-81f1-1b8e9f6bee89 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:05.830545 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdac33f-3016-4aca-81f1-1b8e9f6bee89 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:05.832491 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 511/1029] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:05.837546 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beecc4e-aca7-4e6e-b38e-fbd5e7adacca None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:05.837835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beecc4e-aca7-4e6e-b38e-fbd5e7adacca None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:05.838109 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beecc4e-aca7-4e6e-b38e-fbd5e7adacca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:05.856493 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-2beecc4e-aca7-4e6e-b38e-fbd5e7adacca None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:05.858611 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-2beecc4e-aca7-4e6e-b38e-fbd5e7adacca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:05.879781 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 519/1030] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:05 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:30:05.903509 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdac33f-3016-4aca-81f1-1b8e9f6bee89 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:05.915936 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdac33f-3016-4aca-81f1-1b8e9f6bee89 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:05.921134 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474742e3-d3be-4adf-bd0d-92945791f43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:05.921917 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474742e3-d3be-4adf-bd0d-92945791f43a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:05.922200 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474742e3-d3be-4adf-bd0d-92945791f43a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:05.922475 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474742e3-d3be-4adf-bd0d-92945791f43a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:05.923650 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474742e3-d3be-4adf-bd0d-92945791f43a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:05.925368 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474742e3-d3be-4adf-bd0d-92945791f43a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:05.931557 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 512/1031] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:30:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:05.933027 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beecc4e-aca7-4e6e-b38e-fbd5e7adacca None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:05.942946 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beecc4e-aca7-4e6e-b38e-fbd5e7adacca None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:05.947328 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e732915-8360-47bc-9ee4-15f9033f5136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:05.947993 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e732915-8360-47bc-9ee4-15f9033f5136 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:05.948270 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e732915-8360-47bc-9ee4-15f9033f5136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:05.948537 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e732915-8360-47bc-9ee4-15f9033f5136 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:05.949248 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e732915-8360-47bc-9ee4-15f9033f5136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:05.951125 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e732915-8360-47bc-9ee4-15f9033f5136 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:05.977013 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 520/1032] 10.222.0.35 () {60 vars in 1162 bytes} [Tue Feb 8 16:30:05 2022] POST /identity/v3/projects => generated 311 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:30:06.159552 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d59ca-f8f9-47a6-8bce-f9fe8e931c6c None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:06.160124 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d59ca-f8f9-47a6-8bce-f9fe8e931c6c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:06.160124 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d59ca-f8f9-47a6-8bce-f9fe8e931c6c None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:06.161864 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 513/1033] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:06.167358 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a65a7-30cd-4ab1-8299-1a34c8cf6f79 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:06.167929 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a65a7-30cd-4ab1-8299-1a34c8cf6f79 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:06.167929 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a65a7-30cd-4ab1-8299-1a34c8cf6f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:06.187035 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-2f9a65a7-30cd-4ab1-8299-1a34c8cf6f79 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:06.188253 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-2f9a65a7-30cd-4ab1-8299-1a34c8cf6f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:06.245877 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 521/1034] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:06.274378 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d59ca-f8f9-47a6-8bce-f9fe8e931c6c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:06.286777 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d59ca-f8f9-47a6-8bce-f9fe8e931c6c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:06.291186 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472617a-7d72-4dce-b32f-6afdaff51509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:06.292084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472617a-7d72-4dce-b32f-6afdaff51509 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:06.292434 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472617a-7d72-4dce-b32f-6afdaff51509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:06.292714 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472617a-7d72-4dce-b32f-6afdaff51509 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:06.304113 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472617a-7d72-4dce-b32f-6afdaff51509 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:30:06.312420 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-9472617a-7d72-4dce-b32f-6afdaff51509 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 08 16:30:06.313822 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 514/1035] 10.222.0.35 () {56 vars in 1141 bytes} [Tue Feb 8 16:30:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:06.319549 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a65a7-30cd-4ab1-8299-1a34c8cf6f79 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:06.329657 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a65a7-30cd-4ab1-8299-1a34c8cf6f79 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:06.334176 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e7285-1490-46c3-a17c-02a3455ef7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:06.334831 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e7285-1490-46c3-a17c-02a3455ef7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:06.335109 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e7285-1490-46c3-a17c-02a3455ef7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:06.335384 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e7285-1490-46c3-a17c-02a3455ef7c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:06.336173 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e7285-1490-46c3-a17c-02a3455ef7c7 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:06.336476 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e7285-1490-46c3-a17c-02a3455ef7c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:06.338049 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e7285-1490-46c3-a17c-02a3455ef7c7 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:06.355827 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 522/1036] 10.222.0.35 () {56 vars in 1136 bytes} [Tue Feb 8 16:30:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:06.358393 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472617a-7d72-4dce-b32f-6afdaff51509 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:06.368110 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472617a-7d72-4dce-b32f-6afdaff51509 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:06.372736 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff502a9-1f14-40a9-8cb5-a9f2885510b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:06.373806 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff502a9-1f14-40a9-8cb5-a9f2885510b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:06.374092 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff502a9-1f14-40a9-8cb5-a9f2885510b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:06.374355 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff502a9-1f14-40a9-8cb5-a9f2885510b7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:06.384937 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff502a9-1f14-40a9-8cb5-a9f2885510b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:06.387293 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff502a9-1f14-40a9-8cb5-a9f2885510b7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:06.407111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-4ff502a9-1f14-40a9-8cb5-a9f2885510b7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:30:06.408591 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 515/1037] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:30:06.414095 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e7285-1490-46c3-a17c-02a3455ef7c7 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:06.424016 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e7285-1490-46c3-a17c-02a3455ef7c7 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:06.428503 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd5056-c2a5-4bdd-96cd-ef7590b718b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:06.429154 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd5056-c2a5-4bdd-96cd-ef7590b718b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:06.429435 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd5056-c2a5-4bdd-96cd-ef7590b718b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:06.429710 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd5056-c2a5-4bdd-96cd-ef7590b718b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:06.430431 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd5056-c2a5-4bdd-96cd-ef7590b718b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:06.430737 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd5056-c2a5-4bdd-96cd-ef7590b718b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:06.432337 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd5056-c2a5-4bdd-96cd-ef7590b718b1 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:06.444498 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 523/1038] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:06.449761 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff502a9-1f14-40a9-8cb5-a9f2885510b7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:06.460290 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff502a9-1f14-40a9-8cb5-a9f2885510b7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:06.464876 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94325ef8-663c-4a56-804d-061af554c98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:06.465650 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94325ef8-663c-4a56-804d-061af554c98f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:06.465929 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94325ef8-663c-4a56-804d-061af554c98f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:06.466198 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94325ef8-663c-4a56-804d-061af554c98f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:06.474374 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94325ef8-663c-4a56-804d-061af554c98f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:06.476448 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94325ef8-663c-4a56-804d-061af554c98f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:06.490490 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-94325ef8-663c-4a56-804d-061af554c98f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 08 16:30:06.491886 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 516/1039] 10.222.0.35 () {56 vars in 1114 bytes} [Tue Feb 8 16:30:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:06.497350 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd5056-c2a5-4bdd-96cd-ef7590b718b1 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:06.508362 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd5056-c2a5-4bdd-96cd-ef7590b718b1 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:06.513200 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac118fdc-afe9-4a23-a633-45f428ad5aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:06.514725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac118fdc-afe9-4a23-a633-45f428ad5aed admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:06.515219 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac118fdc-afe9-4a23-a633-45f428ad5aed admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:06.515562 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac118fdc-afe9-4a23-a633-45f428ad5aed admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:06.516780 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac118fdc-afe9-4a23-a633-45f428ad5aed admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:06.517166 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac118fdc-afe9-4a23-a633-45f428ad5aed admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:06.519100 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac118fdc-afe9-4a23-a633-45f428ad5aed admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:06.537867 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 524/1040] 10.222.0.35 () {56 vars in 1154 bytes} [Tue Feb 8 16:30:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:06.543282 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94325ef8-663c-4a56-804d-061af554c98f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:06.553527 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94325ef8-663c-4a56-804d-061af554c98f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:06.558015 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58a6d2-9309-4733-8b6f-6da6dad7a3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:06.558638 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58a6d2-9309-4733-8b6f-6da6dad7a3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:06.558917 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58a6d2-9309-4733-8b6f-6da6dad7a3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:06.559192 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58a6d2-9309-4733-8b6f-6da6dad7a3f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:06.567063 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58a6d2-9309-4733-8b6f-6da6dad7a3f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:06.568835 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58a6d2-9309-4733-8b6f-6da6dad7a3f7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:06.578468 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 517/1041] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:30:06 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:30:06.583873 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac118fdc-afe9-4a23-a633-45f428ad5aed admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:06.594542 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac118fdc-afe9-4a23-a633-45f428ad5aed admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:06.599189 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815e3b2-cad5-4e16-844c-28bf24c85735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:06.600070 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815e3b2-cad5-4e16-844c-28bf24c85735 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:06.600419 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815e3b2-cad5-4e16-844c-28bf24c85735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:06.600764 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815e3b2-cad5-4e16-844c-28bf24c85735 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:06.611086 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815e3b2-cad5-4e16-844c-28bf24c85735 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:06.612915 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815e3b2-cad5-4e16-844c-28bf24c85735 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:06.629424 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-f815e3b2-cad5-4e16-844c-28bf24c85735 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:30:06.630745 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 525/1042] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:06.636114 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58a6d2-9309-4733-8b6f-6da6dad7a3f7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:06.648843 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58a6d2-9309-4733-8b6f-6da6dad7a3f7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:06.655026 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be42991-45be-4253-b8a5-dfc5d53472de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:06.655947 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be42991-45be-4253-b8a5-dfc5d53472de admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:06.656447 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be42991-45be-4253-b8a5-dfc5d53472de admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:06.656923 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be42991-45be-4253-b8a5-dfc5d53472de admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:06.657903 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be42991-45be-4253-b8a5-dfc5d53472de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:06.658425 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be42991-45be-4253-b8a5-dfc5d53472de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:06.660283 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be42991-45be-4253-b8a5-dfc5d53472de admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:06.673087 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 518/1043] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:06.680876 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815e3b2-cad5-4e16-844c-28bf24c85735 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:06.692131 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815e3b2-cad5-4e16-844c-28bf24c85735 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:06.699283 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01255e18-e430-4cdc-b949-bdbdbca88d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:06.704003 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01255e18-e430-4cdc-b949-bdbdbca88d7a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:06.704003 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01255e18-e430-4cdc-b949-bdbdbca88d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:06.704003 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01255e18-e430-4cdc-b949-bdbdbca88d7a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:06.713055 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01255e18-e430-4cdc-b949-bdbdbca88d7a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:06.715529 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01255e18-e430-4cdc-b949-bdbdbca88d7a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:06.730085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-01255e18-e430-4cdc-b949-bdbdbca88d7a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:30:06.731972 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 526/1044] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:30:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:06.738258 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be42991-45be-4253-b8a5-dfc5d53472de admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:06.749846 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be42991-45be-4253-b8a5-dfc5d53472de admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:06.755310 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd508b8c-2bc9-4068-aabf-1400096538ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:06.756313 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd508b8c-2bc9-4068-aabf-1400096538ef admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:06.756836 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd508b8c-2bc9-4068-aabf-1400096538ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:06.757315 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd508b8c-2bc9-4068-aabf-1400096538ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:06.758388 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd508b8c-2bc9-4068-aabf-1400096538ef admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:06.758897 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd508b8c-2bc9-4068-aabf-1400096538ef admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:06.761204 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd508b8c-2bc9-4068-aabf-1400096538ef admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:06.775224 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 519/1045] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:30:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:06.782749 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01255e18-e430-4cdc-b949-bdbdbca88d7a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:06.796365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01255e18-e430-4cdc-b949-bdbdbca88d7a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:06.800745 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59312f-0dbf-4b2d-8a6d-8ec80696c980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:06.801518 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59312f-0dbf-4b2d-8a6d-8ec80696c980 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:06.801899 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59312f-0dbf-4b2d-8a6d-8ec80696c980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:06.802272 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59312f-0dbf-4b2d-8a6d-8ec80696c980 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:06.803208 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59312f-0dbf-4b2d-8a6d-8ec80696c980 admin admin] RBAC: Adding query filter params (role.id=347979f7c2ac478c96b4781b6eea1a29, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=ccb02e5d8ef14f8f85bbacfa5b1f5be3) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:06.803619 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59312f-0dbf-4b2d-8a6d-8ec80696c980 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:06.805580 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59312f-0dbf-4b2d-8a6d-8ec80696c980 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:06.812717 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 527/1046] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:30:06 2022] GET /identity/v3/role_assignments?user.id=ccb02e5d8ef14f8f85bbacfa5b1f5be3&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=347979f7c2ac478c96b4781b6eea1a29 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:07.667375 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a150f8-e3f8-443f-888d-7ba4100cd633 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:07.667910 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a150f8-e3f8-443f-888d-7ba4100cd633 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:07.667910 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a150f8-e3f8-443f-888d-7ba4100cd633 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:07.669980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 520/1047] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:07.675360 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27db2c6-d6f2-4a63-8602-75cd277eb956 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:07.675828 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27db2c6-d6f2-4a63-8602-75cd277eb956 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:07.676037 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27db2c6-d6f2-4a63-8602-75cd277eb956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:07.693805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-c27db2c6-d6f2-4a63-8602-75cd277eb956 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:07.694976 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-c27db2c6-d6f2-4a63-8602-75cd277eb956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:07.703427 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 528/1048] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:07 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:30:07.726128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a150f8-e3f8-443f-888d-7ba4100cd633 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:07.739546 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a150f8-e3f8-443f-888d-7ba4100cd633 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:07.744032 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdfba6-2ae4-4405-81ba-22908e40613c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:07.744732 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdfba6-2ae4-4405-81ba-22908e40613c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:07.745084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdfba6-2ae4-4405-81ba-22908e40613c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:07.745426 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdfba6-2ae4-4405-81ba-22908e40613c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:07.755932 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdfba6-2ae4-4405-81ba-22908e40613c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:07.757676 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdfba6-2ae4-4405-81ba-22908e40613c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:07.769343 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 521/1049] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:30:07 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:30:07.775426 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27db2c6-d6f2-4a63-8602-75cd277eb956 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:07.785063 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27db2c6-d6f2-4a63-8602-75cd277eb956 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:07.789702 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73f2bc-aa2e-4d19-bc72-e8e142f13870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:07.790484 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73f2bc-aa2e-4d19-bc72-e8e142f13870 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:07.790763 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73f2bc-aa2e-4d19-bc72-e8e142f13870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:07.791038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73f2bc-aa2e-4d19-bc72-e8e142f13870 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:07.792251 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73f2bc-aa2e-4d19-bc72-e8e142f13870 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:07.793922 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73f2bc-aa2e-4d19-bc72-e8e142f13870 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:07.796407 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 529/1050] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:30:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:08.290456 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805ec5a-941c-4c01-80bc-85507418b573 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:08.290743 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805ec5a-941c-4c01-80bc-85507418b573 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:08.291030 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805ec5a-941c-4c01-80bc-85507418b573 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:08.292850 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 522/1051] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:08.298557 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb6a32-6687-4c10-8a51-758a7fd13a18 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:08.298845 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb6a32-6687-4c10-8a51-758a7fd13a18 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:08.299123 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb6a32-6687-4c10-8a51-758a7fd13a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:08.320005 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-49cb6a32-6687-4c10-8a51-758a7fd13a18 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:08.321278 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-49cb6a32-6687-4c10-8a51-758a7fd13a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:08.329833 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 530/1052] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:08 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:08.355338 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805ec5a-941c-4c01-80bc-85507418b573 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:08.367514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805ec5a-941c-4c01-80bc-85507418b573 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:08.371845 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093a401-b70b-44b9-ab82-882f030bca95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:08.373339 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093a401-b70b-44b9-ab82-882f030bca95 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:08.373680 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093a401-b70b-44b9-ab82-882f030bca95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:08.374256 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093a401-b70b-44b9-ab82-882f030bca95 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:08.378010 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093a401-b70b-44b9-ab82-882f030bca95 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:08.378010 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093a401-b70b-44b9-ab82-882f030bca95 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:08.378799 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 523/1053] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:30:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:08.384648 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb6a32-6687-4c10-8a51-758a7fd13a18 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:08.394597 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb6a32-6687-4c10-8a51-758a7fd13a18 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:08.399101 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb50b38-9205-45db-ad79-bbd7a8e00b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:08.399746 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb50b38-9205-45db-ad79-bbd7a8e00b31 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:08.400064 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb50b38-9205-45db-ad79-bbd7a8e00b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:08.400338 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb50b38-9205-45db-ad79-bbd7a8e00b31 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:08.401058 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb50b38-9205-45db-ad79-bbd7a8e00b31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:08.402949 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb50b38-9205-45db-ad79-bbd7a8e00b31 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:08.424313 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 531/1054] 10.222.0.35 () {60 vars in 1153 bytes} [Tue Feb 8 16:30:08 2022] POST /identity/v3/users => generated 285 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:30:09.124581 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9eeab-4f85-4bca-86b4-c47fe8dc3d00 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:09.125138 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9eeab-4f85-4bca-86b4-c47fe8dc3d00 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:09.125138 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9eeab-4f85-4bca-86b4-c47fe8dc3d00 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:09.126928 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 524/1055] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:30:09.132297 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054ee2c-a31a-46e2-90dd-cac48a21985e None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:09.132688 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054ee2c-a31a-46e2-90dd-cac48a21985e None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:09.132861 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054ee2c-a31a-46e2-90dd-cac48a21985e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:09.150685 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-d054ee2c-a31a-46e2-90dd-cac48a21985e None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:09.151997 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d054ee2c-a31a-46e2-90dd-cac48a21985e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:09.163655 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 532/1056] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:09 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:09.187452 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9eeab-4f85-4bca-86b4-c47fe8dc3d00 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:09.199397 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9eeab-4f85-4bca-86b4-c47fe8dc3d00 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:09.204031 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168de37-7dfd-4e00-936b-a9cb3757d36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:09.204836 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168de37-7dfd-4e00-936b-a9cb3757d36e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:09.205114 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168de37-7dfd-4e00-936b-a9cb3757d36e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:09.205384 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168de37-7dfd-4e00-936b-a9cb3757d36e admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:09.215312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168de37-7dfd-4e00-936b-a9cb3757d36e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:30:09.223270 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-f168de37-7dfd-4e00-936b-a9cb3757d36e admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 08 16:30:09.224448 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 525/1057] 10.222.0.35 () {56 vars in 1141 bytes} [Tue Feb 8 16:30:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:09.230224 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054ee2c-a31a-46e2-90dd-cac48a21985e None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:09.240029 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054ee2c-a31a-46e2-90dd-cac48a21985e None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:09.244592 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1489983-3380-405f-9588-235ff57b62f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:09.245237 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1489983-3380-405f-9588-235ff57b62f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:09.245515 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1489983-3380-405f-9588-235ff57b62f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:09.245789 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1489983-3380-405f-9588-235ff57b62f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:09.246546 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1489983-3380-405f-9588-235ff57b62f7 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:09.246850 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1489983-3380-405f-9588-235ff57b62f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:09.248538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1489983-3380-405f-9588-235ff57b62f7 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:09.260999 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 533/1058] 10.222.0.35 () {56 vars in 1136 bytes} [Tue Feb 8 16:30:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:09.262225 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168de37-7dfd-4e00-936b-a9cb3757d36e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:09.273169 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168de37-7dfd-4e00-936b-a9cb3757d36e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:09.277631 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1e81e-8c4d-42ed-bbd9-8e2c18e69be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:09.278391 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1e81e-8c4d-42ed-bbd9-8e2c18e69be3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:09.278672 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1e81e-8c4d-42ed-bbd9-8e2c18e69be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:09.279431 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1e81e-8c4d-42ed-bbd9-8e2c18e69be3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:09.289759 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1e81e-8c4d-42ed-bbd9-8e2c18e69be3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:09.291603 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1e81e-8c4d-42ed-bbd9-8e2c18e69be3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:09.308309 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-03c1e81e-8c4d-42ed-bbd9-8e2c18e69be3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:30:09.309699 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 526/1059] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:09.315172 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1489983-3380-405f-9588-235ff57b62f7 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:09.325068 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1489983-3380-405f-9588-235ff57b62f7 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:09.330047 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789852a4-b716-4289-848a-9c7ba274987f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:09.330676 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789852a4-b716-4289-848a-9c7ba274987f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:09.330953 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789852a4-b716-4289-848a-9c7ba274987f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:09.331222 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789852a4-b716-4289-848a-9c7ba274987f admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:09.331973 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789852a4-b716-4289-848a-9c7ba274987f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:09.332273 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789852a4-b716-4289-848a-9c7ba274987f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:09.333842 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789852a4-b716-4289-848a-9c7ba274987f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:09.345832 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 534/1060] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:30:09.351549 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1e81e-8c4d-42ed-bbd9-8e2c18e69be3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:09.361287 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1e81e-8c4d-42ed-bbd9-8e2c18e69be3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:09.365812 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d01595-731e-4eec-913c-b70a1bad9033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:09.366551 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d01595-731e-4eec-913c-b70a1bad9033 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:09.366832 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d01595-731e-4eec-913c-b70a1bad9033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:09.367107 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d01595-731e-4eec-913c-b70a1bad9033 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:09.374771 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d01595-731e-4eec-913c-b70a1bad9033 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:09.376774 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d01595-731e-4eec-913c-b70a1bad9033 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:09.391338 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-09d01595-731e-4eec-913c-b70a1bad9033 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 08 16:30:09.392757 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 527/1061] 10.222.0.35 () {56 vars in 1114 bytes} [Tue Feb 8 16:30:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:09.398485 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789852a4-b716-4289-848a-9c7ba274987f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:09.408811 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789852a4-b716-4289-848a-9c7ba274987f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:09.413335 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984855f5-58a5-4ace-a0ac-eed70373e074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:09.413975 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984855f5-58a5-4ace-a0ac-eed70373e074 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:09.414256 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984855f5-58a5-4ace-a0ac-eed70373e074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:09.414530 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984855f5-58a5-4ace-a0ac-eed70373e074 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:09.415374 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984855f5-58a5-4ace-a0ac-eed70373e074 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:09.415682 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984855f5-58a5-4ace-a0ac-eed70373e074 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:09.417551 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984855f5-58a5-4ace-a0ac-eed70373e074 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:09.434441 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 535/1062] 10.222.0.35 () {56 vars in 1154 bytes} [Tue Feb 8 16:30:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:09.439791 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d01595-731e-4eec-913c-b70a1bad9033 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:09.449209 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d01595-731e-4eec-913c-b70a1bad9033 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:09.454311 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbda07-0839-45fd-8745-ccef49c818bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:09.455068 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbda07-0839-45fd-8745-ccef49c818bd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:09.455345 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbda07-0839-45fd-8745-ccef49c818bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:09.455613 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbda07-0839-45fd-8745-ccef49c818bd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:09.465478 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbda07-0839-45fd-8745-ccef49c818bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:09.468044 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbda07-0839-45fd-8745-ccef49c818bd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:09.486680 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-02dbda07-0839-45fd-8745-ccef49c818bd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:30:09.487991 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 528/1063] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:09.493552 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984855f5-58a5-4ace-a0ac-eed70373e074 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:09.503904 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984855f5-58a5-4ace-a0ac-eed70373e074 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:09.508311 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c18fe6-6710-4814-bad6-136f0cd2581d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:09.508944 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c18fe6-6710-4814-bad6-136f0cd2581d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:09.509220 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c18fe6-6710-4814-bad6-136f0cd2581d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:09.509491 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c18fe6-6710-4814-bad6-136f0cd2581d admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:09.510212 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c18fe6-6710-4814-bad6-136f0cd2581d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:09.510521 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c18fe6-6710-4814-bad6-136f0cd2581d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:09.512113 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c18fe6-6710-4814-bad6-136f0cd2581d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:09.523978 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 536/1064] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:09.529497 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbda07-0839-45fd-8745-ccef49c818bd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:09.538893 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbda07-0839-45fd-8745-ccef49c818bd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:09.543320 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f26c4-2107-4a33-97b1-9efbe5f68446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:09.544113 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f26c4-2107-4a33-97b1-9efbe5f68446 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:09.544906 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f26c4-2107-4a33-97b1-9efbe5f68446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:09.545183 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f26c4-2107-4a33-97b1-9efbe5f68446 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:09.552095 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f26c4-2107-4a33-97b1-9efbe5f68446 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:09.554058 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f26c4-2107-4a33-97b1-9efbe5f68446 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:09.567229 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-697f26c4-2107-4a33-97b1-9efbe5f68446 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:30:09.568409 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 529/1065] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:30:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:09.574130 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c18fe6-6710-4814-bad6-136f0cd2581d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:09.583876 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c18fe6-6710-4814-bad6-136f0cd2581d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:09.589466 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ae565-9e12-4773-94d0-856359f38830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:09.590108 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ae565-9e12-4773-94d0-856359f38830 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:09.590383 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ae565-9e12-4773-94d0-856359f38830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:09.590656 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ae565-9e12-4773-94d0-856359f38830 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:09.591489 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ae565-9e12-4773-94d0-856359f38830 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:09.591996 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ae565-9e12-4773-94d0-856359f38830 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:09.593822 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ae565-9e12-4773-94d0-856359f38830 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:09.607885 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 537/1066] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:30:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:09.614072 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f26c4-2107-4a33-97b1-9efbe5f68446 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:09.625084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f26c4-2107-4a33-97b1-9efbe5f68446 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:09.629467 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d6966-a007-418f-8a71-1e5dd1e28e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:09.630321 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d6966-a007-418f-8a71-1e5dd1e28e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:09.630592 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d6966-a007-418f-8a71-1e5dd1e28e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:09.630856 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d6966-a007-418f-8a71-1e5dd1e28e03 admin admin] PATH_INFO: `/v3/projects/6b01069799b34858bbebc201a3f2046d/users/ccb02e5d8ef14f8f85bbacfa5b1f5be3/roles/347979f7c2ac478c96b4781b6eea1a29` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:09.633062 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d6966-a007-418f-8a71-1e5dd1e28e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b01069799b34858bbebc201a3f2046d, user_id=ccb02e5d8ef14f8f85bbacfa5b1f5be3, role_id=347979f7c2ac478c96b4781b6eea1a29)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:09.635662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d6966-a007-418f-8a71-1e5dd1e28e03 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:09.660028 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 530/1067] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:30:09 2022] PUT /identity/v3/projects/6b01069799b34858bbebc201a3f2046d/users/ccb02e5d8ef14f8f85bbacfa5b1f5be3/roles/347979f7c2ac478c96b4781b6eea1a29 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:30:10.724231 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95a029-a6ab-42cd-a410-ceb8f41c10c7 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:10.724737 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95a029-a6ab-42cd-a410-ceb8f41c10c7 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:10.724737 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95a029-a6ab-42cd-a410-ceb8f41c10c7 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:10.726467 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 538/1068] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:10.732148 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1f3ad-07af-410a-a490-ff0041edec94 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:10.732662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1f3ad-07af-410a-a490-ff0041edec94 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:10.732980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1f3ad-07af-410a-a490-ff0041edec94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:10.761127 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-a0f1f3ad-07af-410a-a490-ff0041edec94 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:10.762375 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a0f1f3ad-07af-410a-a490-ff0041edec94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:10.831700 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 531/1069] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:10 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:10.856237 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95a029-a6ab-42cd-a410-ceb8f41c10c7 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:10.874155 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95a029-a6ab-42cd-a410-ceb8f41c10c7 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:10.878866 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092504a5-c932-4832-abc6-51e9ff76b07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:10.879733 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092504a5-c932-4832-abc6-51e9ff76b07a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:10.880050 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092504a5-c932-4832-abc6-51e9ff76b07a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:10.880323 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092504a5-c932-4832-abc6-51e9ff76b07a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:10.891291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092504a5-c932-4832-abc6-51e9ff76b07a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:30:10.901268 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-092504a5-c932-4832-abc6-51e9ff76b07a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:30:10.902472 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 539/1070] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:30:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:10.908528 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1f3ad-07af-410a-a490-ff0041edec94 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:10.917576 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1f3ad-07af-410a-a490-ff0041edec94 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:10.922797 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec6c8e-de6f-446c-b6b2-02f56d72015b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:10.923455 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec6c8e-de6f-446c-b6b2-02f56d72015b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:10.923739 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec6c8e-de6f-446c-b6b2-02f56d72015b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:10.924059 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec6c8e-de6f-446c-b6b2-02f56d72015b admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:10.924815 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec6c8e-de6f-446c-b6b2-02f56d72015b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:10.925231 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec6c8e-de6f-446c-b6b2-02f56d72015b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:10.926894 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec6c8e-de6f-446c-b6b2-02f56d72015b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:10.942870 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 532/1071] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:30:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:10.943046 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092504a5-c932-4832-abc6-51e9ff76b07a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:10.953061 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092504a5-c932-4832-abc6-51e9ff76b07a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:10.957582 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bde93-b2b7-4408-bf64-608a4c0e7241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:10.958427 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bde93-b2b7-4408-bf64-608a4c0e7241 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:10.958705 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bde93-b2b7-4408-bf64-608a4c0e7241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:10.958981 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bde93-b2b7-4408-bf64-608a4c0e7241 admin admin] PATH_INFO: `/v3/users/8adf869102fe4357ba5e1264804d5be9` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:10.974191 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bde93-b2b7-4408-bf64-608a4c0e7241 admin admin] RBAC: Authorizing `identity:get_user(user_id=8adf869102fe4357ba5e1264804d5be9)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:10.976515 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bde93-b2b7-4408-bf64-608a4c0e7241 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:10.978399 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 540/1072] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:30:10 2022] GET /identity/v3/users/8adf869102fe4357ba5e1264804d5be9 => generated 285 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:10.984454 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec6c8e-de6f-446c-b6b2-02f56d72015b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:10.994542 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec6c8e-de6f-446c-b6b2-02f56d72015b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:10.999931 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b330eb-34b9-4444-9af7-7853ee5195c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:11.000561 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b330eb-34b9-4444-9af7-7853ee5195c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:11.000840 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b330eb-34b9-4444-9af7-7853ee5195c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:11.001112 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b330eb-34b9-4444-9af7-7853ee5195c1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:11.010306 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b330eb-34b9-4444-9af7-7853ee5195c1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:11.012102 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b330eb-34b9-4444-9af7-7853ee5195c1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:11.021718 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 533/1073] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:30:10 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:30:11.027472 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bde93-b2b7-4408-bf64-608a4c0e7241 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:11.037307 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bde93-b2b7-4408-bf64-608a4c0e7241 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:11.042239 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa151a-6b1f-43d0-ba14-009e26cc9b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:11.043058 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa151a-6b1f-43d0-ba14-009e26cc9b50 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:11.043329 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa151a-6b1f-43d0-ba14-009e26cc9b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:11.043596 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa151a-6b1f-43d0-ba14-009e26cc9b50 admin admin] PATH_INFO: `/v3/projects/eb0620447f0342c3bb5e4c872c1e302a` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:11.045296 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa151a-6b1f-43d0-ba14-009e26cc9b50 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb0620447f0342c3bb5e4c872c1e302a)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:11.047376 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa151a-6b1f-43d0-ba14-009e26cc9b50 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:11.049053 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 541/1074] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:30:11 2022] GET /identity/v3/projects/eb0620447f0342c3bb5e4c872c1e302a => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:11.055047 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b330eb-34b9-4444-9af7-7853ee5195c1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:11.064531 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b330eb-34b9-4444-9af7-7853ee5195c1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:11.069075 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ed5db-7ee3-441b-a23c-75966e94910c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:11.069698 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ed5db-7ee3-441b-a23c-75966e94910c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:11.069980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ed5db-7ee3-441b-a23c-75966e94910c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:11.070259 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ed5db-7ee3-441b-a23c-75966e94910c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:11.071096 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ed5db-7ee3-441b-a23c-75966e94910c admin admin] RBAC: Adding query filter params (role.id=e6d18df5c4e74dfd8ebd9c636f45936e, scope.project.id=eb0620447f0342c3bb5e4c872c1e302a, user.id=8adf869102fe4357ba5e1264804d5be9) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:11.071408 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ed5db-7ee3-441b-a23c-75966e94910c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:11.073335 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ed5db-7ee3-441b-a23c-75966e94910c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:11.080349 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 534/1075] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:30:11 2022] GET /identity/v3/role_assignments?user.id=8adf869102fe4357ba5e1264804d5be9&scope.project.id=eb0620447f0342c3bb5e4c872c1e302a&role.id=e6d18df5c4e74dfd8ebd9c636f45936e => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:11.867397 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16627347-78e1-4106-9858-29e6d751e184 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:11.867957 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16627347-78e1-4106-9858-29e6d751e184 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:11.867957 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16627347-78e1-4106-9858-29e6d751e184 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:11.870440 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 542/1076] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:11.878428 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4086d-8380-4b21-8569-9e93269108cf None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:11.878428 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4086d-8380-4b21-8569-9e93269108cf None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:11.878428 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4086d-8380-4b21-8569-9e93269108cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:11.896335 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-4bb4086d-8380-4b21-8569-9e93269108cf None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:11.897648 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4bb4086d-8380-4b21-8569-9e93269108cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:11.907795 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 535/1077] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:11 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:11.930625 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16627347-78e1-4106-9858-29e6d751e184 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:11.947874 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16627347-78e1-4106-9858-29e6d751e184 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:11.952552 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d13f9c-c89d-4446-a7e8-01c8961a0d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:11.953342 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d13f9c-c89d-4446-a7e8-01c8961a0d3a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:11.953622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d13f9c-c89d-4446-a7e8-01c8961a0d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:11.953905 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d13f9c-c89d-4446-a7e8-01c8961a0d3a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:11.965763 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d13f9c-c89d-4446-a7e8-01c8961a0d3a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:30:11.979941 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-a1d13f9c-c89d-4446-a7e8-01c8961a0d3a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 08 16:30:11.982945 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 543/1078] 10.222.0.35 () {56 vars in 1141 bytes} [Tue Feb 8 16:30:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:11.991398 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4086d-8380-4b21-8569-9e93269108cf None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:12.005739 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4086d-8380-4b21-8569-9e93269108cf None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:12.012537 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b257241-a67f-4199-8268-3e3a8b382a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:12.013577 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b257241-a67f-4199-8268-3e3a8b382a5c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:12.014022 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b257241-a67f-4199-8268-3e3a8b382a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:12.014447 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b257241-a67f-4199-8268-3e3a8b382a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:12.015700 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b257241-a67f-4199-8268-3e3a8b382a5c admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:12.016213 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b257241-a67f-4199-8268-3e3a8b382a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:12.019144 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b257241-a67f-4199-8268-3e3a8b382a5c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:12.032858 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 536/1079] 10.222.0.35 () {56 vars in 1136 bytes} [Tue Feb 8 16:30:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:12.041190 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d13f9c-c89d-4446-a7e8-01c8961a0d3a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:12.059243 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d13f9c-c89d-4446-a7e8-01c8961a0d3a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:12.066699 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27856e-b31d-4f24-8b5e-3b7e21875f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:12.067997 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27856e-b31d-4f24-8b5e-3b7e21875f8f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:12.068470 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27856e-b31d-4f24-8b5e-3b7e21875f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:12.068954 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27856e-b31d-4f24-8b5e-3b7e21875f8f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:12.086112 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27856e-b31d-4f24-8b5e-3b7e21875f8f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:12.089376 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27856e-b31d-4f24-8b5e-3b7e21875f8f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:12.117370 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-7b27856e-b31d-4f24-8b5e-3b7e21875f8f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:30:12.119415 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 544/1080] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:30:12.129023 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b257241-a67f-4199-8268-3e3a8b382a5c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:12.138632 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b257241-a67f-4199-8268-3e3a8b382a5c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:12.143364 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023cd525-9c12-4867-909f-49c85007cc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:12.144035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cd525-9c12-4867-909f-49c85007cc7a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:12.144315 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cd525-9c12-4867-909f-49c85007cc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:12.144580 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cd525-9c12-4867-909f-49c85007cc7a admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:12.145302 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023cd525-9c12-4867-909f-49c85007cc7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:12.145604 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023cd525-9c12-4867-909f-49c85007cc7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:12.148745 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023cd525-9c12-4867-909f-49c85007cc7a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:12.162371 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 537/1081] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:12.167968 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27856e-b31d-4f24-8b5e-3b7e21875f8f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:12.179077 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27856e-b31d-4f24-8b5e-3b7e21875f8f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:12.184622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0cc1c-951d-4ae5-8273-250f716024e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:12.184622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0cc1c-951d-4ae5-8273-250f716024e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:12.184622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0cc1c-951d-4ae5-8273-250f716024e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:12.184886 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0cc1c-951d-4ae5-8273-250f716024e5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:12.197929 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0cc1c-951d-4ae5-8273-250f716024e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:12.199520 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0cc1c-951d-4ae5-8273-250f716024e5 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:12.215746 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-67a0cc1c-951d-4ae5-8273-250f716024e5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 08 16:30:12.217905 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 545/1082] 10.222.0.35 () {56 vars in 1114 bytes} [Tue Feb 8 16:30:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:12.223458 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023cd525-9c12-4867-909f-49c85007cc7a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:12.234125 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023cd525-9c12-4867-909f-49c85007cc7a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:12.238774 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a873973-be65-4bf8-a53c-2b122890b12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:12.239482 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a873973-be65-4bf8-a53c-2b122890b12b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:12.239857 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a873973-be65-4bf8-a53c-2b122890b12b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:12.240195 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a873973-be65-4bf8-a53c-2b122890b12b admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:12.241098 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a873973-be65-4bf8-a53c-2b122890b12b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:12.241469 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a873973-be65-4bf8-a53c-2b122890b12b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:12.243351 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a873973-be65-4bf8-a53c-2b122890b12b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:12.261645 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 538/1083] 10.222.0.35 () {56 vars in 1154 bytes} [Tue Feb 8 16:30:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:30:12.268483 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0cc1c-951d-4ae5-8273-250f716024e5 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:12.278303 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0cc1c-951d-4ae5-8273-250f716024e5 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:12.283054 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4170b4-f4ef-4663-b06e-f294b9cf9ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:12.283688 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4170b4-f4ef-4663-b06e-f294b9cf9ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:12.284011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4170b4-f4ef-4663-b06e-f294b9cf9ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:12.284288 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4170b4-f4ef-4663-b06e-f294b9cf9ab5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:12.292194 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4170b4-f4ef-4663-b06e-f294b9cf9ab5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:12.293925 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4170b4-f4ef-4663-b06e-f294b9cf9ab5 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:12.303567 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 546/1084] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:30:12 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:30:12.309283 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a873973-be65-4bf8-a53c-2b122890b12b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:12.321788 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a873973-be65-4bf8-a53c-2b122890b12b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:12.326366 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51536354-1393-46ab-a7c0-d389d95ac18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:12.327135 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51536354-1393-46ab-a7c0-d389d95ac18c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:12.327417 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51536354-1393-46ab-a7c0-d389d95ac18c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:12.327691 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51536354-1393-46ab-a7c0-d389d95ac18c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:12.337993 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51536354-1393-46ab-a7c0-d389d95ac18c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:12.339928 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51536354-1393-46ab-a7c0-d389d95ac18c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:12.356234 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-51536354-1393-46ab-a7c0-d389d95ac18c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:30:12.358100 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 539/1085] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:30:12.364609 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4170b4-f4ef-4663-b06e-f294b9cf9ab5 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:12.375339 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4170b4-f4ef-4663-b06e-f294b9cf9ab5 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:12.380082 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624cc0d-211f-465f-8aa0-61b7307d119b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:12.380797 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624cc0d-211f-465f-8aa0-61b7307d119b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:12.381150 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624cc0d-211f-465f-8aa0-61b7307d119b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:12.381515 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624cc0d-211f-465f-8aa0-61b7307d119b admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:12.382308 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624cc0d-211f-465f-8aa0-61b7307d119b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:12.382709 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624cc0d-211f-465f-8aa0-61b7307d119b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:12.384398 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624cc0d-211f-465f-8aa0-61b7307d119b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:12.401684 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 547/1086] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:30:12.402483 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51536354-1393-46ab-a7c0-d389d95ac18c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:12.412232 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51536354-1393-46ab-a7c0-d389d95ac18c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:12.416720 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd924c-0fca-4585-a544-98ca65f78a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:12.417480 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd924c-0fca-4585-a544-98ca65f78a6e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:12.417763 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd924c-0fca-4585-a544-98ca65f78a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:12.418040 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd924c-0fca-4585-a544-98ca65f78a6e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:12.425447 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd924c-0fca-4585-a544-98ca65f78a6e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:12.427400 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd924c-0fca-4585-a544-98ca65f78a6e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:12.440555 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-4bdd924c-0fca-4585-a544-98ca65f78a6e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:30:12.441674 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 540/1087] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:30:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:12.447247 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624cc0d-211f-465f-8aa0-61b7307d119b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:12.456875 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624cc0d-211f-465f-8aa0-61b7307d119b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:12.461608 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50740aee-d96e-4502-901f-e151a866cdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:12.462244 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50740aee-d96e-4502-901f-e151a866cdaa admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:12.462527 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50740aee-d96e-4502-901f-e151a866cdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:12.462802 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50740aee-d96e-4502-901f-e151a866cdaa admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:12.463592 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50740aee-d96e-4502-901f-e151a866cdaa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:12.463941 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50740aee-d96e-4502-901f-e151a866cdaa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:12.465757 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50740aee-d96e-4502-901f-e151a866cdaa admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:12.479957 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 548/1088] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:30:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:30:12.485124 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd924c-0fca-4585-a544-98ca65f78a6e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:12.495682 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd924c-0fca-4585-a544-98ca65f78a6e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:12.501165 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839e637-cbe6-4a88-9906-1f4c8ce03f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:12.501800 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839e637-cbe6-4a88-9906-1f4c8ce03f04 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:12.502084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839e637-cbe6-4a88-9906-1f4c8ce03f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:12.502366 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839e637-cbe6-4a88-9906-1f4c8ce03f04 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:12.503386 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839e637-cbe6-4a88-9906-1f4c8ce03f04 admin admin] RBAC: Adding query filter params (role.id=347979f7c2ac478c96b4781b6eea1a29, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=ccb02e5d8ef14f8f85bbacfa5b1f5be3) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:12.503701 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839e637-cbe6-4a88-9906-1f4c8ce03f04 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:12.505613 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839e637-cbe6-4a88-9906-1f4c8ce03f04 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:12.512347 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 541/1089] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:30:12 2022] GET /identity/v3/role_assignments?user.id=ccb02e5d8ef14f8f85bbacfa5b1f5be3&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=347979f7c2ac478c96b4781b6eea1a29 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:13.312028 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4f669-7a1f-48cd-babc-998ab336cd4a None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:13.312028 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4f669-7a1f-48cd-babc-998ab336cd4a None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:13.312028 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4f669-7a1f-48cd-babc-998ab336cd4a None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:13.313337 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 549/1090] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:13.318717 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e815ffd-2fd9-4737-bccb-495d3cdebfb0 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:13.319179 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e815ffd-2fd9-4737-bccb-495d3cdebfb0 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:13.319264 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e815ffd-2fd9-4737-bccb-495d3cdebfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:13.344933 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-0e815ffd-2fd9-4737-bccb-495d3cdebfb0 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:13.347416 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0e815ffd-2fd9-4737-bccb-495d3cdebfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:13.356692 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 542/1091] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:13 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:30:13.380234 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4f669-7a1f-48cd-babc-998ab336cd4a None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:13.395859 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4f669-7a1f-48cd-babc-998ab336cd4a None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:13.401346 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc724452-b435-44ba-a919-ecea27213dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:13.402117 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc724452-b435-44ba-a919-ecea27213dab admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:13.402414 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc724452-b435-44ba-a919-ecea27213dab admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:13.402687 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc724452-b435-44ba-a919-ecea27213dab admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:13.415389 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc724452-b435-44ba-a919-ecea27213dab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:30:13.422301 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-bc724452-b435-44ba-a919-ecea27213dab admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:30:13.423506 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 550/1092] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:30:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:30:13.429618 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e815ffd-2fd9-4737-bccb-495d3cdebfb0 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:13.442642 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e815ffd-2fd9-4737-bccb-495d3cdebfb0 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:13.447880 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a55670-6ad2-4be1-8164-97a84c683287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:13.448547 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a55670-6ad2-4be1-8164-97a84c683287 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:13.449241 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a55670-6ad2-4be1-8164-97a84c683287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:13.451600 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a55670-6ad2-4be1-8164-97a84c683287 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:13.451877 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a55670-6ad2-4be1-8164-97a84c683287 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:13.452164 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a55670-6ad2-4be1-8164-97a84c683287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:13.453771 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a55670-6ad2-4be1-8164-97a84c683287 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:13.465688 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 543/1093] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:30:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:13.471905 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc724452-b435-44ba-a919-ecea27213dab admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:13.482388 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc724452-b435-44ba-a919-ecea27213dab admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:13.486920 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423e576-28e9-4256-9201-4d553e1528d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:13.487789 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423e576-28e9-4256-9201-4d553e1528d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:13.488068 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423e576-28e9-4256-9201-4d553e1528d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:13.488340 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423e576-28e9-4256-9201-4d553e1528d2 admin admin] PATH_INFO: `/v3/users/8adf869102fe4357ba5e1264804d5be9` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:13.489557 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423e576-28e9-4256-9201-4d553e1528d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=8adf869102fe4357ba5e1264804d5be9)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:13.491820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423e576-28e9-4256-9201-4d553e1528d2 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:13.493436 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 551/1094] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:30:13 2022] GET /identity/v3/users/8adf869102fe4357ba5e1264804d5be9 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:13.499642 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a55670-6ad2-4be1-8164-97a84c683287 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:13.509222 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a55670-6ad2-4be1-8164-97a84c683287 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:13.514599 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc4314-9025-4d30-ad8e-5fba82990923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:13.515412 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc4314-9025-4d30-ad8e-5fba82990923 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:13.515692 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc4314-9025-4d30-ad8e-5fba82990923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:13.515993 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc4314-9025-4d30-ad8e-5fba82990923 admin admin] PATH_INFO: `/v3/projects/eb0620447f0342c3bb5e4c872c1e302a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:13.517407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc4314-9025-4d30-ad8e-5fba82990923 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb0620447f0342c3bb5e4c872c1e302a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:13.519412 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc4314-9025-4d30-ad8e-5fba82990923 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:13.521054 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 544/1095] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:30:13 2022] GET /identity/v3/projects/eb0620447f0342c3bb5e4c872c1e302a => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:13.526566 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423e576-28e9-4256-9201-4d553e1528d2 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:13.536057 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423e576-28e9-4256-9201-4d553e1528d2 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:13.540502 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c827e-8370-4259-890a-38aa0d5e54a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:13.541350 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c827e-8370-4259-890a-38aa0d5e54a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:13.541628 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c827e-8370-4259-890a-38aa0d5e54a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:13.541900 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c827e-8370-4259-890a-38aa0d5e54a6 admin admin] PATH_INFO: `/v3/projects/eb0620447f0342c3bb5e4c872c1e302a/users/8adf869102fe4357ba5e1264804d5be9/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:13.543866 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c827e-8370-4259-890a-38aa0d5e54a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb0620447f0342c3bb5e4c872c1e302a, user_id=8adf869102fe4357ba5e1264804d5be9, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:13.546596 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c827e-8370-4259-890a-38aa0d5e54a6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:13.560532 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 552/1096] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:30:13 2022] PUT /identity/v3/projects/eb0620447f0342c3bb5e4c872c1e302a/users/8adf869102fe4357ba5e1264804d5be9/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:30:15.779668 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705df177-8481-4cb4-a06b-c19ef0588138 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:15.780309 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705df177-8481-4cb4-a06b-c19ef0588138 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:15.780309 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705df177-8481-4cb4-a06b-c19ef0588138 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:15.781928 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 545/1097] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:15.787336 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0a853-066b-4ece-9b6e-e934fdbe613d None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:15.787804 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0a853-066b-4ece-9b6e-e934fdbe613d None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:15.787927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0a853-066b-4ece-9b6e-e934fdbe613d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:15.805780 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-1ef0a853-066b-4ece-9b6e-e934fdbe613d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:15.806961 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-1ef0a853-066b-4ece-9b6e-e934fdbe613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:15.862169 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 553/1098] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:15 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:15.886209 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705df177-8481-4cb4-a06b-c19ef0588138 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:15.898742 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705df177-8481-4cb4-a06b-c19ef0588138 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:15.903086 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403dca8-503b-467b-8de2-f6613ee8d74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:15.904644 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403dca8-503b-467b-8de2-f6613ee8d74c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:15.904942 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403dca8-503b-467b-8de2-f6613ee8d74c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:15.905220 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403dca8-503b-467b-8de2-f6613ee8d74c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:15.915573 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403dca8-503b-467b-8de2-f6613ee8d74c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:30:15.923174 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-7403dca8-503b-467b-8de2-f6613ee8d74c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:30:15.924384 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 546/1099] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:30:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:15.930234 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0a853-066b-4ece-9b6e-e934fdbe613d None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:15.939150 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0a853-066b-4ece-9b6e-e934fdbe613d None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:15.943543 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c6417-88a9-4e92-be0a-41c57b3c9fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:15.944201 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c6417-88a9-4e92-be0a-41c57b3c9fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:15.944477 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c6417-88a9-4e92-be0a-41c57b3c9fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:15.944744 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c6417-88a9-4e92-be0a-41c57b3c9fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:15.945488 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c6417-88a9-4e92-be0a-41c57b3c9fe8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:15.945787 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c6417-88a9-4e92-be0a-41c57b3c9fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:15.947339 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c6417-88a9-4e92-be0a-41c57b3c9fe8 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:15.955245 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 554/1100] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:30:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:15.960554 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403dca8-503b-467b-8de2-f6613ee8d74c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:15.971596 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403dca8-503b-467b-8de2-f6613ee8d74c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:15.976185 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4673f8-5db5-4db4-9737-a714562d9473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:15.977005 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4673f8-5db5-4db4-9737-a714562d9473 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:15.977287 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4673f8-5db5-4db4-9737-a714562d9473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:15.977556 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4673f8-5db5-4db4-9737-a714562d9473 admin admin] PATH_INFO: `/v3/users/8adf869102fe4357ba5e1264804d5be9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:15.978758 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4673f8-5db5-4db4-9737-a714562d9473 admin admin] RBAC: Authorizing `identity:get_user(user_id=8adf869102fe4357ba5e1264804d5be9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:15.980919 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4673f8-5db5-4db4-9737-a714562d9473 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:15.983234 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 547/1101] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:30:15 2022] GET /identity/v3/users/8adf869102fe4357ba5e1264804d5be9 => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:15.988807 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c6417-88a9-4e92-be0a-41c57b3c9fe8 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:15.998173 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c6417-88a9-4e92-be0a-41c57b3c9fe8 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:16.002633 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab3ac6-b68a-4d1e-b060-a48a94a4c7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:16.003249 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab3ac6-b68a-4d1e-b060-a48a94a4c7da admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:16.003527 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab3ac6-b68a-4d1e-b060-a48a94a4c7da admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:16.003831 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab3ac6-b68a-4d1e-b060-a48a94a4c7da admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:16.011583 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab3ac6-b68a-4d1e-b060-a48a94a4c7da admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:16.013659 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab3ac6-b68a-4d1e-b060-a48a94a4c7da admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:16.022457 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 555/1102] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:30:15 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:30:16.028211 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4673f8-5db5-4db4-9737-a714562d9473 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:16.038959 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4673f8-5db5-4db4-9737-a714562d9473 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:16.043473 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b6a32-9078-4765-8eac-70241c58730d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:16.044973 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b6a32-9078-4765-8eac-70241c58730d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:16.045351 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b6a32-9078-4765-8eac-70241c58730d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:16.045637 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b6a32-9078-4765-8eac-70241c58730d admin admin] PATH_INFO: `/v3/projects/eb0620447f0342c3bb5e4c872c1e302a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:16.046816 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b6a32-9078-4765-8eac-70241c58730d admin admin] RBAC: Authorizing `identity:get_project(project_id=eb0620447f0342c3bb5e4c872c1e302a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:16.048876 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b6a32-9078-4765-8eac-70241c58730d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:16.050513 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 548/1103] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:30:16 2022] GET /identity/v3/projects/eb0620447f0342c3bb5e4c872c1e302a => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:30:16.056177 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab3ac6-b68a-4d1e-b060-a48a94a4c7da admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:16.064840 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab3ac6-b68a-4d1e-b060-a48a94a4c7da admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:16.069284 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051446f-dfb0-4fe4-b464-247d32d49226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:16.069886 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051446f-dfb0-4fe4-b464-247d32d49226 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:16.070163 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051446f-dfb0-4fe4-b464-247d32d49226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:16.070433 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051446f-dfb0-4fe4-b464-247d32d49226 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:16.071241 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051446f-dfb0-4fe4-b464-247d32d49226 admin admin] RBAC: Adding query filter params (role.id=e6d18df5c4e74dfd8ebd9c636f45936e, scope.project.id=eb0620447f0342c3bb5e4c872c1e302a, user.id=8adf869102fe4357ba5e1264804d5be9) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:16.071544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051446f-dfb0-4fe4-b464-247d32d49226 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:16.073377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051446f-dfb0-4fe4-b464-247d32d49226 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:16.079539 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 556/1104] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:30:16 2022] GET /identity/v3/role_assignments?user.id=8adf869102fe4357ba5e1264804d5be9&scope.project.id=eb0620447f0342c3bb5e4c872c1e302a&role.id=e6d18df5c4e74dfd8ebd9c636f45936e => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:18.312077 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b36a71-fcaf-4549-a1eb-3c76560a7d43 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:18.312461 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b36a71-fcaf-4549-a1eb-3c76560a7d43 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:18.312629 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b36a71-fcaf-4549-a1eb-3c76560a7d43 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:18.314392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 549/1105] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:18.319954 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63ebe5-89cb-4e1f-8d0b-c2b271aad00d None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:18.320394 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63ebe5-89cb-4e1f-8d0b-c2b271aad00d None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:18.320486 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63ebe5-89cb-4e1f-8d0b-c2b271aad00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:18.337952 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-cd63ebe5-89cb-4e1f-8d0b-c2b271aad00d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:18.339114 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-cd63ebe5-89cb-4e1f-8d0b-c2b271aad00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:18.346909 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 557/1106] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:18.372096 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b36a71-fcaf-4549-a1eb-3c76560a7d43 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:18.384664 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b36a71-fcaf-4549-a1eb-3c76560a7d43 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:18.388983 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45109d7-d722-4b10-ab46-742e2649e0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:18.389739 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45109d7-d722-4b10-ab46-742e2649e0ac admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:18.390020 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45109d7-d722-4b10-ab46-742e2649e0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:18.390296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45109d7-d722-4b10-ab46-742e2649e0ac admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:18.391710 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45109d7-d722-4b10-ab46-742e2649e0ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:18.393394 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45109d7-d722-4b10-ab46-742e2649e0ac admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:18.394939 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 550/1107] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:30:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:18.400257 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63ebe5-89cb-4e1f-8d0b-c2b271aad00d None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:18.409068 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63ebe5-89cb-4e1f-8d0b-c2b271aad00d None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:18.413481 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c0647-3dfb-4ea3-b8eb-6d699736f0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:18.414117 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c0647-3dfb-4ea3-b8eb-6d699736f0ca admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:18.414391 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c0647-3dfb-4ea3-b8eb-6d699736f0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:18.414661 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c0647-3dfb-4ea3-b8eb-6d699736f0ca admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:18.415380 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c0647-3dfb-4ea3-b8eb-6d699736f0ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:18.417287 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c0647-3dfb-4ea3-b8eb-6d699736f0ca admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:18.437259 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 558/1108] 10.222.0.35 () {60 vars in 1153 bytes} [Tue Feb 8 16:30:18 2022] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:30:20.721553 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60483c1b-f339-4e79-97a5-8c8fe9dd4969 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:20.722051 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60483c1b-f339-4e79-97a5-8c8fe9dd4969 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:20.722051 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60483c1b-f339-4e79-97a5-8c8fe9dd4969 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:20.723959 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 551/1109] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:20.729066 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b8a05-d4b6-4563-8d2d-093e4b352fc6 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:20.729474 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b8a05-d4b6-4563-8d2d-093e4b352fc6 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:20.729628 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b8a05-d4b6-4563-8d2d-093e4b352fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:20.748442 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-0a1b8a05-d4b6-4563-8d2d-093e4b352fc6 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:20.749618 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-0a1b8a05-d4b6-4563-8d2d-093e4b352fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:20.757209 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 559/1110] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:20 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:30:20.781536 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60483c1b-f339-4e79-97a5-8c8fe9dd4969 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:20.793573 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60483c1b-f339-4e79-97a5-8c8fe9dd4969 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:20.798478 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ed1cf-2015-4d27-a0dc-a7cd9d7ef9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:20.799301 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ed1cf-2015-4d27-a0dc-a7cd9d7ef9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:20.799578 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ed1cf-2015-4d27-a0dc-a7cd9d7ef9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:20.799949 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ed1cf-2015-4d27-a0dc-a7cd9d7ef9f0 admin admin] PATH_INFO: `/v3/roles/519f10f80fbd4e108392697b77c2178a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:20.801426 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ed1cf-2015-4d27-a0dc-a7cd9d7ef9f0 admin admin] RBAC: Authorizing `identity:get_role(role_id=519f10f80fbd4e108392697b77c2178a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:20.802441 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-2e4ed1cf-2015-4d27-a0dc-a7cd9d7ef9f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:30:20.802441 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Feb 08 16:30:20.802441 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: Feb 08 16:30:20.803311 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ed1cf-2015-4d27-a0dc-a7cd9d7ef9f0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:20.804647 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 552/1111] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:30:20 2022] GET /identity/v3/roles/519f10f80fbd4e108392697b77c2178a => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:20.810741 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b8a05-d4b6-4563-8d2d-093e4b352fc6 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:20.819703 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b8a05-d4b6-4563-8d2d-093e4b352fc6 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:20.824198 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1af06-5277-4e53-87c1-bbb527a03299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:20.825037 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1af06-5277-4e53-87c1-bbb527a03299 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:20.825317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1af06-5277-4e53-87c1-bbb527a03299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:20.825588 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1af06-5277-4e53-87c1-bbb527a03299 admin admin] PATH_INFO: `/v3/users/dc3425e42e524ef185adce5fa92da479` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:20.838894 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1af06-5277-4e53-87c1-bbb527a03299 admin admin] RBAC: Authorizing `identity:get_user(user_id=dc3425e42e524ef185adce5fa92da479)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:20.841180 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1af06-5277-4e53-87c1-bbb527a03299 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:20.842835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 560/1112] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:30:20 2022] GET /identity/v3/users/dc3425e42e524ef185adce5fa92da479 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:20.848176 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ed1cf-2015-4d27-a0dc-a7cd9d7ef9f0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:20.858332 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ed1cf-2015-4d27-a0dc-a7cd9d7ef9f0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:20.863025 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5798620-c6db-4e7c-9703-5a56653d5d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:20.863633 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5798620-c6db-4e7c-9703-5a56653d5d5c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:20.863949 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5798620-c6db-4e7c-9703-5a56653d5d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:20.864228 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5798620-c6db-4e7c-9703-5a56653d5d5c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:20.871879 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5798620-c6db-4e7c-9703-5a56653d5d5c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:20.874576 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5798620-c6db-4e7c-9703-5a56653d5d5c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:20.883538 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 553/1113] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:30:20 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:30:20.889285 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1af06-5277-4e53-87c1-bbb527a03299 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:20.899059 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1af06-5277-4e53-87c1-bbb527a03299 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:20.904657 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd123d6d-39c4-4c32-9723-50aff61d040b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:20.905496 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd123d6d-39c4-4c32-9723-50aff61d040b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:20.905778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd123d6d-39c4-4c32-9723-50aff61d040b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:20.906051 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd123d6d-39c4-4c32-9723-50aff61d040b admin admin] PATH_INFO: `/v3/projects/eb0620447f0342c3bb5e4c872c1e302a` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:20.907245 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd123d6d-39c4-4c32-9723-50aff61d040b admin admin] RBAC: Authorizing `identity:get_project(project_id=eb0620447f0342c3bb5e4c872c1e302a)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:20.909308 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd123d6d-39c4-4c32-9723-50aff61d040b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:20.910957 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 561/1114] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:30:20 2022] GET /identity/v3/projects/eb0620447f0342c3bb5e4c872c1e302a => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:20.916704 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5798620-c6db-4e7c-9703-5a56653d5d5c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:20.926158 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5798620-c6db-4e7c-9703-5a56653d5d5c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:20.930782 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505d5c0-3b45-4a55-a77d-5faff815df48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:20.931401 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505d5c0-3b45-4a55-a77d-5faff815df48 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:20.931684 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505d5c0-3b45-4a55-a77d-5faff815df48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:20.931990 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505d5c0-3b45-4a55-a77d-5faff815df48 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:20.932817 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505d5c0-3b45-4a55-a77d-5faff815df48 admin admin] RBAC: Adding query filter params (role.id=519f10f80fbd4e108392697b77c2178a, scope.project.id=eb0620447f0342c3bb5e4c872c1e302a, user.id=dc3425e42e524ef185adce5fa92da479) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:20.933128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505d5c0-3b45-4a55-a77d-5faff815df48 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:20.935979 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505d5c0-3b45-4a55-a77d-5faff815df48 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:20.941182 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 554/1115] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:30:20 2022] GET /identity/v3/role_assignments?user.id=dc3425e42e524ef185adce5fa92da479&scope.project.id=eb0620447f0342c3bb5e4c872c1e302a&role.id=519f10f80fbd4e108392697b77c2178a => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:30:23.127860 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071924a7-2cb8-4a48-84b1-c1a361616669 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:23.128442 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071924a7-2cb8-4a48-84b1-c1a361616669 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:23.128442 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071924a7-2cb8-4a48-84b1-c1a361616669 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:23.130149 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 562/1116] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:23.135261 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df58744-1483-4794-90b6-36c0a0693511 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:23.135675 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df58744-1483-4794-90b6-36c0a0693511 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:23.135830 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df58744-1483-4794-90b6-36c0a0693511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:23.154152 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2df58744-1483-4794-90b6-36c0a0693511 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:23.155332 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2df58744-1483-4794-90b6-36c0a0693511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:23.162933 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 555/1117] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:23 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:30:23.186986 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071924a7-2cb8-4a48-84b1-c1a361616669 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:23.198865 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071924a7-2cb8-4a48-84b1-c1a361616669 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:23.203193 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314979e5-dde0-49a3-8f39-e994a5d13a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:23.204037 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314979e5-dde0-49a3-8f39-e994a5d13a7f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:23.204314 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314979e5-dde0-49a3-8f39-e994a5d13a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:23.204578 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314979e5-dde0-49a3-8f39-e994a5d13a7f admin admin] PATH_INFO: `/v3/roles/519f10f80fbd4e108392697b77c2178a` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:23.206025 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314979e5-dde0-49a3-8f39-e994a5d13a7f admin admin] RBAC: Authorizing `identity:get_role(role_id=519f10f80fbd4e108392697b77c2178a)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:23.207017 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING py.warnings [None req-314979e5-dde0-49a3-8f39-e994a5d13a7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:30:23.207017 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: warnings.warn(msg) Feb 08 16:30:23.207017 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: Feb 08 16:30:23.207917 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314979e5-dde0-49a3-8f39-e994a5d13a7f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:23.209198 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 563/1118] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:30:23 2022] GET /identity/v3/roles/519f10f80fbd4e108392697b77c2178a => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:23.218641 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df58744-1483-4794-90b6-36c0a0693511 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:23.230224 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df58744-1483-4794-90b6-36c0a0693511 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:23.235966 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a4792-0af5-4bc1-809f-3ac244d05e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:23.236823 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a4792-0af5-4bc1-809f-3ac244d05e71 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:23.237104 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a4792-0af5-4bc1-809f-3ac244d05e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:23.237379 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a4792-0af5-4bc1-809f-3ac244d05e71 admin admin] PATH_INFO: `/v3/users/dc3425e42e524ef185adce5fa92da479` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:23.238591 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a4792-0af5-4bc1-809f-3ac244d05e71 admin admin] RBAC: Authorizing `identity:get_user(user_id=dc3425e42e524ef185adce5fa92da479)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:23.240742 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a4792-0af5-4bc1-809f-3ac244d05e71 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:23.242341 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 556/1119] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:30:23 2022] GET /identity/v3/users/dc3425e42e524ef185adce5fa92da479 => generated 286 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:23.248204 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314979e5-dde0-49a3-8f39-e994a5d13a7f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:23.257685 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314979e5-dde0-49a3-8f39-e994a5d13a7f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:23.262201 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a43337-43f8-4449-aadb-306394cbfbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:23.263314 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a43337-43f8-4449-aadb-306394cbfbba admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:23.263594 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a43337-43f8-4449-aadb-306394cbfbba admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:23.263901 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a43337-43f8-4449-aadb-306394cbfbba admin admin] PATH_INFO: `/v3/projects/eb0620447f0342c3bb5e4c872c1e302a` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:23.265124 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a43337-43f8-4449-aadb-306394cbfbba admin admin] RBAC: Authorizing `identity:get_project(project_id=eb0620447f0342c3bb5e4c872c1e302a)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:23.267406 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a43337-43f8-4449-aadb-306394cbfbba admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:23.269099 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 564/1120] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:30:23 2022] GET /identity/v3/projects/eb0620447f0342c3bb5e4c872c1e302a => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:23.274914 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a4792-0af5-4bc1-809f-3ac244d05e71 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:23.285022 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a4792-0af5-4bc1-809f-3ac244d05e71 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:23.289607 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a7eef-7b02-4e06-b823-0d7f300d17aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:23.290451 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a7eef-7b02-4e06-b823-0d7f300d17aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:23.290725 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a7eef-7b02-4e06-b823-0d7f300d17aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:23.290995 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a7eef-7b02-4e06-b823-0d7f300d17aa admin admin] PATH_INFO: `/v3/projects/eb0620447f0342c3bb5e4c872c1e302a/users/dc3425e42e524ef185adce5fa92da479/roles/519f10f80fbd4e108392697b77c2178a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:23.293220 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a7eef-7b02-4e06-b823-0d7f300d17aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb0620447f0342c3bb5e4c872c1e302a, user_id=dc3425e42e524ef185adce5fa92da479, role_id=519f10f80fbd4e108392697b77c2178a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:23.296621 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a7eef-7b02-4e06-b823-0d7f300d17aa admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:23.308909 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 557/1121] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:30:23 2022] PUT /identity/v3/projects/eb0620447f0342c3bb5e4c872c1e302a/users/dc3425e42e524ef185adce5fa92da479/roles/519f10f80fbd4e108392697b77c2178a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:30:25.499184 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb617e-6ca1-4efb-a3b6-5f9abc5115a0 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:25.499732 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb617e-6ca1-4efb-a3b6-5f9abc5115a0 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:25.499732 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb617e-6ca1-4efb-a3b6-5f9abc5115a0 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:25.501687 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 565/1122] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:25.507116 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39342e07-547d-450a-a4b3-0c6977873cdb None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:25.507514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39342e07-547d-450a-a4b3-0c6977873cdb None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:25.507667 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39342e07-547d-450a-a4b3-0c6977873cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:25.525181 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-39342e07-547d-450a-a4b3-0c6977873cdb None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:25.526354 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-39342e07-547d-450a-a4b3-0c6977873cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:25.583347 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 558/1123] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:25 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:25.608373 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb617e-6ca1-4efb-a3b6-5f9abc5115a0 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:25.620544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb617e-6ca1-4efb-a3b6-5f9abc5115a0 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:25.625299 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb68ed-2ce3-409e-ba71-55d89757ce44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:25.626163 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb68ed-2ce3-409e-ba71-55d89757ce44 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:25.626440 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb68ed-2ce3-409e-ba71-55d89757ce44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:25.626709 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb68ed-2ce3-409e-ba71-55d89757ce44 admin admin] PATH_INFO: `/v3/roles/519f10f80fbd4e108392697b77c2178a` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:25.628220 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb68ed-2ce3-409e-ba71-55d89757ce44 admin admin] RBAC: Authorizing `identity:get_role(role_id=519f10f80fbd4e108392697b77c2178a)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:25.629802 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb68ed-2ce3-409e-ba71-55d89757ce44 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:25.631104 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 566/1124] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:30:25 2022] GET /identity/v3/roles/519f10f80fbd4e108392697b77c2178a => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:25.636466 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39342e07-547d-450a-a4b3-0c6977873cdb None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:25.645591 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39342e07-547d-450a-a4b3-0c6977873cdb None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:25.650083 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f7e13-0529-4dec-a814-46444d682479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:25.650913 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f7e13-0529-4dec-a814-46444d682479 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:25.651191 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f7e13-0529-4dec-a814-46444d682479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:25.651461 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f7e13-0529-4dec-a814-46444d682479 admin admin] PATH_INFO: `/v3/users/dc3425e42e524ef185adce5fa92da479` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:25.652697 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f7e13-0529-4dec-a814-46444d682479 admin admin] RBAC: Authorizing `identity:get_user(user_id=dc3425e42e524ef185adce5fa92da479)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:25.655426 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f7e13-0529-4dec-a814-46444d682479 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:25.657047 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 559/1125] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:30:25 2022] GET /identity/v3/users/dc3425e42e524ef185adce5fa92da479 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:25.662801 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb68ed-2ce3-409e-ba71-55d89757ce44 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:25.673171 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb68ed-2ce3-409e-ba71-55d89757ce44 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:25.677667 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cdb528-5d48-4c05-b0b7-667352ec7203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:25.678291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cdb528-5d48-4c05-b0b7-667352ec7203 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:25.678567 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cdb528-5d48-4c05-b0b7-667352ec7203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:25.678838 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cdb528-5d48-4c05-b0b7-667352ec7203 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:25.686482 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cdb528-5d48-4c05-b0b7-667352ec7203 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:25.688256 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cdb528-5d48-4c05-b0b7-667352ec7203 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:25.696961 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 567/1126] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:30:25 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:30:25.702682 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f7e13-0529-4dec-a814-46444d682479 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:25.712054 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f7e13-0529-4dec-a814-46444d682479 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:25.717074 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa5651-71c4-47a5-a061-2ae553ab153f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:25.717882 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa5651-71c4-47a5-a061-2ae553ab153f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:25.718158 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa5651-71c4-47a5-a061-2ae553ab153f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:25.718427 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa5651-71c4-47a5-a061-2ae553ab153f admin admin] PATH_INFO: `/v3/projects/eb0620447f0342c3bb5e4c872c1e302a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:25.719568 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa5651-71c4-47a5-a061-2ae553ab153f admin admin] RBAC: Authorizing `identity:get_project(project_id=eb0620447f0342c3bb5e4c872c1e302a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:25.721600 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa5651-71c4-47a5-a061-2ae553ab153f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:25.723198 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 560/1127] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:30:25 2022] GET /identity/v3/projects/eb0620447f0342c3bb5e4c872c1e302a => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:25.728846 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cdb528-5d48-4c05-b0b7-667352ec7203 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:25.738042 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cdb528-5d48-4c05-b0b7-667352ec7203 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:25.742506 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba865e-2dd0-49ad-a2a2-f650f624c914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:25.743119 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba865e-2dd0-49ad-a2a2-f650f624c914 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:25.743396 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba865e-2dd0-49ad-a2a2-f650f624c914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:25.743665 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba865e-2dd0-49ad-a2a2-f650f624c914 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:25.744511 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba865e-2dd0-49ad-a2a2-f650f624c914 admin admin] RBAC: Adding query filter params (role.id=519f10f80fbd4e108392697b77c2178a, scope.project.id=eb0620447f0342c3bb5e4c872c1e302a, user.id=dc3425e42e524ef185adce5fa92da479) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:25.744844 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba865e-2dd0-49ad-a2a2-f650f624c914 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:25.746621 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba865e-2dd0-49ad-a2a2-f650f624c914 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:25.752205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 568/1128] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:30:25 2022] GET /identity/v3/role_assignments?user.id=dc3425e42e524ef185adce5fa92da479&scope.project.id=eb0620447f0342c3bb5e4c872c1e302a&role.id=519f10f80fbd4e108392697b77c2178a => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:28.020738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fd47f-6cd3-4931-8a89-e361dba5a461 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:28.021249 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fd47f-6cd3-4931-8a89-e361dba5a461 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:28.021375 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fd47f-6cd3-4931-8a89-e361dba5a461 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:28.023419 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 561/1129] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:28.029020 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d817c7c-4207-4666-9ff2-6d1a9a1a118b None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:28.029468 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d817c7c-4207-4666-9ff2-6d1a9a1a118b None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:28.029577 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d817c7c-4207-4666-9ff2-6d1a9a1a118b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:28.047825 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-8d817c7c-4207-4666-9ff2-6d1a9a1a118b None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:28.049032 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-8d817c7c-4207-4666-9ff2-6d1a9a1a118b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:28.056750 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 569/1130] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:28 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:28.083435 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fd47f-6cd3-4931-8a89-e361dba5a461 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:28.095874 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fd47f-6cd3-4931-8a89-e361dba5a461 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:28.101574 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2b349-5fcb-4e84-80d5-40809a1a80ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:28.102338 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2b349-5fcb-4e84-80d5-40809a1a80ff admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:28.102620 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2b349-5fcb-4e84-80d5-40809a1a80ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:28.102891 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2b349-5fcb-4e84-80d5-40809a1a80ff admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:28.104118 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2b349-5fcb-4e84-80d5-40809a1a80ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:28.105792 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2b349-5fcb-4e84-80d5-40809a1a80ff admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:28.108031 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 562/1131] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:30:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:28.113810 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d817c7c-4207-4666-9ff2-6d1a9a1a118b None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:28.126345 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d817c7c-4207-4666-9ff2-6d1a9a1a118b None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:28.130848 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bdf4a6-3def-4884-a534-732dc8237dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:28.131491 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdf4a6-3def-4884-a534-732dc8237dff admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:28.131824 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdf4a6-3def-4884-a534-732dc8237dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:28.132132 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdf4a6-3def-4884-a534-732dc8237dff admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:28.132859 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bdf4a6-3def-4884-a534-732dc8237dff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:28.134771 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bdf4a6-3def-4884-a534-732dc8237dff admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:28.160660 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 570/1132] 10.222.0.35 () {60 vars in 1162 bytes} [Tue Feb 8 16:30:28 2022] POST /identity/v3/projects => generated 311 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:30:30.485152 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdab5a0-afda-4e55-a2b1-5b7c4beb9523 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:30.485685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdab5a0-afda-4e55-a2b1-5b7c4beb9523 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:30.485685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdab5a0-afda-4e55-a2b1-5b7c4beb9523 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:30.487456 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 563/1133] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:30.492873 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a6610-5779-4d8b-889b-b640e058133d None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:30.493306 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a6610-5779-4d8b-889b-b640e058133d None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:30.493433 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a6610-5779-4d8b-889b-b640e058133d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:30.511862 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-4d2a6610-5779-4d8b-889b-b640e058133d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:30.513570 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-4d2a6610-5779-4d8b-889b-b640e058133d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:30.570821 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 571/1134] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:30 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:30.598377 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdab5a0-afda-4e55-a2b1-5b7c4beb9523 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:30.611094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdab5a0-afda-4e55-a2b1-5b7c4beb9523 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:30.615938 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d139ad0-089c-4b01-97c8-c3800f3f425b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:30.616705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d139ad0-089c-4b01-97c8-c3800f3f425b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:30.617023 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d139ad0-089c-4b01-97c8-c3800f3f425b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:30.617299 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d139ad0-089c-4b01-97c8-c3800f3f425b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:30.618495 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d139ad0-089c-4b01-97c8-c3800f3f425b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:30.620327 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d139ad0-089c-4b01-97c8-c3800f3f425b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:30.622226 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 564/1135] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:30:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:30.628061 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a6610-5779-4d8b-889b-b640e058133d None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:30.637128 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a6610-5779-4d8b-889b-b640e058133d None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:30.642582 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83948d-e549-469f-ab50-09e827c3e5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:30.643230 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83948d-e549-469f-ab50-09e827c3e5a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:30.643509 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83948d-e549-469f-ab50-09e827c3e5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:30.643838 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83948d-e549-469f-ab50-09e827c3e5a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:30.644573 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83948d-e549-469f-ab50-09e827c3e5a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:30.646470 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83948d-e549-469f-ab50-09e827c3e5a0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:30.667620 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 572/1136] 10.222.0.35 () {60 vars in 1153 bytes} [Tue Feb 8 16:30:30 2022] POST /identity/v3/users => generated 286 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:30:32.987112 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3b5cd-445c-44e4-8e4b-8e310614201c None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:32.987652 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3b5cd-445c-44e4-8e4b-8e310614201c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:32.987652 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3b5cd-445c-44e4-8e4b-8e310614201c None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:32.989463 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 565/1137] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:32.994942 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c8fce-da22-444d-be01-c8d6bab99cf3 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:32.995709 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c8fce-da22-444d-be01-c8d6bab99cf3 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:32.996014 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c8fce-da22-444d-be01-c8d6bab99cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:33.013945 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-570c8fce-da22-444d-be01-c8d6bab99cf3 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:33.015132 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-570c8fce-da22-444d-be01-c8d6bab99cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:33.023296 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 573/1138] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:32 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:33.049282 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3b5cd-445c-44e4-8e4b-8e310614201c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:33.062039 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3b5cd-445c-44e4-8e4b-8e310614201c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:33.066590 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39701f4-fae2-4a69-83d3-1a3f1cd5965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:33.067357 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39701f4-fae2-4a69-83d3-1a3f1cd5965a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:33.067640 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39701f4-fae2-4a69-83d3-1a3f1cd5965a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:33.068075 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39701f4-fae2-4a69-83d3-1a3f1cd5965a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:33.078816 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39701f4-fae2-4a69-83d3-1a3f1cd5965a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:30:33.085830 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-a39701f4-fae2-4a69-83d3-1a3f1cd5965a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:30:33.087015 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 566/1139] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:30:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:33.094468 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c8fce-da22-444d-be01-c8d6bab99cf3 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:33.103506 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c8fce-da22-444d-be01-c8d6bab99cf3 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:33.109239 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372922a-403f-4b8d-b45d-ca5a66c13035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:33.109901 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372922a-403f-4b8d-b45d-ca5a66c13035 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:33.110182 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372922a-403f-4b8d-b45d-ca5a66c13035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:33.110458 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372922a-403f-4b8d-b45d-ca5a66c13035 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:33.111221 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372922a-403f-4b8d-b45d-ca5a66c13035 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:33.111522 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372922a-403f-4b8d-b45d-ca5a66c13035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:33.113142 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372922a-403f-4b8d-b45d-ca5a66c13035 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:33.121580 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 574/1140] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:30:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:33.127436 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39701f4-fae2-4a69-83d3-1a3f1cd5965a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:33.138976 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39701f4-fae2-4a69-83d3-1a3f1cd5965a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:33.144146 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbec99-7465-43ac-b1e4-4cdda6c629a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:33.145056 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbec99-7465-43ac-b1e4-4cdda6c629a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:33.145337 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbec99-7465-43ac-b1e4-4cdda6c629a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:33.145610 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbec99-7465-43ac-b1e4-4cdda6c629a9 admin admin] PATH_INFO: `/v3/users/b17aa48b95e7448d98a39afe33809dba` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:33.160081 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbec99-7465-43ac-b1e4-4cdda6c629a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=b17aa48b95e7448d98a39afe33809dba)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:33.162198 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbec99-7465-43ac-b1e4-4cdda6c629a9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:33.164404 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 567/1141] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:30:33 2022] GET /identity/v3/users/b17aa48b95e7448d98a39afe33809dba => generated 286 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:33.170249 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372922a-403f-4b8d-b45d-ca5a66c13035 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:33.180238 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372922a-403f-4b8d-b45d-ca5a66c13035 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:33.185433 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72518b1-c3aa-4708-8d76-788bfe7aad79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:33.186059 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72518b1-c3aa-4708-8d76-788bfe7aad79 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:33.186349 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72518b1-c3aa-4708-8d76-788bfe7aad79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:33.186626 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72518b1-c3aa-4708-8d76-788bfe7aad79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:33.194884 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72518b1-c3aa-4708-8d76-788bfe7aad79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:33.196669 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72518b1-c3aa-4708-8d76-788bfe7aad79 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:33.205772 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 575/1142] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:30:33 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:30:33.212010 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbec99-7465-43ac-b1e4-4cdda6c629a9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:33.222792 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbec99-7465-43ac-b1e4-4cdda6c629a9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:33.227715 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a30b5b-e6d5-42cf-a23c-d7da283bda7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:33.228585 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a30b5b-e6d5-42cf-a23c-d7da283bda7b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:33.228867 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a30b5b-e6d5-42cf-a23c-d7da283bda7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:33.229144 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a30b5b-e6d5-42cf-a23c-d7da283bda7b admin admin] PATH_INFO: `/v3/projects/90024c95db744ad5a69333b0f0ba5f6e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:33.230325 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a30b5b-e6d5-42cf-a23c-d7da283bda7b admin admin] RBAC: Authorizing `identity:get_project(project_id=90024c95db744ad5a69333b0f0ba5f6e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:33.233044 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a30b5b-e6d5-42cf-a23c-d7da283bda7b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:33.234737 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 568/1143] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:30:33 2022] GET /identity/v3/projects/90024c95db744ad5a69333b0f0ba5f6e => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:33.240966 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72518b1-c3aa-4708-8d76-788bfe7aad79 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:33.250726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72518b1-c3aa-4708-8d76-788bfe7aad79 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:33.255434 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8d9ab-ec1d-483f-8dc8-a7848cfd2c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:33.256088 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8d9ab-ec1d-483f-8dc8-a7848cfd2c3a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:33.256365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8d9ab-ec1d-483f-8dc8-a7848cfd2c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:33.256636 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8d9ab-ec1d-483f-8dc8-a7848cfd2c3a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:33.257471 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8d9ab-ec1d-483f-8dc8-a7848cfd2c3a admin admin] RBAC: Adding query filter params (role.id=e6d18df5c4e74dfd8ebd9c636f45936e, scope.project.id=90024c95db744ad5a69333b0f0ba5f6e, user.id=b17aa48b95e7448d98a39afe33809dba) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:33.257782 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8d9ab-ec1d-483f-8dc8-a7848cfd2c3a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:33.259596 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8d9ab-ec1d-483f-8dc8-a7848cfd2c3a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:33.266518 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 576/1144] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:30:33 2022] GET /identity/v3/role_assignments?user.id=b17aa48b95e7448d98a39afe33809dba&scope.project.id=90024c95db744ad5a69333b0f0ba5f6e&role.id=e6d18df5c4e74dfd8ebd9c636f45936e => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:35.489884 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ecd1e-72cd-48a6-9357-ae2ed648286f None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:35.490436 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ecd1e-72cd-48a6-9357-ae2ed648286f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:35.490436 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ecd1e-72cd-48a6-9357-ae2ed648286f None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:35.492238 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 569/1145] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:35.497489 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f812d-cd12-48d1-934a-092a11e68db6 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:35.497886 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f812d-cd12-48d1-934a-092a11e68db6 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:35.498044 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f812d-cd12-48d1-934a-092a11e68db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:35.516104 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-6e7f812d-cd12-48d1-934a-092a11e68db6 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:35.517514 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-6e7f812d-cd12-48d1-934a-092a11e68db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:35.525071 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 577/1146] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:35 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:35.549129 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ecd1e-72cd-48a6-9357-ae2ed648286f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:35.562134 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ecd1e-72cd-48a6-9357-ae2ed648286f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:35.566375 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7c4a7-608c-4e84-8590-b0f2d020b2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:35.567124 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7c4a7-608c-4e84-8590-b0f2d020b2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:35.567401 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7c4a7-608c-4e84-8590-b0f2d020b2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:35.567669 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7c4a7-608c-4e84-8590-b0f2d020b2d5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:35.578392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7c4a7-608c-4e84-8590-b0f2d020b2d5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:30:35.585225 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-71a7c4a7-608c-4e84-8590-b0f2d020b2d5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:30:35.586346 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 570/1147] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:30:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:35.592664 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f812d-cd12-48d1-934a-092a11e68db6 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:35.601726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f812d-cd12-48d1-934a-092a11e68db6 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:35.606613 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0e370-06bd-493b-ace1-3dbef81b720c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:35.607249 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0e370-06bd-493b-ace1-3dbef81b720c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:35.607532 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0e370-06bd-493b-ace1-3dbef81b720c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:35.607843 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0e370-06bd-493b-ace1-3dbef81b720c admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:35.608597 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0e370-06bd-493b-ace1-3dbef81b720c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:35.608902 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0e370-06bd-493b-ace1-3dbef81b720c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:35.610777 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0e370-06bd-493b-ace1-3dbef81b720c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:35.618806 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 578/1148] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:30:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:35.624966 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7c4a7-608c-4e84-8590-b0f2d020b2d5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:35.634871 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7c4a7-608c-4e84-8590-b0f2d020b2d5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:35.639869 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af948671-9ecd-483e-9a27-12750e9b3ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:35.640682 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af948671-9ecd-483e-9a27-12750e9b3ffa admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:35.640954 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af948671-9ecd-483e-9a27-12750e9b3ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:35.641486 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af948671-9ecd-483e-9a27-12750e9b3ffa admin admin] PATH_INFO: `/v3/users/b17aa48b95e7448d98a39afe33809dba` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:35.642658 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af948671-9ecd-483e-9a27-12750e9b3ffa admin admin] RBAC: Authorizing `identity:get_user(user_id=b17aa48b95e7448d98a39afe33809dba)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:35.644770 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af948671-9ecd-483e-9a27-12750e9b3ffa admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:35.646294 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 571/1149] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:30:35 2022] GET /identity/v3/users/b17aa48b95e7448d98a39afe33809dba => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:35.651996 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0e370-06bd-493b-ace1-3dbef81b720c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:35.661651 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0e370-06bd-493b-ace1-3dbef81b720c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:35.666185 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b5259-e07e-427f-a04a-294babe2959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:35.667010 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b5259-e07e-427f-a04a-294babe2959b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:35.667343 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b5259-e07e-427f-a04a-294babe2959b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:35.667621 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b5259-e07e-427f-a04a-294babe2959b admin admin] PATH_INFO: `/v3/projects/90024c95db744ad5a69333b0f0ba5f6e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:35.668876 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b5259-e07e-427f-a04a-294babe2959b admin admin] RBAC: Authorizing `identity:get_project(project_id=90024c95db744ad5a69333b0f0ba5f6e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:35.670916 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b5259-e07e-427f-a04a-294babe2959b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:35.672566 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 579/1150] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:30:35 2022] GET /identity/v3/projects/90024c95db744ad5a69333b0f0ba5f6e => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:35.677913 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af948671-9ecd-483e-9a27-12750e9b3ffa admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:35.687717 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af948671-9ecd-483e-9a27-12750e9b3ffa admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:35.692185 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d629ed-7634-4a20-9068-d15c12477d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:35.693016 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d629ed-7634-4a20-9068-d15c12477d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:35.693294 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d629ed-7634-4a20-9068-d15c12477d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:35.693569 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d629ed-7634-4a20-9068-d15c12477d11 admin admin] PATH_INFO: `/v3/projects/90024c95db744ad5a69333b0f0ba5f6e/users/b17aa48b95e7448d98a39afe33809dba/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:35.695492 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d629ed-7634-4a20-9068-d15c12477d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90024c95db744ad5a69333b0f0ba5f6e, user_id=b17aa48b95e7448d98a39afe33809dba, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:35.698101 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d629ed-7634-4a20-9068-d15c12477d11 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:35.710869 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 572/1151] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:30:35 2022] PUT /identity/v3/projects/90024c95db744ad5a69333b0f0ba5f6e/users/b17aa48b95e7448d98a39afe33809dba/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:30:37.904456 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ea394-a7a3-4178-9134-61bcb70d5c0e None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:37.905009 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ea394-a7a3-4178-9134-61bcb70d5c0e None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:37.905009 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ea394-a7a3-4178-9134-61bcb70d5c0e None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:37.906888 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 580/1152] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:37.912063 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42287b3a-b9b2-4ecd-bccf-caac38a18b14 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:37.912488 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42287b3a-b9b2-4ecd-bccf-caac38a18b14 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:37.912618 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42287b3a-b9b2-4ecd-bccf-caac38a18b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:37.930070 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-42287b3a-b9b2-4ecd-bccf-caac38a18b14 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:37.931245 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-42287b3a-b9b2-4ecd-bccf-caac38a18b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:37.986768 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 573/1153] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:37 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:38.010753 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ea394-a7a3-4178-9134-61bcb70d5c0e None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:38.023470 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ea394-a7a3-4178-9134-61bcb70d5c0e None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:38.027727 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657efc94-6311-4ccd-99c8-b6e5dcf26982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:38.028692 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657efc94-6311-4ccd-99c8-b6e5dcf26982 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:38.028970 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657efc94-6311-4ccd-99c8-b6e5dcf26982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:38.029237 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657efc94-6311-4ccd-99c8-b6e5dcf26982 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:38.039014 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657efc94-6311-4ccd-99c8-b6e5dcf26982 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:30:38.046378 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-657efc94-6311-4ccd-99c8-b6e5dcf26982 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:30:38.047507 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 581/1154] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:30:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:38.053328 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42287b3a-b9b2-4ecd-bccf-caac38a18b14 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:38.062555 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42287b3a-b9b2-4ecd-bccf-caac38a18b14 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:38.067046 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aaa2fd-e964-4742-9eef-205365b1bcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:38.067692 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aaa2fd-e964-4742-9eef-205365b1bcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:38.068006 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aaa2fd-e964-4742-9eef-205365b1bcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:38.068286 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aaa2fd-e964-4742-9eef-205365b1bcf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:38.069036 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aaa2fd-e964-4742-9eef-205365b1bcf6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:38.069338 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aaa2fd-e964-4742-9eef-205365b1bcf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:38.070924 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aaa2fd-e964-4742-9eef-205365b1bcf6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:38.079656 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 574/1155] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:30:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:38.085120 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657efc94-6311-4ccd-99c8-b6e5dcf26982 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:38.094965 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657efc94-6311-4ccd-99c8-b6e5dcf26982 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:38.099389 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81333d-d5a1-478c-9546-6e2ed4346a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:38.100242 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81333d-d5a1-478c-9546-6e2ed4346a70 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:38.100519 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81333d-d5a1-478c-9546-6e2ed4346a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:38.100787 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81333d-d5a1-478c-9546-6e2ed4346a70 admin admin] PATH_INFO: `/v3/users/b17aa48b95e7448d98a39afe33809dba` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:38.101965 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81333d-d5a1-478c-9546-6e2ed4346a70 admin admin] RBAC: Authorizing `identity:get_user(user_id=b17aa48b95e7448d98a39afe33809dba)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:38.104060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81333d-d5a1-478c-9546-6e2ed4346a70 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:38.105625 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 582/1156] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:30:38 2022] GET /identity/v3/users/b17aa48b95e7448d98a39afe33809dba => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:38.110752 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aaa2fd-e964-4742-9eef-205365b1bcf6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:38.119947 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aaa2fd-e964-4742-9eef-205365b1bcf6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:38.125562 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7f606-69b5-4168-9178-fbc57b571d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:38.126192 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7f606-69b5-4168-9178-fbc57b571d24 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:38.126469 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7f606-69b5-4168-9178-fbc57b571d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:38.126737 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7f606-69b5-4168-9178-fbc57b571d24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:38.134229 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7f606-69b5-4168-9178-fbc57b571d24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:38.135959 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7f606-69b5-4168-9178-fbc57b571d24 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:38.147266 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 575/1157] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:30:38 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:30:38.152833 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81333d-d5a1-478c-9546-6e2ed4346a70 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:38.162376 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81333d-d5a1-478c-9546-6e2ed4346a70 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:38.166782 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1bf9b-6e55-4a80-bfd0-88157b07caf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:38.167591 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1bf9b-6e55-4a80-bfd0-88157b07caf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:38.167910 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1bf9b-6e55-4a80-bfd0-88157b07caf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:38.168184 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1bf9b-6e55-4a80-bfd0-88157b07caf5 admin admin] PATH_INFO: `/v3/projects/90024c95db744ad5a69333b0f0ba5f6e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:38.169657 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1bf9b-6e55-4a80-bfd0-88157b07caf5 admin admin] RBAC: Authorizing `identity:get_project(project_id=90024c95db744ad5a69333b0f0ba5f6e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:38.171687 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1bf9b-6e55-4a80-bfd0-88157b07caf5 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:38.173329 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 583/1158] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:30:38 2022] GET /identity/v3/projects/90024c95db744ad5a69333b0f0ba5f6e => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:38.178839 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7f606-69b5-4168-9178-fbc57b571d24 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:38.187879 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7f606-69b5-4168-9178-fbc57b571d24 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:38.192367 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc86465-3097-47fe-8ddf-d5432bd9e85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:38.193057 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc86465-3097-47fe-8ddf-d5432bd9e85a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:38.193333 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc86465-3097-47fe-8ddf-d5432bd9e85a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:38.193606 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc86465-3097-47fe-8ddf-d5432bd9e85a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:38.194426 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc86465-3097-47fe-8ddf-d5432bd9e85a admin admin] RBAC: Adding query filter params (role.id=e6d18df5c4e74dfd8ebd9c636f45936e, scope.project.id=90024c95db744ad5a69333b0f0ba5f6e, user.id=b17aa48b95e7448d98a39afe33809dba) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:38.194734 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc86465-3097-47fe-8ddf-d5432bd9e85a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:38.196575 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc86465-3097-47fe-8ddf-d5432bd9e85a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:38.202805 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 576/1159] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:30:38 2022] GET /identity/v3/role_assignments?user.id=b17aa48b95e7448d98a39afe33809dba&scope.project.id=90024c95db744ad5a69333b0f0ba5f6e&role.id=e6d18df5c4e74dfd8ebd9c636f45936e => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:30:40.445688 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a002d-4b9f-4128-b707-dfb35acecd3e None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:40.446207 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a002d-4b9f-4128-b707-dfb35acecd3e None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:40.446207 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a002d-4b9f-4128-b707-dfb35acecd3e None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:40.448025 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 584/1160] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:40.453886 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc5d0b-be21-4788-9544-ef132cacace6 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:40.454298 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc5d0b-be21-4788-9544-ef132cacace6 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:40.454445 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc5d0b-be21-4788-9544-ef132cacace6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:40.471658 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-37bc5d0b-be21-4788-9544-ef132cacace6 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:40.472875 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-37bc5d0b-be21-4788-9544-ef132cacace6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:40.481077 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 577/1161] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:40 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:40.504192 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a002d-4b9f-4128-b707-dfb35acecd3e None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:40.516567 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a002d-4b9f-4128-b707-dfb35acecd3e None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:40.520842 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3974c-4add-42cc-939c-3ba844e71883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:40.521453 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3974c-4add-42cc-939c-3ba844e71883 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:40.521727 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3974c-4add-42cc-939c-3ba844e71883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:40.521993 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3974c-4add-42cc-939c-3ba844e71883 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:40.529546 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3974c-4add-42cc-939c-3ba844e71883 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:40.531252 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3974c-4add-42cc-939c-3ba844e71883 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:40.539704 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 585/1162] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:30:40 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:30:40.545810 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc5d0b-be21-4788-9544-ef132cacace6 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:40.554471 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc5d0b-be21-4788-9544-ef132cacace6 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:40.559855 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e644ce3-c7c5-4331-9df0-0d895a4be98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:40.560674 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e644ce3-c7c5-4331-9df0-0d895a4be98b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:40.560976 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e644ce3-c7c5-4331-9df0-0d895a4be98b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:40.561248 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e644ce3-c7c5-4331-9df0-0d895a4be98b admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:40.568059 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e644ce3-c7c5-4331-9df0-0d895a4be98b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:40.569853 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e644ce3-c7c5-4331-9df0-0d895a4be98b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:40.584176 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-1e644ce3-c7c5-4331-9df0-0d895a4be98b admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 08 16:30:40.585289 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 578/1163] 10.222.0.35 () {56 vars in 1138 bytes} [Tue Feb 8 16:30:40 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:40.591294 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3974c-4add-42cc-939c-3ba844e71883 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:40.599980 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3974c-4add-42cc-939c-3ba844e71883 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:40.604630 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beaabfd-524c-49fc-b8c0-bac36553f56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:40.605252 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaabfd-524c-49fc-b8c0-bac36553f56f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:40.606023 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaabfd-524c-49fc-b8c0-bac36553f56f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:40.606478 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaabfd-524c-49fc-b8c0-bac36553f56f admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:40.607283 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beaabfd-524c-49fc-b8c0-bac36553f56f admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:40.607587 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beaabfd-524c-49fc-b8c0-bac36553f56f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:40.609165 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beaabfd-524c-49fc-b8c0-bac36553f56f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:40.616168 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 586/1164] 10.222.0.35 () {56 vars in 1136 bytes} [Tue Feb 8 16:30:40 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:42.820932 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddebd5-8ac2-4bbd-b2c9-1157ebdd3a4c None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:42.821445 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddebd5-8ac2-4bbd-b2c9-1157ebdd3a4c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:42.821540 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddebd5-8ac2-4bbd-b2c9-1157ebdd3a4c None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:42.823239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 579/1165] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:42.828673 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c6427-dd10-47ee-9e1a-36bf6305ea34 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:42.829087 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c6427-dd10-47ee-9e1a-36bf6305ea34 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:42.829227 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c6427-dd10-47ee-9e1a-36bf6305ea34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:42.846642 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-4e7c6427-dd10-47ee-9e1a-36bf6305ea34 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:42.847887 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-4e7c6427-dd10-47ee-9e1a-36bf6305ea34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:42.856260 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 587/1166] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:42 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:42.879834 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddebd5-8ac2-4bbd-b2c9-1157ebdd3a4c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:42.892180 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddebd5-8ac2-4bbd-b2c9-1157ebdd3a4c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:42.896746 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c241c-bfc3-40e7-b10f-6d859dff1583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:42.897316 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c241c-bfc3-40e7-b10f-6d859dff1583 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:42.897444 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c241c-bfc3-40e7-b10f-6d859dff1583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:42.897718 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c241c-bfc3-40e7-b10f-6d859dff1583 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:42.898471 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c241c-bfc3-40e7-b10f-6d859dff1583 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:42.899473 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-e67c241c-bfc3-40e7-b10f-6d859dff1583 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:30:42.899473 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Feb 08 16:30:42.899473 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: Feb 08 16:30:42.900372 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c241c-bfc3-40e7-b10f-6d859dff1583 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:42.914492 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 580/1167] 10.222.0.35 () {60 vars in 1159 bytes} [Tue Feb 8 16:30:42 2022] POST /identity/v3/domains => generated 267 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:30:45.130047 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dcafe-0f04-4568-b22b-4696152b8c45 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:45.130589 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dcafe-0f04-4568-b22b-4696152b8c45 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:45.130589 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dcafe-0f04-4568-b22b-4696152b8c45 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:45.132351 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 588/1168] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:45.137952 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f322b86-8706-4949-a878-9279b9714a08 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:45.138348 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f322b86-8706-4949-a878-9279b9714a08 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:45.138508 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f322b86-8706-4949-a878-9279b9714a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:45.156450 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-7f322b86-8706-4949-a878-9279b9714a08 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:45.157637 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7f322b86-8706-4949-a878-9279b9714a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:45.212167 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 581/1169] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:45 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:30:45.235987 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dcafe-0f04-4568-b22b-4696152b8c45 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:45.248493 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dcafe-0f04-4568-b22b-4696152b8c45 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:45.252748 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38163a6-17c1-4975-8515-ea7e31c8a7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:45.253568 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38163a6-17c1-4975-8515-ea7e31c8a7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:45.253838 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38163a6-17c1-4975-8515-ea7e31c8a7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:45.254101 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38163a6-17c1-4975-8515-ea7e31c8a7c0 admin admin] PATH_INFO: `/v3/domains/75b0a50f00df4b228191e42bb7245abd` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:45.264472 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38163a6-17c1-4975-8515-ea7e31c8a7c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=75b0a50f00df4b228191e42bb7245abd)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:45.266654 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38163a6-17c1-4975-8515-ea7e31c8a7c0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:45.268293 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 589/1170] 10.222.0.35 () {56 vars in 1204 bytes} [Tue Feb 8 16:30:45 2022] GET /identity/v3/domains/75b0a50f00df4b228191e42bb7245abd => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:45.273860 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f322b86-8706-4949-a878-9279b9714a08 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:45.282919 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f322b86-8706-4949-a878-9279b9714a08 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:45.287422 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c1f1e-1b42-4f23-86cb-af7545ee394e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:45.288082 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c1f1e-1b42-4f23-86cb-af7545ee394e admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:45.288364 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c1f1e-1b42-4f23-86cb-af7545ee394e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:45.288635 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c1f1e-1b42-4f23-86cb-af7545ee394e admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:45.289356 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c1f1e-1b42-4f23-86cb-af7545ee394e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:45.291220 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c1f1e-1b42-4f23-86cb-af7545ee394e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:45.316942 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 582/1171] 10.222.0.35 () {60 vars in 1162 bytes} [Tue Feb 8 16:30:45 2022] POST /identity/v3/projects => generated 361 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:30:47.565992 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88f181-2c3c-4b6c-b680-7446fd56723c None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:47.566610 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88f181-2c3c-4b6c-b680-7446fd56723c None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:47.566610 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88f181-2c3c-4b6c-b680-7446fd56723c None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:47.568271 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 590/1172] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:47.573575 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b893e6-9844-4e7c-8c22-c91222b1f43b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:47.574061 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b893e6-9844-4e7c-8c22-c91222b1f43b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:47.574760 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b893e6-9844-4e7c-8c22-c91222b1f43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:47.592208 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-a3b893e6-9844-4e7c-8c22-c91222b1f43b None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:47.593384 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a3b893e6-9844-4e7c-8c22-c91222b1f43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:47.648152 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 583/1173] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:47 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:47.673625 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88f181-2c3c-4b6c-b680-7446fd56723c None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:47.686483 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88f181-2c3c-4b6c-b680-7446fd56723c None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:47.690812 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799b6f7-5595-4a78-8d09-8d78c49433fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:47.691638 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799b6f7-5595-4a78-8d09-8d78c49433fe admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:47.691953 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799b6f7-5595-4a78-8d09-8d78c49433fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:47.692224 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799b6f7-5595-4a78-8d09-8d78c49433fe admin admin] PATH_INFO: `/v3/domains/75b0a50f00df4b228191e42bb7245abd` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:47.693402 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799b6f7-5595-4a78-8d09-8d78c49433fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=75b0a50f00df4b228191e42bb7245abd)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:47.695320 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799b6f7-5595-4a78-8d09-8d78c49433fe admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:47.696906 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 591/1174] 10.222.0.35 () {56 vars in 1204 bytes} [Tue Feb 8 16:30:47 2022] GET /identity/v3/domains/75b0a50f00df4b228191e42bb7245abd => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:47.702839 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b893e6-9844-4e7c-8c22-c91222b1f43b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:47.711437 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b893e6-9844-4e7c-8c22-c91222b1f43b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:47.715981 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f5f67-81ee-4549-97cc-1bef543ee374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:47.716615 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f5f67-81ee-4549-97cc-1bef543ee374 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:47.716889 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f5f67-81ee-4549-97cc-1bef543ee374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:47.717157 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f5f67-81ee-4549-97cc-1bef543ee374 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:47.717860 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f5f67-81ee-4549-97cc-1bef543ee374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:47.719733 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f5f67-81ee-4549-97cc-1bef543ee374 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:47.738480 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 584/1175] 10.222.0.35 () {60 vars in 1153 bytes} [Tue Feb 8 16:30:47 2022] POST /identity/v3/users => generated 311 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:30:50.008943 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33751af1-446b-42a0-8a31-17aac3156c4e None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:50.009504 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33751af1-446b-42a0-8a31-17aac3156c4e None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:50.009504 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33751af1-446b-42a0-8a31-17aac3156c4e None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:50.011271 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 592/1176] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:50.017989 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b5a78-5ddb-40ff-9316-8f1b2983f01f None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:50.018404 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b5a78-5ddb-40ff-9316-8f1b2983f01f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:50.018549 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b5a78-5ddb-40ff-9316-8f1b2983f01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:50.037277 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-848b5a78-5ddb-40ff-9316-8f1b2983f01f None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:50.038483 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-848b5a78-5ddb-40ff-9316-8f1b2983f01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:50.046237 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 585/1177] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:50 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:50.070810 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33751af1-446b-42a0-8a31-17aac3156c4e None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:50.083284 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33751af1-446b-42a0-8a31-17aac3156c4e None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:50.087498 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e5299-6f7b-4ba1-88a9-38ce4a76e1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:50.088288 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e5299-6f7b-4ba1-88a9-38ce4a76e1fc admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:50.088566 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e5299-6f7b-4ba1-88a9-38ce4a76e1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:50.088841 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e5299-6f7b-4ba1-88a9-38ce4a76e1fc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:50.098947 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e5299-6f7b-4ba1-88a9-38ce4a76e1fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:30:50.105572 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-479e5299-6f7b-4ba1-88a9-38ce4a76e1fc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:30:50.106691 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 593/1178] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:30:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:50.112434 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b5a78-5ddb-40ff-9316-8f1b2983f01f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:50.121618 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b5a78-5ddb-40ff-9316-8f1b2983f01f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:50.125980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666ccc9-7997-4f0c-b140-a55d118c61fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:50.126612 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666ccc9-7997-4f0c-b140-a55d118c61fd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:50.126887 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666ccc9-7997-4f0c-b140-a55d118c61fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:50.127157 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666ccc9-7997-4f0c-b140-a55d118c61fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:50.127941 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666ccc9-7997-4f0c-b140-a55d118c61fd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:50.128302 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666ccc9-7997-4f0c-b140-a55d118c61fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:50.129887 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666ccc9-7997-4f0c-b140-a55d118c61fd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:50.137936 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 586/1179] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:30:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:50.144055 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e5299-6f7b-4ba1-88a9-38ce4a76e1fc admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:50.154276 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e5299-6f7b-4ba1-88a9-38ce4a76e1fc admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:50.158707 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63404f49-ff89-4d21-9c2f-c6ad5416c4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:50.159537 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63404f49-ff89-4d21-9c2f-c6ad5416c4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:50.159844 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63404f49-ff89-4d21-9c2f-c6ad5416c4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:50.160120 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63404f49-ff89-4d21-9c2f-c6ad5416c4b7 admin admin] PATH_INFO: `/v3/users/63d23e81280245bab3863fb7a1dbbb57` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:50.173624 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63404f49-ff89-4d21-9c2f-c6ad5416c4b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=63d23e81280245bab3863fb7a1dbbb57)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:50.175715 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63404f49-ff89-4d21-9c2f-c6ad5416c4b7 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:50.177318 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 594/1180] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:30:50 2022] GET /identity/v3/users/63d23e81280245bab3863fb7a1dbbb57 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:50.182808 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666ccc9-7997-4f0c-b140-a55d118c61fd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:50.192646 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666ccc9-7997-4f0c-b140-a55d118c61fd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:50.197128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726c649-6471-4780-8ed6-d276bf00ec96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:50.197744 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726c649-6471-4780-8ed6-d276bf00ec96 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:50.198027 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726c649-6471-4780-8ed6-d276bf00ec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:50.198304 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726c649-6471-4780-8ed6-d276bf00ec96 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:50.206655 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726c649-6471-4780-8ed6-d276bf00ec96 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:50.208445 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726c649-6471-4780-8ed6-d276bf00ec96 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:50.217665 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 587/1181] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:30:50 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:30:50.223032 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63404f49-ff89-4d21-9c2f-c6ad5416c4b7 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:50.232917 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63404f49-ff89-4d21-9c2f-c6ad5416c4b7 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:50.238489 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e2da5-34e7-43a9-ad31-7d8eb5bd0f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:50.239304 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e2da5-34e7-43a9-ad31-7d8eb5bd0f20 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:50.239586 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e2da5-34e7-43a9-ad31-7d8eb5bd0f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:50.239905 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e2da5-34e7-43a9-ad31-7d8eb5bd0f20 admin admin] PATH_INFO: `/v3/projects/84abde6732aa478ab4f19f20efbd22e3` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:50.241082 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e2da5-34e7-43a9-ad31-7d8eb5bd0f20 admin admin] RBAC: Authorizing `identity:get_project(project_id=84abde6732aa478ab4f19f20efbd22e3)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:50.243078 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e2da5-34e7-43a9-ad31-7d8eb5bd0f20 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:50.244733 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 595/1182] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:30:50 2022] GET /identity/v3/projects/84abde6732aa478ab4f19f20efbd22e3 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:50.250541 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726c649-6471-4780-8ed6-d276bf00ec96 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:50.259359 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726c649-6471-4780-8ed6-d276bf00ec96 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:50.264917 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a2070-252f-4b4a-9e33-7eaf4b6df985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:50.265551 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a2070-252f-4b4a-9e33-7eaf4b6df985 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:50.265834 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a2070-252f-4b4a-9e33-7eaf4b6df985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:50.266362 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a2070-252f-4b4a-9e33-7eaf4b6df985 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:50.267192 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a2070-252f-4b4a-9e33-7eaf4b6df985 admin admin] RBAC: Adding query filter params (role.id=e6d18df5c4e74dfd8ebd9c636f45936e, scope.project.id=84abde6732aa478ab4f19f20efbd22e3, user.id=63d23e81280245bab3863fb7a1dbbb57) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:50.267503 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a2070-252f-4b4a-9e33-7eaf4b6df985 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:50.269388 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a2070-252f-4b4a-9e33-7eaf4b6df985 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:50.274876 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 588/1183] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:30:50 2022] GET /identity/v3/role_assignments?user.id=63d23e81280245bab3863fb7a1dbbb57&scope.project.id=84abde6732aa478ab4f19f20efbd22e3&role.id=e6d18df5c4e74dfd8ebd9c636f45936e => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:52.495287 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd18b7-87da-4edd-8182-99b0ccafbaf2 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:52.495926 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd18b7-87da-4edd-8182-99b0ccafbaf2 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:52.495926 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd18b7-87da-4edd-8182-99b0ccafbaf2 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:52.497632 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 596/1184] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:52.502788 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e4b2a-22a9-423c-8a11-1dde586ef7a0 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:52.503225 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e4b2a-22a9-423c-8a11-1dde586ef7a0 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:52.503326 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e4b2a-22a9-423c-8a11-1dde586ef7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:52.521709 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ad7e4b2a-22a9-423c-8a11-1dde586ef7a0 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:52.522897 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ad7e4b2a-22a9-423c-8a11-1dde586ef7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:52.531250 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 589/1185] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:52 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:52.554344 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd18b7-87da-4edd-8182-99b0ccafbaf2 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:52.566470 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd18b7-87da-4edd-8182-99b0ccafbaf2 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:52.570693 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c6b00-9640-43ae-bf31-1d58384380df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:52.571443 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c6b00-9640-43ae-bf31-1d58384380df admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:52.571721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c6b00-9640-43ae-bf31-1d58384380df admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:52.572018 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c6b00-9640-43ae-bf31-1d58384380df admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:52.582280 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c6b00-9640-43ae-bf31-1d58384380df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:30:52.589133 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-186c6b00-9640-43ae-bf31-1d58384380df admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:30:52.590919 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 597/1186] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:30:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:52.596602 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e4b2a-22a9-423c-8a11-1dde586ef7a0 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:52.605839 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e4b2a-22a9-423c-8a11-1dde586ef7a0 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:52.610330 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92df99e-5293-4dac-af3c-c7c2415e856d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:52.610968 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92df99e-5293-4dac-af3c-c7c2415e856d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:52.611249 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92df99e-5293-4dac-af3c-c7c2415e856d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:52.611523 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92df99e-5293-4dac-af3c-c7c2415e856d admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:52.612318 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92df99e-5293-4dac-af3c-c7c2415e856d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:52.612624 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92df99e-5293-4dac-af3c-c7c2415e856d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:52.614205 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92df99e-5293-4dac-af3c-c7c2415e856d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:52.622500 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 590/1187] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:30:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:52.628121 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c6b00-9640-43ae-bf31-1d58384380df admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:52.638836 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c6b00-9640-43ae-bf31-1d58384380df admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:52.643608 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5b0ea-6a32-4be0-80d3-0f83b142abfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:52.644463 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5b0ea-6a32-4be0-80d3-0f83b142abfd admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:52.644746 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5b0ea-6a32-4be0-80d3-0f83b142abfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:52.645020 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5b0ea-6a32-4be0-80d3-0f83b142abfd admin admin] PATH_INFO: `/v3/users/63d23e81280245bab3863fb7a1dbbb57` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:52.646358 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5b0ea-6a32-4be0-80d3-0f83b142abfd admin admin] RBAC: Authorizing `identity:get_user(user_id=63d23e81280245bab3863fb7a1dbbb57)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:52.648501 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5b0ea-6a32-4be0-80d3-0f83b142abfd admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:52.650194 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 598/1188] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:30:52 2022] GET /identity/v3/users/63d23e81280245bab3863fb7a1dbbb57 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:52.656183 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92df99e-5293-4dac-af3c-c7c2415e856d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:52.665575 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92df99e-5293-4dac-af3c-c7c2415e856d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:52.670110 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed95309-bfee-4ece-8605-1c55c7257788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:52.670927 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed95309-bfee-4ece-8605-1c55c7257788 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:52.671204 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed95309-bfee-4ece-8605-1c55c7257788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:52.671474 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed95309-bfee-4ece-8605-1c55c7257788 admin admin] PATH_INFO: `/v3/projects/84abde6732aa478ab4f19f20efbd22e3` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:52.672696 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed95309-bfee-4ece-8605-1c55c7257788 admin admin] RBAC: Authorizing `identity:get_project(project_id=84abde6732aa478ab4f19f20efbd22e3)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:52.674708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed95309-bfee-4ece-8605-1c55c7257788 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:52.676483 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 591/1189] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:30:52 2022] GET /identity/v3/projects/84abde6732aa478ab4f19f20efbd22e3 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:52.681757 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5b0ea-6a32-4be0-80d3-0f83b142abfd admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:52.691205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5b0ea-6a32-4be0-80d3-0f83b142abfd admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:52.695897 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0bb95-60f4-4d88-9eaf-1cec52e4a8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:52.696732 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0bb95-60f4-4d88-9eaf-1cec52e4a8d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:52.697012 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0bb95-60f4-4d88-9eaf-1cec52e4a8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:52.697284 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0bb95-60f4-4d88-9eaf-1cec52e4a8d6 admin admin] PATH_INFO: `/v3/projects/84abde6732aa478ab4f19f20efbd22e3/users/63d23e81280245bab3863fb7a1dbbb57/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:52.699951 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0bb95-60f4-4d88-9eaf-1cec52e4a8d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84abde6732aa478ab4f19f20efbd22e3, user_id=63d23e81280245bab3863fb7a1dbbb57, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:52.702525 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0bb95-60f4-4d88-9eaf-1cec52e4a8d6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:52.716246 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 599/1190] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:30:52 2022] PUT /identity/v3/projects/84abde6732aa478ab4f19f20efbd22e3/users/63d23e81280245bab3863fb7a1dbbb57/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:30:54.916174 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565eb83-e75c-4ea5-acb9-660b7c5e4535 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:54.916708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565eb83-e75c-4ea5-acb9-660b7c5e4535 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:54.916708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565eb83-e75c-4ea5-acb9-660b7c5e4535 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:54.918869 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 592/1191] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:30:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:30:54.924107 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a10364-f563-4c59-9b92-452aca9cdd61 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:54.924515 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a10364-f563-4c59-9b92-452aca9cdd61 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:54.924660 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a10364-f563-4c59-9b92-452aca9cdd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:54.941905 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-29a10364-f563-4c59-9b92-452aca9cdd61 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:30:54.943079 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-29a10364-f563-4c59-9b92-452aca9cdd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:30:54.999063 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 600/1192] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:30:54 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:30:55.023241 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565eb83-e75c-4ea5-acb9-660b7c5e4535 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:55.035314 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565eb83-e75c-4ea5-acb9-660b7c5e4535 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:55.039672 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c75091-70c9-44b1-ada0-c6bb75f86c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:55.040457 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c75091-70c9-44b1-ada0-c6bb75f86c0e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:55.040741 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c75091-70c9-44b1-ada0-c6bb75f86c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:55.041014 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c75091-70c9-44b1-ada0-c6bb75f86c0e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:55.051581 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c75091-70c9-44b1-ada0-c6bb75f86c0e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:30:55.059019 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-13c75091-70c9-44b1-ada0-c6bb75f86c0e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:30:55.060182 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 593/1193] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:30:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:30:55.065869 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a10364-f563-4c59-9b92-452aca9cdd61 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:55.075090 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a10364-f563-4c59-9b92-452aca9cdd61 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:55.079575 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae05c8-8f81-4eba-9450-4e8b2ac2c5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:55.080253 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae05c8-8f81-4eba-9450-4e8b2ac2c5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:55.080532 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae05c8-8f81-4eba-9450-4e8b2ac2c5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:55.080802 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae05c8-8f81-4eba-9450-4e8b2ac2c5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:55.081549 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae05c8-8f81-4eba-9450-4e8b2ac2c5c7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:55.081851 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae05c8-8f81-4eba-9450-4e8b2ac2c5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:55.083413 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae05c8-8f81-4eba-9450-4e8b2ac2c5c7 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:55.092149 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 601/1194] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:30:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:55.097576 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c75091-70c9-44b1-ada0-c6bb75f86c0e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:55.109119 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c75091-70c9-44b1-ada0-c6bb75f86c0e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:55.113623 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76333da-8cb3-4807-aced-4b956118b949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:55.114534 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76333da-8cb3-4807-aced-4b956118b949 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:55.114814 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76333da-8cb3-4807-aced-4b956118b949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:55.115091 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76333da-8cb3-4807-aced-4b956118b949 admin admin] PATH_INFO: `/v3/users/63d23e81280245bab3863fb7a1dbbb57` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:55.116307 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76333da-8cb3-4807-aced-4b956118b949 admin admin] RBAC: Authorizing `identity:get_user(user_id=63d23e81280245bab3863fb7a1dbbb57)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:55.118412 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76333da-8cb3-4807-aced-4b956118b949 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:55.119999 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 594/1195] 10.222.0.35 () {56 vars in 1198 bytes} [Tue Feb 8 16:30:55 2022] GET /identity/v3/users/63d23e81280245bab3863fb7a1dbbb57 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:55.125977 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae05c8-8f81-4eba-9450-4e8b2ac2c5c7 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:55.135229 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae05c8-8f81-4eba-9450-4e8b2ac2c5c7 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:55.139841 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c872f4-b461-463d-926a-ca0fcc62c867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:55.140455 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c872f4-b461-463d-926a-ca0fcc62c867 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:55.140728 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c872f4-b461-463d-926a-ca0fcc62c867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:55.141250 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c872f4-b461-463d-926a-ca0fcc62c867 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:55.148761 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c872f4-b461-463d-926a-ca0fcc62c867 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:55.150457 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c872f4-b461-463d-926a-ca0fcc62c867 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:55.159607 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 602/1196] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:30:55 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:30:55.164974 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76333da-8cb3-4807-aced-4b956118b949 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:55.175033 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76333da-8cb3-4807-aced-4b956118b949 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:55.179359 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f8d46-94bc-4c98-8a12-be2cacbff2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:55.180192 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f8d46-94bc-4c98-8a12-be2cacbff2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:55.180466 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f8d46-94bc-4c98-8a12-be2cacbff2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:55.180735 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f8d46-94bc-4c98-8a12-be2cacbff2b8 admin admin] PATH_INFO: `/v3/projects/84abde6732aa478ab4f19f20efbd22e3` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:55.181881 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f8d46-94bc-4c98-8a12-be2cacbff2b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=84abde6732aa478ab4f19f20efbd22e3)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:55.184028 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f8d46-94bc-4c98-8a12-be2cacbff2b8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:55.185617 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 595/1197] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:30:55 2022] GET /identity/v3/projects/84abde6732aa478ab4f19f20efbd22e3 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:30:55.191272 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c872f4-b461-463d-926a-ca0fcc62c867 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:30:55.200094 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c872f4-b461-463d-926a-ca0fcc62c867 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:30:55.204637 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d76b1-8786-4678-853a-09a10add1127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:30:55.205246 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d76b1-8786-4678-853a-09a10add1127 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:30:55.205632 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d76b1-8786-4678-853a-09a10add1127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:30:55.205915 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d76b1-8786-4678-853a-09a10add1127 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:30:55.206742 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d76b1-8786-4678-853a-09a10add1127 admin admin] RBAC: Adding query filter params (role.id=e6d18df5c4e74dfd8ebd9c636f45936e, scope.project.id=84abde6732aa478ab4f19f20efbd22e3, user.id=63d23e81280245bab3863fb7a1dbbb57) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:30:55.207050 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d76b1-8786-4678-853a-09a10add1127 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:30:55.208993 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d76b1-8786-4678-853a-09a10add1127 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:30:55.215214 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 603/1198] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:30:55 2022] GET /identity/v3/role_assignments?user.id=63d23e81280245bab3863fb7a1dbbb57&scope.project.id=84abde6732aa478ab4f19f20efbd22e3&role.id=e6d18df5c4e74dfd8ebd9c636f45936e => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:31:56.518220 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179153e-3038-4ab4-98e2-adf73a1e10bd None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:31:56.519022 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179153e-3038-4ab4-98e2-adf73a1e10bd None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:31:56.519022 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179153e-3038-4ab4-98e2-adf73a1e10bd None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:31:56.521148 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 596/1199] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:31:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:31:56.528943 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ee46e-80f3-43e4-a901-b935b855cd3c None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:31:56.529729 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ee46e-80f3-43e4-a901-b935b855cd3c None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:31:56.529729 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ee46e-80f3-43e4-a901-b935b855cd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:31:56.550590 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-7c9ee46e-80f3-43e4-a901-b935b855cd3c None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:31:56.552376 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-7c9ee46e-80f3-43e4-a901-b935b855cd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:31:56.565027 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 604/1200] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:31:56 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:31:56.606316 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179153e-3038-4ab4-98e2-adf73a1e10bd None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:31:56.620911 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179153e-3038-4ab4-98e2-adf73a1e10bd None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:31:56.625877 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1258b4-a7c3-42ee-9fad-419e1f668aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:31:56.626898 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1258b4-a7c3-42ee-9fad-419e1f668aef admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:31:56.627198 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1258b4-a7c3-42ee-9fad-419e1f668aef admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:31:56.627469 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1258b4-a7c3-42ee-9fad-419e1f668aef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:31:56.639720 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1258b4-a7c3-42ee-9fad-419e1f668aef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:31:56.641934 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1258b4-a7c3-42ee-9fad-419e1f668aef admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:31:56.667787 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-1f1258b4-a7c3-42ee-9fad-419e1f668aef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:31:56.669407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 597/1201] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:31:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:31:56.676497 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ee46e-80f3-43e4-a901-b935b855cd3c None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:31:56.686892 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ee46e-80f3-43e4-a901-b935b855cd3c None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:31:56.691560 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017fbda-e782-4185-a790-2376efd8c987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:31:56.692259 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017fbda-e782-4185-a790-2376efd8c987 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:31:56.692608 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017fbda-e782-4185-a790-2376efd8c987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:31:56.692795 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017fbda-e782-4185-a790-2376efd8c987 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:31:56.693547 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017fbda-e782-4185-a790-2376efd8c987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:31:56.693898 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017fbda-e782-4185-a790-2376efd8c987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:31:56.695529 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017fbda-e782-4185-a790-2376efd8c987 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:31:56.712908 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 605/1202] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:31:56.720511 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1258b4-a7c3-42ee-9fad-419e1f668aef admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:31:56.732297 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1258b4-a7c3-42ee-9fad-419e1f668aef admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:31:56.737786 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0af5ca-0af7-49da-bec6-78ae6a4b1fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:31:56.740531 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0af5ca-0af7-49da-bec6-78ae6a4b1fef admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:31:56.740531 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0af5ca-0af7-49da-bec6-78ae6a4b1fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:31:56.740531 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0af5ca-0af7-49da-bec6-78ae6a4b1fef admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:31:56.740531 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0af5ca-0af7-49da-bec6-78ae6a4b1fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:31:56.741805 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0af5ca-0af7-49da-bec6-78ae6a4b1fef admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:31:56.770353 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 598/1203] 10.222.0.35 () {60 vars in 1153 bytes} [Tue Feb 8 16:31:56 2022] POST /identity/v3/users => generated 251 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:31:59.407038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cc27a-7eb3-4270-9ff9-ddd038e96db8 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:31:59.407620 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cc27a-7eb3-4270-9ff9-ddd038e96db8 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:31:59.407620 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cc27a-7eb3-4270-9ff9-ddd038e96db8 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:31:59.409835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 606/1204] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:31:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:31:59.417858 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60ce21-424a-4d2c-91cf-f90c23bdd377 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:31:59.418398 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60ce21-424a-4d2c-91cf-f90c23bdd377 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:31:59.418789 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60ce21-424a-4d2c-91cf-f90c23bdd377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:31:59.441226 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-bc60ce21-424a-4d2c-91cf-f90c23bdd377 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:31:59.442927 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-bc60ce21-424a-4d2c-91cf-f90c23bdd377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:31:59.451255 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 599/1205] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:31:59 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:31:59.481587 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cc27a-7eb3-4270-9ff9-ddd038e96db8 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:31:59.497036 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cc27a-7eb3-4270-9ff9-ddd038e96db8 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:31:59.502844 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e2d86-7465-4e7b-bc7f-387472929bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:31:59.503736 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e2d86-7465-4e7b-bc7f-387472929bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:31:59.504048 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e2d86-7465-4e7b-bc7f-387472929bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:31:59.504342 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e2d86-7465-4e7b-bc7f-387472929bd1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:31:59.518536 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e2d86-7465-4e7b-bc7f-387472929bd1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:31:59.526722 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-054e2d86-7465-4e7b-bc7f-387472929bd1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 08 16:31:59.531961 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 607/1206] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:31:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:31:59.534765 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60ce21-424a-4d2c-91cf-f90c23bdd377 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:31:59.544488 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60ce21-424a-4d2c-91cf-f90c23bdd377 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:31:59.549738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2248bd4-cd43-42ff-bdb3-b297d7cdae36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:31:59.550367 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2248bd4-cd43-42ff-bdb3-b297d7cdae36 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:31:59.550657 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2248bd4-cd43-42ff-bdb3-b297d7cdae36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:31:59.550920 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2248bd4-cd43-42ff-bdb3-b297d7cdae36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:31:59.551698 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2248bd4-cd43-42ff-bdb3-b297d7cdae36 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:31:59.552041 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2248bd4-cd43-42ff-bdb3-b297d7cdae36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:31:59.553772 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2248bd4-cd43-42ff-bdb3-b297d7cdae36 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:31:59.568273 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 600/1207] 10.222.0.35 () {56 vars in 1124 bytes} [Tue Feb 8 16:31:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:31:59.569534 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e2d86-7465-4e7b-bc7f-387472929bd1 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:31:59.582239 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e2d86-7465-4e7b-bc7f-387472929bd1 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:31:59.588778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3512ad-aac7-4b7a-b8fa-880577c8dcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:31:59.589791 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3512ad-aac7-4b7a-b8fa-880577c8dcdb admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:31:59.590100 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3512ad-aac7-4b7a-b8fa-880577c8dcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:31:59.590392 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3512ad-aac7-4b7a-b8fa-880577c8dcdb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:31:59.604148 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3512ad-aac7-4b7a-b8fa-880577c8dcdb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:31:59.606322 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3512ad-aac7-4b7a-b8fa-880577c8dcdb admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:31:59.751546 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-7e3512ad-aac7-4b7a-b8fa-880577c8dcdb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:31:59.753367 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 608/1208] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:31:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:31:59.759543 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2248bd4-cd43-42ff-bdb3-b297d7cdae36 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:31:59.769821 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2248bd4-cd43-42ff-bdb3-b297d7cdae36 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:31:59.777172 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c234f1-5d3e-40e8-89d3-a55e37e1a591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:31:59.778540 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c234f1-5d3e-40e8-89d3-a55e37e1a591 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:31:59.779186 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c234f1-5d3e-40e8-89d3-a55e37e1a591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:31:59.779854 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c234f1-5d3e-40e8-89d3-a55e37e1a591 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:31:59.781319 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c234f1-5d3e-40e8-89d3-a55e37e1a591 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:31:59.781902 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c234f1-5d3e-40e8-89d3-a55e37e1a591 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:31:59.784302 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c234f1-5d3e-40e8-89d3-a55e37e1a591 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:31:59.801772 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 601/1209] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:31:59.808789 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3512ad-aac7-4b7a-b8fa-880577c8dcdb admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:31:59.819919 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3512ad-aac7-4b7a-b8fa-880577c8dcdb admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:31:59.826449 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758a14f-377c-4fa4-8cf5-7377ca1b4883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:31:59.827328 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758a14f-377c-4fa4-8cf5-7377ca1b4883 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:31:59.827615 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758a14f-377c-4fa4-8cf5-7377ca1b4883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:31:59.827929 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758a14f-377c-4fa4-8cf5-7377ca1b4883 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:31:59.836925 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758a14f-377c-4fa4-8cf5-7377ca1b4883 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:31:59.839098 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758a14f-377c-4fa4-8cf5-7377ca1b4883 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:31:59.852707 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-9758a14f-377c-4fa4-8cf5-7377ca1b4883 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 08 16:31:59.853895 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 609/1210] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:31:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:31:59.859893 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c234f1-5d3e-40e8-89d3-a55e37e1a591 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:31:59.870420 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c234f1-5d3e-40e8-89d3-a55e37e1a591 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:31:59.875432 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e279cf-0799-48cc-aa86-e87832ae7679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:31:59.876250 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e279cf-0799-48cc-aa86-e87832ae7679 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:31:59.876583 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e279cf-0799-48cc-aa86-e87832ae7679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:31:59.876968 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e279cf-0799-48cc-aa86-e87832ae7679 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:31:59.877935 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e279cf-0799-48cc-aa86-e87832ae7679 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:31:59.878337 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e279cf-0799-48cc-aa86-e87832ae7679 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:31:59.880312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e279cf-0799-48cc-aa86-e87832ae7679 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:31:59.903800 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 602/1211] 10.222.0.35 () {56 vars in 1164 bytes} [Tue Feb 8 16:31:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:31:59.907795 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758a14f-377c-4fa4-8cf5-7377ca1b4883 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:31:59.918479 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758a14f-377c-4fa4-8cf5-7377ca1b4883 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:31:59.924872 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296147d-1378-4434-a1f0-040b456e9213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:31:59.925981 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296147d-1378-4434-a1f0-040b456e9213 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:31:59.925981 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296147d-1378-4434-a1f0-040b456e9213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:31:59.926159 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296147d-1378-4434-a1f0-040b456e9213 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:31:59.935613 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296147d-1378-4434-a1f0-040b456e9213 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:31:59.939456 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296147d-1378-4434-a1f0-040b456e9213 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:31:59.947449 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 610/1212] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:31:59 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:31:59.954034 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e279cf-0799-48cc-aa86-e87832ae7679 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:31:59.965194 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e279cf-0799-48cc-aa86-e87832ae7679 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:31:59.969996 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da027828-22e0-4602-a1c2-cdcac1799843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:31:59.970773 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da027828-22e0-4602-a1c2-cdcac1799843 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:31:59.971054 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da027828-22e0-4602-a1c2-cdcac1799843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:31:59.971330 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da027828-22e0-4602-a1c2-cdcac1799843 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:31:59.982978 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da027828-22e0-4602-a1c2-cdcac1799843 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:31:59.984990 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da027828-22e0-4602-a1c2-cdcac1799843 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:00.006689 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-da027828-22e0-4602-a1c2-cdcac1799843 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:32:00.008309 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 603/1213] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:31:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:00.013969 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296147d-1378-4434-a1f0-040b456e9213 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:00.026071 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296147d-1378-4434-a1f0-040b456e9213 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:00.031414 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da321a-9f4a-412a-a2b6-4c836aa6c6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:00.032098 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da321a-9f4a-412a-a2b6-4c836aa6c6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:00.032375 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da321a-9f4a-412a-a2b6-4c836aa6c6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:00.032654 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da321a-9f4a-412a-a2b6-4c836aa6c6c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:00.033441 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da321a-9f4a-412a-a2b6-4c836aa6c6c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:00.033826 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da321a-9f4a-412a-a2b6-4c836aa6c6c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:00.035383 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da321a-9f4a-412a-a2b6-4c836aa6c6c4 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:00.051232 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 611/1214] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:00.057821 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da027828-22e0-4602-a1c2-cdcac1799843 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:00.067575 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da027828-22e0-4602-a1c2-cdcac1799843 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:00.073942 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa8d66-79eb-4c24-80f1-3d99eec76064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:00.074973 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa8d66-79eb-4c24-80f1-3d99eec76064 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:00.075399 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa8d66-79eb-4c24-80f1-3d99eec76064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:00.075715 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa8d66-79eb-4c24-80f1-3d99eec76064 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:00.084463 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa8d66-79eb-4c24-80f1-3d99eec76064 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:00.086919 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa8d66-79eb-4c24-80f1-3d99eec76064 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:00.103163 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-57fa8d66-79eb-4c24-80f1-3d99eec76064 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:32:00.109623 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 604/1215] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:32:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:00.111340 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da321a-9f4a-412a-a2b6-4c836aa6c6c4 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:00.122264 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da321a-9f4a-412a-a2b6-4c836aa6c6c4 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:00.127018 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b232a7-c11b-4c77-a63d-def82db4362c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:00.127664 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b232a7-c11b-4c77-a63d-def82db4362c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:00.127975 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b232a7-c11b-4c77-a63d-def82db4362c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:00.128244 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b232a7-c11b-4c77-a63d-def82db4362c admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:00.129085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b232a7-c11b-4c77-a63d-def82db4362c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:00.129473 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b232a7-c11b-4c77-a63d-def82db4362c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:00.131303 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b232a7-c11b-4c77-a63d-def82db4362c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:00.144590 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 612/1216] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:32:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:00.151410 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa8d66-79eb-4c24-80f1-3d99eec76064 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:00.165713 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa8d66-79eb-4c24-80f1-3d99eec76064 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:00.172468 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591242e-c9dc-46be-bc4d-75b05af4293f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:00.173261 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591242e-c9dc-46be-bc4d-75b05af4293f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:00.173837 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591242e-c9dc-46be-bc4d-75b05af4293f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:00.174248 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591242e-c9dc-46be-bc4d-75b05af4293f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:00.175709 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591242e-c9dc-46be-bc4d-75b05af4293f admin admin] RBAC: Adding query filter params (role.id=54ef06f5478a48d08a2c08df2500fe6f, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=75c8f232fc83474b8731ee6c1eb321fd) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:00.176344 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591242e-c9dc-46be-bc4d-75b05af4293f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:00.178949 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591242e-c9dc-46be-bc4d-75b05af4293f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:00.187192 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 605/1217] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:32:00 2022] GET /identity/v3/role_assignments?user.id=75c8f232fc83474b8731ee6c1eb321fd&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=54ef06f5478a48d08a2c08df2500fe6f => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:02.652953 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc5b04-1254-4cdc-808a-d9f96753c866 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:02.653462 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc5b04-1254-4cdc-808a-d9f96753c866 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:02.653462 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc5b04-1254-4cdc-808a-d9f96753c866 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:02.655576 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 613/1218] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:32:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:32:02.661348 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e08d23-5510-4bcd-bcb4-f418abbf66a0 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:02.661838 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e08d23-5510-4bcd-bcb4-f418abbf66a0 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:02.661988 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e08d23-5510-4bcd-bcb4-f418abbf66a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:02.682574 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-33e08d23-5510-4bcd-bcb4-f418abbf66a0 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:32:02.684075 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-33e08d23-5510-4bcd-bcb4-f418abbf66a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:32:02.693168 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 606/1219] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:32:02 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:32:02.717923 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc5b04-1254-4cdc-808a-d9f96753c866 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:02.732643 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc5b04-1254-4cdc-808a-d9f96753c866 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:02.737488 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a597cb4-077c-439a-b8fc-6c0e2182d279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:02.738259 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a597cb4-077c-439a-b8fc-6c0e2182d279 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:02.738541 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a597cb4-077c-439a-b8fc-6c0e2182d279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:02.738882 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a597cb4-077c-439a-b8fc-6c0e2182d279 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:02.751724 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a597cb4-077c-439a-b8fc-6c0e2182d279 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:32:02.760041 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-7a597cb4-077c-439a-b8fc-6c0e2182d279 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 08 16:32:02.763924 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 614/1220] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:32:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:02.768138 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e08d23-5510-4bcd-bcb4-f418abbf66a0 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:02.778707 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e08d23-5510-4bcd-bcb4-f418abbf66a0 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:02.787887 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5effe-1711-4949-a148-9d567a73d8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:02.788700 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5effe-1711-4949-a148-9d567a73d8ff admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:02.789103 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5effe-1711-4949-a148-9d567a73d8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:02.790024 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5effe-1711-4949-a148-9d567a73d8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:02.790870 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5effe-1711-4949-a148-9d567a73d8ff admin admin] RBAC: Adding query filter params (name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:02.791403 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5effe-1711-4949-a148-9d567a73d8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:02.793166 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5effe-1711-4949-a148-9d567a73d8ff admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:02.804217 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 607/1221] 10.222.0.35 () {56 vars in 1124 bytes} [Tue Feb 8 16:32:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:32:02.810250 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a597cb4-077c-439a-b8fc-6c0e2182d279 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:02.823849 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a597cb4-077c-439a-b8fc-6c0e2182d279 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:02.830463 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25645f6f-3964-4718-8b95-b3266d1f44ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:02.831344 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25645f6f-3964-4718-8b95-b3266d1f44ee admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:02.831626 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25645f6f-3964-4718-8b95-b3266d1f44ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:02.831986 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25645f6f-3964-4718-8b95-b3266d1f44ee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:02.853799 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25645f6f-3964-4718-8b95-b3266d1f44ee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:02.856477 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25645f6f-3964-4718-8b95-b3266d1f44ee admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:02.875252 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-25645f6f-3964-4718-8b95-b3266d1f44ee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:32:02.876737 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 615/1222] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:32:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:02.882688 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5effe-1711-4949-a148-9d567a73d8ff admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:02.894393 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5effe-1711-4949-a148-9d567a73d8ff admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:02.899830 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777dca7-d60a-4536-bb49-8a2a4e3b22bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:02.900513 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777dca7-d60a-4536-bb49-8a2a4e3b22bb admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:02.900794 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777dca7-d60a-4536-bb49-8a2a4e3b22bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:02.901065 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777dca7-d60a-4536-bb49-8a2a4e3b22bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:02.901823 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777dca7-d60a-4536-bb49-8a2a4e3b22bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:02.902127 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777dca7-d60a-4536-bb49-8a2a4e3b22bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:02.903789 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777dca7-d60a-4536-bb49-8a2a4e3b22bb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:02.916418 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 608/1223] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:02.922366 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25645f6f-3964-4718-8b95-b3266d1f44ee admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:02.932966 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25645f6f-3964-4718-8b95-b3266d1f44ee admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:02.937753 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bf726-880d-4263-932b-ed0b482ed33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:02.938529 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bf726-880d-4263-932b-ed0b482ed33f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:02.938813 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bf726-880d-4263-932b-ed0b482ed33f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:02.939086 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bf726-880d-4263-932b-ed0b482ed33f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:02.947547 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5bf726-880d-4263-932b-ed0b482ed33f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:02.949688 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5bf726-880d-4263-932b-ed0b482ed33f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:02.964168 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-2f5bf726-880d-4263-932b-ed0b482ed33f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 08 16:32:02.965563 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 616/1224] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:32:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:02.971156 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777dca7-d60a-4536-bb49-8a2a4e3b22bb admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:02.981644 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777dca7-d60a-4536-bb49-8a2a4e3b22bb admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:02.986684 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32c3cc-e875-407f-87e5-7904e1d70e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:02.987538 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32c3cc-e875-407f-87e5-7904e1d70e74 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:02.987879 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32c3cc-e875-407f-87e5-7904e1d70e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:02.988190 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32c3cc-e875-407f-87e5-7904e1d70e74 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:02.989167 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32c3cc-e875-407f-87e5-7904e1d70e74 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:02.989569 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32c3cc-e875-407f-87e5-7904e1d70e74 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:02.991727 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32c3cc-e875-407f-87e5-7904e1d70e74 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:03.015526 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 609/1225] 10.222.0.35 () {56 vars in 1164 bytes} [Tue Feb 8 16:32:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:32:03.016802 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bf726-880d-4263-932b-ed0b482ed33f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:03.027886 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bf726-880d-4263-932b-ed0b482ed33f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:03.032901 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d098c4-ca58-42ca-8c93-2d910dd32067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:03.033678 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d098c4-ca58-42ca-8c93-2d910dd32067 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:03.033957 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d098c4-ca58-42ca-8c93-2d910dd32067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:03.034231 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d098c4-ca58-42ca-8c93-2d910dd32067 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:03.045271 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d098c4-ca58-42ca-8c93-2d910dd32067 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:03.047096 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d098c4-ca58-42ca-8c93-2d910dd32067 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:03.064416 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-56d098c4-ca58-42ca-8c93-2d910dd32067 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:32:03.065811 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 617/1226] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:32:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:03.071746 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32c3cc-e875-407f-87e5-7904e1d70e74 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:03.082244 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32c3cc-e875-407f-87e5-7904e1d70e74 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:03.088334 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414c61b-065d-4756-aa2b-2c6e84658a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:03.089019 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414c61b-065d-4756-aa2b-2c6e84658a71 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:03.089319 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414c61b-065d-4756-aa2b-2c6e84658a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:03.089651 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414c61b-065d-4756-aa2b-2c6e84658a71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:03.090444 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414c61b-065d-4756-aa2b-2c6e84658a71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:03.090815 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414c61b-065d-4756-aa2b-2c6e84658a71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:03.092721 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414c61b-065d-4756-aa2b-2c6e84658a71 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:03.105936 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 610/1227] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:03.111971 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d098c4-ca58-42ca-8c93-2d910dd32067 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:03.122771 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d098c4-ca58-42ca-8c93-2d910dd32067 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:03.129940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ba804-a3e3-45f7-9c18-14e20ddbd286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:03.129940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ba804-a3e3-45f7-9c18-14e20ddbd286 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:03.129940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ba804-a3e3-45f7-9c18-14e20ddbd286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:03.129940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ba804-a3e3-45f7-9c18-14e20ddbd286 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:03.138258 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ba804-a3e3-45f7-9c18-14e20ddbd286 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:03.141050 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ba804-a3e3-45f7-9c18-14e20ddbd286 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:03.155809 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-ee0ba804-a3e3-45f7-9c18-14e20ddbd286 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:32:03.156953 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 618/1228] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:32:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:03.163731 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414c61b-065d-4756-aa2b-2c6e84658a71 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:03.177467 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414c61b-065d-4756-aa2b-2c6e84658a71 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:03.184054 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a835d9f-3e13-4753-92e5-bed50d411755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:03.184794 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a835d9f-3e13-4753-92e5-bed50d411755 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:03.185070 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a835d9f-3e13-4753-92e5-bed50d411755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:03.185393 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a835d9f-3e13-4753-92e5-bed50d411755 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:03.186257 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a835d9f-3e13-4753-92e5-bed50d411755 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:03.186587 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a835d9f-3e13-4753-92e5-bed50d411755 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:03.188601 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a835d9f-3e13-4753-92e5-bed50d411755 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:03.204939 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 611/1229] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:32:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:03.212243 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ba804-a3e3-45f7-9c18-14e20ddbd286 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:03.225630 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ba804-a3e3-45f7-9c18-14e20ddbd286 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:03.232680 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2518e-550e-4d9c-8678-0974e9174108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:03.233908 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2518e-550e-4d9c-8678-0974e9174108 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:03.234205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2518e-550e-4d9c-8678-0974e9174108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:03.234538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2518e-550e-4d9c-8678-0974e9174108 admin admin] PATH_INFO: `/v3/projects/6b01069799b34858bbebc201a3f2046d/users/75c8f232fc83474b8731ee6c1eb321fd/roles/54ef06f5478a48d08a2c08df2500fe6f` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:03.252464 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2518e-550e-4d9c-8678-0974e9174108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b01069799b34858bbebc201a3f2046d, user_id=75c8f232fc83474b8731ee6c1eb321fd, role_id=54ef06f5478a48d08a2c08df2500fe6f)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:03.255424 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2518e-550e-4d9c-8678-0974e9174108 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:03.274846 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 619/1230] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:32:03 2022] PUT /identity/v3/projects/6b01069799b34858bbebc201a3f2046d/users/75c8f232fc83474b8731ee6c1eb321fd/roles/54ef06f5478a48d08a2c08df2500fe6f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:32:05.634300 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cfc42-c17e-479a-9d85-b4ab9ccc5fe2 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:05.634955 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cfc42-c17e-479a-9d85-b4ab9ccc5fe2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:05.635114 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cfc42-c17e-479a-9d85-b4ab9ccc5fe2 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:05.637435 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 612/1231] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:32:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:32:05.644864 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674012b6-475d-44e4-bd0a-b734789b0416 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:05.645391 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674012b6-475d-44e4-bd0a-b734789b0416 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:05.645494 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674012b6-475d-44e4-bd0a-b734789b0416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:05.666773 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-674012b6-475d-44e4-bd0a-b734789b0416 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:32:05.667992 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-674012b6-475d-44e4-bd0a-b734789b0416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:32:05.730466 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 620/1232] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:32:05 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:32:05.760290 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cfc42-c17e-479a-9d85-b4ab9ccc5fe2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:05.774472 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cfc42-c17e-479a-9d85-b4ab9ccc5fe2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:05.779790 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4d981-1b3f-46ec-bce5-21f13ce68a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:05.780794 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4d981-1b3f-46ec-bce5-21f13ce68a7d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:05.781179 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4d981-1b3f-46ec-bce5-21f13ce68a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:05.781618 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4d981-1b3f-46ec-bce5-21f13ce68a7d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:05.792456 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4d981-1b3f-46ec-bce5-21f13ce68a7d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:32:05.800853 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-fde4d981-1b3f-46ec-bce5-21f13ce68a7d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 08 16:32:05.802465 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 613/1233] 10.222.0.35 () {56 vars in 1123 bytes} [Tue Feb 8 16:32:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:05.810463 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674012b6-475d-44e4-bd0a-b734789b0416 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:05.819602 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674012b6-475d-44e4-bd0a-b734789b0416 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:05.825261 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5053eb-7993-44f3-acaa-c09eecedfacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:05.825881 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5053eb-7993-44f3-acaa-c09eecedfacc admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:05.826162 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5053eb-7993-44f3-acaa-c09eecedfacc admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:05.826443 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5053eb-7993-44f3-acaa-c09eecedfacc admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:05.827203 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5053eb-7993-44f3-acaa-c09eecedfacc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:05.827509 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5053eb-7993-44f3-acaa-c09eecedfacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:05.829131 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5053eb-7993-44f3-acaa-c09eecedfacc admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:05.838442 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 621/1234] 10.222.0.35 () {56 vars in 1124 bytes} [Tue Feb 8 16:32:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:05.844503 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4d981-1b3f-46ec-bce5-21f13ce68a7d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:05.854901 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4d981-1b3f-46ec-bce5-21f13ce68a7d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:05.860180 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d239684-54d0-40a6-8780-93fb2c0f9a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:05.861198 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d239684-54d0-40a6-8780-93fb2c0f9a51 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:05.861775 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d239684-54d0-40a6-8780-93fb2c0f9a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:05.862054 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d239684-54d0-40a6-8780-93fb2c0f9a51 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:05.873492 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d239684-54d0-40a6-8780-93fb2c0f9a51 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:05.876073 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d239684-54d0-40a6-8780-93fb2c0f9a51 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:05.895675 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-4d239684-54d0-40a6-8780-93fb2c0f9a51 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:32:05.896990 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 614/1235] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:32:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:05.904143 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5053eb-7993-44f3-acaa-c09eecedfacc admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:05.915602 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5053eb-7993-44f3-acaa-c09eecedfacc admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:05.921075 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d58f0-2984-4973-af03-a2b06e3839de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:05.921843 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d58f0-2984-4973-af03-a2b06e3839de admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:05.922192 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d58f0-2984-4973-af03-a2b06e3839de admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:05.922579 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d58f0-2984-4973-af03-a2b06e3839de admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:05.923449 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d58f0-2984-4973-af03-a2b06e3839de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:05.923781 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d58f0-2984-4973-af03-a2b06e3839de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:05.925497 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d58f0-2984-4973-af03-a2b06e3839de admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:05.939163 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 622/1236] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:05.947258 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d239684-54d0-40a6-8780-93fb2c0f9a51 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:05.959029 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d239684-54d0-40a6-8780-93fb2c0f9a51 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:05.965056 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d791cf-6a31-4287-aa28-e56926d2ca23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:05.966025 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d791cf-6a31-4287-aa28-e56926d2ca23 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:05.966440 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d791cf-6a31-4287-aa28-e56926d2ca23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:05.966789 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d791cf-6a31-4287-aa28-e56926d2ca23 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:05.977243 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d791cf-6a31-4287-aa28-e56926d2ca23 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:05.979558 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d791cf-6a31-4287-aa28-e56926d2ca23 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:06.000481 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-63d791cf-6a31-4287-aa28-e56926d2ca23 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 08 16:32:06.002006 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 615/1237] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:32:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:06.009220 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d58f0-2984-4973-af03-a2b06e3839de admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:06.021141 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d58f0-2984-4973-af03-a2b06e3839de admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:06.026760 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578e1f9-64f6-43bd-aaf3-da4940918bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:06.027492 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578e1f9-64f6-43bd-aaf3-da4940918bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:06.027931 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578e1f9-64f6-43bd-aaf3-da4940918bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:06.028256 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578e1f9-64f6-43bd-aaf3-da4940918bb9 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:06.029248 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578e1f9-64f6-43bd-aaf3-da4940918bb9 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:06.029595 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578e1f9-64f6-43bd-aaf3-da4940918bb9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:06.031556 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578e1f9-64f6-43bd-aaf3-da4940918bb9 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:06.053892 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 623/1238] 10.222.0.35 () {56 vars in 1164 bytes} [Tue Feb 8 16:32:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:06.061513 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d791cf-6a31-4287-aa28-e56926d2ca23 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:06.072994 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d791cf-6a31-4287-aa28-e56926d2ca23 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:06.078687 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e97805-76c9-433e-aaa6-c70d910385ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:06.079507 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e97805-76c9-433e-aaa6-c70d910385ca admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:06.079671 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e97805-76c9-433e-aaa6-c70d910385ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:06.080118 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e97805-76c9-433e-aaa6-c70d910385ca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:06.089476 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e97805-76c9-433e-aaa6-c70d910385ca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:06.091360 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e97805-76c9-433e-aaa6-c70d910385ca admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:06.104173 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 616/1239] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:32:06 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:32:06.110359 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578e1f9-64f6-43bd-aaf3-da4940918bb9 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:06.121515 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578e1f9-64f6-43bd-aaf3-da4940918bb9 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:06.127381 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adf1e1-c1e2-480d-94ef-5779858bd518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:06.128395 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adf1e1-c1e2-480d-94ef-5779858bd518 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:06.128822 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adf1e1-c1e2-480d-94ef-5779858bd518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:06.129308 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adf1e1-c1e2-480d-94ef-5779858bd518 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:06.140699 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adf1e1-c1e2-480d-94ef-5779858bd518 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:06.142664 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adf1e1-c1e2-480d-94ef-5779858bd518 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:06.160066 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-a2adf1e1-c1e2-480d-94ef-5779858bd518 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:32:06.161192 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 624/1240] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:32:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:06.167794 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e97805-76c9-433e-aaa6-c70d910385ca admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:06.177642 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e97805-76c9-433e-aaa6-c70d910385ca admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:06.183411 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06515b9-b27a-4866-83e0-811248d6d336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:06.184779 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06515b9-b27a-4866-83e0-811248d6d336 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:06.185058 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06515b9-b27a-4866-83e0-811248d6d336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:06.185326 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06515b9-b27a-4866-83e0-811248d6d336 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:06.186048 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06515b9-b27a-4866-83e0-811248d6d336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:06.186344 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06515b9-b27a-4866-83e0-811248d6d336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:06.187937 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06515b9-b27a-4866-83e0-811248d6d336 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:06.200474 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 617/1241] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:06.206558 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adf1e1-c1e2-480d-94ef-5779858bd518 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:06.217994 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adf1e1-c1e2-480d-94ef-5779858bd518 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:06.223377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe0fe1-f704-42ba-bdee-81fcf831810d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:06.224443 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe0fe1-f704-42ba-bdee-81fcf831810d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:06.224778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe0fe1-f704-42ba-bdee-81fcf831810d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:06.225204 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe0fe1-f704-42ba-bdee-81fcf831810d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:06.233473 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe0fe1-f704-42ba-bdee-81fcf831810d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:06.236111 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe0fe1-f704-42ba-bdee-81fcf831810d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:06.251220 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-76fe0fe1-f704-42ba-bdee-81fcf831810d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:32:06.252533 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 625/1242] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:32:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:32:06.259290 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06515b9-b27a-4866-83e0-811248d6d336 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:06.273755 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06515b9-b27a-4866-83e0-811248d6d336 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:06.279100 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7bc55-eeb4-4a41-bb73-92ada59b4e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:06.279745 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7bc55-eeb4-4a41-bb73-92ada59b4e83 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:06.280052 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7bc55-eeb4-4a41-bb73-92ada59b4e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:06.280326 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7bc55-eeb4-4a41-bb73-92ada59b4e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:06.281232 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7bc55-eeb4-4a41-bb73-92ada59b4e83 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:06.281575 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7bc55-eeb4-4a41-bb73-92ada59b4e83 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:06.283643 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7bc55-eeb4-4a41-bb73-92ada59b4e83 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:06.298050 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 618/1243] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:32:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:06.306696 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe0fe1-f704-42ba-bdee-81fcf831810d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:06.317931 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe0fe1-f704-42ba-bdee-81fcf831810d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:06.323090 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f4d89-2fb7-48a7-a3b2-2792e42c8d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:06.323778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f4d89-2fb7-48a7-a3b2-2792e42c8d35 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:06.324090 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f4d89-2fb7-48a7-a3b2-2792e42c8d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:06.324388 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f4d89-2fb7-48a7-a3b2-2792e42c8d35 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:06.325282 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f4d89-2fb7-48a7-a3b2-2792e42c8d35 admin admin] RBAC: Adding query filter params (role.id=54ef06f5478a48d08a2c08df2500fe6f, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=75c8f232fc83474b8731ee6c1eb321fd) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:06.325644 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f4d89-2fb7-48a7-a3b2-2792e42c8d35 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:06.327616 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f4d89-2fb7-48a7-a3b2-2792e42c8d35 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:06.334236 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 626/1244] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:32:06 2022] GET /identity/v3/role_assignments?user.id=75c8f232fc83474b8731ee6c1eb321fd&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=54ef06f5478a48d08a2c08df2500fe6f => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:32:08.741277 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849bd41-7c75-4961-9286-fac4247d4664 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:08.741785 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849bd41-7c75-4961-9286-fac4247d4664 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:08.741785 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849bd41-7c75-4961-9286-fac4247d4664 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:08.744073 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 619/1245] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:32:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:32:08.750509 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fce2b-e909-4a7e-8ff4-17e2ab091425 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:08.750971 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fce2b-e909-4a7e-8ff4-17e2ab091425 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:08.751199 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fce2b-e909-4a7e-8ff4-17e2ab091425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:08.771070 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-1c7fce2b-e909-4a7e-8ff4-17e2ab091425 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:32:08.772499 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-1c7fce2b-e909-4a7e-8ff4-17e2ab091425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:32:08.783053 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 627/1246] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:32:08 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:32:08.809862 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849bd41-7c75-4961-9286-fac4247d4664 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:08.823084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849bd41-7c75-4961-9286-fac4247d4664 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:08.827478 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e6a27-591f-4b17-88c8-ee21748c9288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:08.828271 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e6a27-591f-4b17-88c8-ee21748c9288 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:08.828550 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e6a27-591f-4b17-88c8-ee21748c9288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:08.828821 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e6a27-591f-4b17-88c8-ee21748c9288 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:08.839777 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e6a27-591f-4b17-88c8-ee21748c9288 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:32:08.846742 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-db8e6a27-591f-4b17-88c8-ee21748c9288 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:32:08.847941 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 620/1247] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:32:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:32:08.854864 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fce2b-e909-4a7e-8ff4-17e2ab091425 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:08.866594 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fce2b-e909-4a7e-8ff4-17e2ab091425 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:08.872414 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d31255-749e-49f3-ba40-1cfca0f6b57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:08.873253 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d31255-749e-49f3-ba40-1cfca0f6b57a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:08.873636 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d31255-749e-49f3-ba40-1cfca0f6b57a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:08.874083 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d31255-749e-49f3-ba40-1cfca0f6b57a admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:08.875019 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d31255-749e-49f3-ba40-1cfca0f6b57a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:08.875474 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d31255-749e-49f3-ba40-1cfca0f6b57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:08.877740 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d31255-749e-49f3-ba40-1cfca0f6b57a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:08.887340 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 628/1248] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:32:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:08.893204 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e6a27-591f-4b17-88c8-ee21748c9288 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:08.904760 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e6a27-591f-4b17-88c8-ee21748c9288 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:08.909797 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ce3f3-f71e-4ac5-a88c-b3b7792421b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:08.910604 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ce3f3-f71e-4ac5-a88c-b3b7792421b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:08.910888 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ce3f3-f71e-4ac5-a88c-b3b7792421b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:08.911163 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ce3f3-f71e-4ac5-a88c-b3b7792421b7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:08.924587 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ce3f3-f71e-4ac5-a88c-b3b7792421b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:08.926429 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ce3f3-f71e-4ac5-a88c-b3b7792421b7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:08.945943 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-e17ce3f3-f71e-4ac5-a88c-b3b7792421b7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:32:08.947466 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 621/1249] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:32:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:08.954592 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d31255-749e-49f3-ba40-1cfca0f6b57a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:08.966302 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d31255-749e-49f3-ba40-1cfca0f6b57a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:08.972098 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e93bf-c763-4c19-a2fe-a14af6865a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:08.972819 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e93bf-c763-4c19-a2fe-a14af6865a8d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:08.973195 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e93bf-c763-4c19-a2fe-a14af6865a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:08.973632 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e93bf-c763-4c19-a2fe-a14af6865a8d admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:08.974613 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e93bf-c763-4c19-a2fe-a14af6865a8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:08.974911 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e93bf-c763-4c19-a2fe-a14af6865a8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:08.978088 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e93bf-c763-4c19-a2fe-a14af6865a8d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:08.992972 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 629/1250] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:08.999714 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ce3f3-f71e-4ac5-a88c-b3b7792421b7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:09.010035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ce3f3-f71e-4ac5-a88c-b3b7792421b7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:09.015411 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ade498-638a-4466-9e9e-e3e300140054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:09.016722 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ade498-638a-4466-9e9e-e3e300140054 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:09.017089 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ade498-638a-4466-9e9e-e3e300140054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:09.017365 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ade498-638a-4466-9e9e-e3e300140054 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:09.027482 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ade498-638a-4466-9e9e-e3e300140054 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:09.030278 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ade498-638a-4466-9e9e-e3e300140054 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:09.049601 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-99ade498-638a-4466-9e9e-e3e300140054 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 08 16:32:09.050976 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 622/1251] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:32:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:09.057912 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e93bf-c763-4c19-a2fe-a14af6865a8d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:09.069422 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e93bf-c763-4c19-a2fe-a14af6865a8d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:09.076005 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0b88c-e6c7-449c-818e-822fa7229f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:09.076694 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0b88c-e6c7-449c-818e-822fa7229f2f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:09.076992 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0b88c-e6c7-449c-818e-822fa7229f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:09.077276 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0b88c-e6c7-449c-818e-822fa7229f2f admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:09.078119 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0b88c-e6c7-449c-818e-822fa7229f2f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:09.078425 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0b88c-e6c7-449c-818e-822fa7229f2f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:09.080311 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0b88c-e6c7-449c-818e-822fa7229f2f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:09.100038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 630/1252] 10.222.0.35 () {56 vars in 1164 bytes} [Tue Feb 8 16:32:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:32:09.106606 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ade498-638a-4466-9e9e-e3e300140054 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:09.119323 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ade498-638a-4466-9e9e-e3e300140054 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:09.123956 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0df8c-5f74-42ce-af85-6ac5b87bbc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:09.124591 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0df8c-5f74-42ce-af85-6ac5b87bbc1d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:09.124871 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0df8c-5f74-42ce-af85-6ac5b87bbc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:09.125146 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0df8c-5f74-42ce-af85-6ac5b87bbc1d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:09.134808 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0df8c-5f74-42ce-af85-6ac5b87bbc1d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:09.137049 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0df8c-5f74-42ce-af85-6ac5b87bbc1d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:09.149277 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 623/1253] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:32:09 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:32:09.157268 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0b88c-e6c7-449c-818e-822fa7229f2f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:09.169231 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0b88c-e6c7-449c-818e-822fa7229f2f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:09.175255 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0342f98-ddb1-4828-b03e-de01a49544ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:09.176235 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0342f98-ddb1-4828-b03e-de01a49544ea admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:09.176510 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0342f98-ddb1-4828-b03e-de01a49544ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:09.176893 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0342f98-ddb1-4828-b03e-de01a49544ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:09.188828 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0342f98-ddb1-4828-b03e-de01a49544ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:09.190647 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0342f98-ddb1-4828-b03e-de01a49544ea admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:09.207580 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-a0342f98-ddb1-4828-b03e-de01a49544ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:32:09.210525 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 631/1254] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:32:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:09.217972 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0df8c-5f74-42ce-af85-6ac5b87bbc1d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:09.230071 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0df8c-5f74-42ce-af85-6ac5b87bbc1d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:09.236458 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea9425-6b3f-4845-8497-516d3fef653d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:09.237096 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea9425-6b3f-4845-8497-516d3fef653d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:09.237392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea9425-6b3f-4845-8497-516d3fef653d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:09.237656 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea9425-6b3f-4845-8497-516d3fef653d admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:09.238385 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea9425-6b3f-4845-8497-516d3fef653d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:09.238688 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea9425-6b3f-4845-8497-516d3fef653d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:09.240313 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea9425-6b3f-4845-8497-516d3fef653d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:09.260464 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 624/1255] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:09.267344 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0342f98-ddb1-4828-b03e-de01a49544ea admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:09.280185 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0342f98-ddb1-4828-b03e-de01a49544ea admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:09.285999 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1fd9b-ef2d-4d77-9793-9b9737d45c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:09.286772 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1fd9b-ef2d-4d77-9793-9b9737d45c08 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:09.287054 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1fd9b-ef2d-4d77-9793-9b9737d45c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:09.287327 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1fd9b-ef2d-4d77-9793-9b9737d45c08 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:09.294884 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1fd9b-ef2d-4d77-9793-9b9737d45c08 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:09.297583 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1fd9b-ef2d-4d77-9793-9b9737d45c08 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:09.311113 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-b9e1fd9b-ef2d-4d77-9793-9b9737d45c08 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:32:09.319206 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 632/1256] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:32:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:09.321085 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea9425-6b3f-4845-8497-516d3fef653d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:09.331888 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea9425-6b3f-4845-8497-516d3fef653d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:09.338999 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc3e8f-c444-44db-91ad-e603d46d49bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:09.339647 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc3e8f-c444-44db-91ad-e603d46d49bc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:09.339993 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc3e8f-c444-44db-91ad-e603d46d49bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:09.340271 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc3e8f-c444-44db-91ad-e603d46d49bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:09.341066 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc3e8f-c444-44db-91ad-e603d46d49bc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:09.341376 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc3e8f-c444-44db-91ad-e603d46d49bc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:09.343942 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc3e8f-c444-44db-91ad-e603d46d49bc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:09.356713 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 625/1257] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:32:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:09.364200 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1fd9b-ef2d-4d77-9793-9b9737d45c08 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:09.375866 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1fd9b-ef2d-4d77-9793-9b9737d45c08 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:09.381072 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa71a40-6cb9-48d0-aba6-061b58ec9936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:09.381706 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa71a40-6cb9-48d0-aba6-061b58ec9936 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:09.381993 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa71a40-6cb9-48d0-aba6-061b58ec9936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:09.382271 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa71a40-6cb9-48d0-aba6-061b58ec9936 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:09.383658 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa71a40-6cb9-48d0-aba6-061b58ec9936 admin admin] RBAC: Adding query filter params (role.id=e6d18df5c4e74dfd8ebd9c636f45936e, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=75c8f232fc83474b8731ee6c1eb321fd) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:09.384054 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa71a40-6cb9-48d0-aba6-061b58ec9936 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:09.386175 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa71a40-6cb9-48d0-aba6-061b58ec9936 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:09.392996 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 633/1258] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:32:09 2022] GET /identity/v3/role_assignments?user.id=75c8f232fc83474b8731ee6c1eb321fd&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=e6d18df5c4e74dfd8ebd9c636f45936e => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:11.714663 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc1114-1d39-4889-88fe-079591db47a1 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:11.715189 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc1114-1d39-4889-88fe-079591db47a1 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:11.715189 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc1114-1d39-4889-88fe-079591db47a1 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:11.717097 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 626/1259] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:32:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:32:11.722715 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4c82f-5d90-4e13-b101-79406ee78219 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:11.723270 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4c82f-5d90-4e13-b101-79406ee78219 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:11.723378 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4c82f-5d90-4e13-b101-79406ee78219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:11.742558 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-f8e4c82f-5d90-4e13-b101-79406ee78219 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:32:11.744127 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-f8e4c82f-5d90-4e13-b101-79406ee78219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:32:11.752370 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 634/1260] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:32:11 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:32:11.777709 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc1114-1d39-4889-88fe-079591db47a1 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:11.790227 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc1114-1d39-4889-88fe-079591db47a1 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:11.794600 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec00ca-8e01-4b93-a492-7e532168c8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:11.795391 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec00ca-8e01-4b93-a492-7e532168c8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:11.795669 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec00ca-8e01-4b93-a492-7e532168c8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:11.795972 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec00ca-8e01-4b93-a492-7e532168c8b5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:11.807739 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec00ca-8e01-4b93-a492-7e532168c8b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:32:11.814751 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-d6ec00ca-8e01-4b93-a492-7e532168c8b5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:32:11.816033 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 627/1261] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:32:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:11.823163 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4c82f-5d90-4e13-b101-79406ee78219 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:11.832783 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4c82f-5d90-4e13-b101-79406ee78219 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:11.838174 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e1bfe-c753-4767-a1a2-3921a0e6ede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:11.839091 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e1bfe-c753-4767-a1a2-3921a0e6ede3 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:11.839450 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e1bfe-c753-4767-a1a2-3921a0e6ede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:11.839878 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e1bfe-c753-4767-a1a2-3921a0e6ede3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:11.840852 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e1bfe-c753-4767-a1a2-3921a0e6ede3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:11.841216 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e1bfe-c753-4767-a1a2-3921a0e6ede3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:11.843479 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e1bfe-c753-4767-a1a2-3921a0e6ede3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:11.854506 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 635/1262] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:32:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:11.861215 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec00ca-8e01-4b93-a492-7e532168c8b5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:11.871740 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec00ca-8e01-4b93-a492-7e532168c8b5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:11.877284 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf3cd2-46a7-4658-a240-887b4c6b3d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:11.878196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf3cd2-46a7-4658-a240-887b4c6b3d7e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:11.878476 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf3cd2-46a7-4658-a240-887b4c6b3d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:11.878747 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf3cd2-46a7-4658-a240-887b4c6b3d7e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:11.890335 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf3cd2-46a7-4658-a240-887b4c6b3d7e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:11.892229 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf3cd2-46a7-4658-a240-887b4c6b3d7e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:11.912390 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-9ecf3cd2-46a7-4658-a240-887b4c6b3d7e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:32:11.913797 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 628/1263] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:32:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:32:11.920307 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e1bfe-c753-4767-a1a2-3921a0e6ede3 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:11.930318 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e1bfe-c753-4767-a1a2-3921a0e6ede3 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:11.935153 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f6588-92af-4cea-958a-b5c57f64e74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:11.935836 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f6588-92af-4cea-958a-b5c57f64e74b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:11.936122 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f6588-92af-4cea-958a-b5c57f64e74b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:11.936396 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f6588-92af-4cea-958a-b5c57f64e74b admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:11.937123 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f6588-92af-4cea-958a-b5c57f64e74b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:11.937429 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f6588-92af-4cea-958a-b5c57f64e74b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:11.939005 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f6588-92af-4cea-958a-b5c57f64e74b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:11.953504 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 636/1264] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:11.959461 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf3cd2-46a7-4658-a240-887b4c6b3d7e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:11.970980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf3cd2-46a7-4658-a240-887b4c6b3d7e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:11.975918 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461fd9a-47f9-4baf-8296-e9c7acfc1be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:11.976885 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461fd9a-47f9-4baf-8296-e9c7acfc1be0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:11.977147 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461fd9a-47f9-4baf-8296-e9c7acfc1be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:11.977422 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461fd9a-47f9-4baf-8296-e9c7acfc1be0 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:11.984928 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461fd9a-47f9-4baf-8296-e9c7acfc1be0 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:11.986913 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461fd9a-47f9-4baf-8296-e9c7acfc1be0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:12.002547 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-b461fd9a-47f9-4baf-8296-e9c7acfc1be0 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 08 16:32:12.003805 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 629/1265] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:32:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:32:12.010566 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f6588-92af-4cea-958a-b5c57f64e74b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:12.023205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f6588-92af-4cea-958a-b5c57f64e74b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:12.029437 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b12d38-e5fa-4779-850b-719be2342994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:12.030196 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b12d38-e5fa-4779-850b-719be2342994 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:12.030540 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b12d38-e5fa-4779-850b-719be2342994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:12.030885 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b12d38-e5fa-4779-850b-719be2342994 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:12.032009 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b12d38-e5fa-4779-850b-719be2342994 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:12.032332 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b12d38-e5fa-4779-850b-719be2342994 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:12.034811 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b12d38-e5fa-4779-850b-719be2342994 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:12.056101 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 637/1266] 10.222.0.35 () {56 vars in 1164 bytes} [Tue Feb 8 16:32:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:12.063154 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461fd9a-47f9-4baf-8296-e9c7acfc1be0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:12.073297 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461fd9a-47f9-4baf-8296-e9c7acfc1be0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:12.078171 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadd023-e718-4106-a3a6-33f67e309b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:12.078975 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadd023-e718-4106-a3a6-33f67e309b25 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:12.079229 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadd023-e718-4106-a3a6-33f67e309b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:12.079503 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadd023-e718-4106-a3a6-33f67e309b25 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:12.091632 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadd023-e718-4106-a3a6-33f67e309b25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:12.093839 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadd023-e718-4106-a3a6-33f67e309b25 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:12.113270 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-5aadd023-e718-4106-a3a6-33f67e309b25 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:32:12.114569 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 630/1267] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:32:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:12.120978 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b12d38-e5fa-4779-850b-719be2342994 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:12.131527 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b12d38-e5fa-4779-850b-719be2342994 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:12.137728 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04311c7e-4b8d-4bfa-af73-c2c4b44b645e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:12.138430 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04311c7e-4b8d-4bfa-af73-c2c4b44b645e admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:12.138711 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04311c7e-4b8d-4bfa-af73-c2c4b44b645e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:12.138988 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04311c7e-4b8d-4bfa-af73-c2c4b44b645e admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:12.140006 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04311c7e-4b8d-4bfa-af73-c2c4b44b645e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:12.140312 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04311c7e-4b8d-4bfa-af73-c2c4b44b645e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:12.141968 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04311c7e-4b8d-4bfa-af73-c2c4b44b645e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:12.154769 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 638/1268] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:12.160510 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadd023-e718-4106-a3a6-33f67e309b25 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:12.171215 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadd023-e718-4106-a3a6-33f67e309b25 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:12.176407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190afd98-03ec-4e91-b9ee-c96a161b5f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:12.177174 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190afd98-03ec-4e91-b9ee-c96a161b5f5f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:12.177460 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190afd98-03ec-4e91-b9ee-c96a161b5f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:12.177764 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190afd98-03ec-4e91-b9ee-c96a161b5f5f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:12.186147 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190afd98-03ec-4e91-b9ee-c96a161b5f5f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:12.188472 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190afd98-03ec-4e91-b9ee-c96a161b5f5f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:12.203431 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-190afd98-03ec-4e91-b9ee-c96a161b5f5f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:32:12.204650 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 631/1269] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:32:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:32:12.211247 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04311c7e-4b8d-4bfa-af73-c2c4b44b645e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:12.222637 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04311c7e-4b8d-4bfa-af73-c2c4b44b645e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:12.227895 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41f3e4-809c-4a83-b247-e52dbb4d065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:12.228549 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41f3e4-809c-4a83-b247-e52dbb4d065d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:12.228830 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41f3e4-809c-4a83-b247-e52dbb4d065d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:12.229105 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41f3e4-809c-4a83-b247-e52dbb4d065d admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:12.229903 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41f3e4-809c-4a83-b247-e52dbb4d065d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:12.230349 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41f3e4-809c-4a83-b247-e52dbb4d065d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:12.232552 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41f3e4-809c-4a83-b247-e52dbb4d065d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:12.251789 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 639/1270] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:32:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:12.253383 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190afd98-03ec-4e91-b9ee-c96a161b5f5f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:12.265174 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190afd98-03ec-4e91-b9ee-c96a161b5f5f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:12.270186 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cd8a8-a985-4d45-81fc-ae596d10554c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:12.271048 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cd8a8-a985-4d45-81fc-ae596d10554c admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:12.271320 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cd8a8-a985-4d45-81fc-ae596d10554c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:12.271662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cd8a8-a985-4d45-81fc-ae596d10554c admin admin] PATH_INFO: `/v3/projects/6b01069799b34858bbebc201a3f2046d/users/75c8f232fc83474b8731ee6c1eb321fd/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:12.274103 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205cd8a8-a985-4d45-81fc-ae596d10554c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b01069799b34858bbebc201a3f2046d, user_id=75c8f232fc83474b8731ee6c1eb321fd, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:12.277043 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205cd8a8-a985-4d45-81fc-ae596d10554c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:12.290595 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 632/1271] 10.222.0.35 () {58 vars in 1460 bytes} [Tue Feb 8 16:32:12 2022] PUT /identity/v3/projects/6b01069799b34858bbebc201a3f2046d/users/75c8f232fc83474b8731ee6c1eb321fd/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:32:14.873921 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dede2-6438-4b7f-8f08-38fc39ce1557 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:14.874533 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dede2-6438-4b7f-8f08-38fc39ce1557 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:14.874533 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dede2-6438-4b7f-8f08-38fc39ce1557 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:14.876525 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 640/1272] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:32:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:32:14.882278 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0c8ac-2552-447b-bf3e-9c203688d016 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:14.882807 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0c8ac-2552-447b-bf3e-9c203688d016 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:14.883099 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0c8ac-2552-447b-bf3e-9c203688d016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:14.904879 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-21a0c8ac-2552-447b-bf3e-9c203688d016 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:32:14.906243 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-21a0c8ac-2552-447b-bf3e-9c203688d016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:32:14.977895 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 633/1273] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:32:14 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:32:15.003991 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dede2-6438-4b7f-8f08-38fc39ce1557 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:15.018850 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dede2-6438-4b7f-8f08-38fc39ce1557 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:15.024135 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6584e-a613-4b97-9dd7-4e6e3c29d747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:15.024922 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6584e-a613-4b97-9dd7-4e6e3c29d747 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:15.025199 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6584e-a613-4b97-9dd7-4e6e3c29d747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:15.025468 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6584e-a613-4b97-9dd7-4e6e3c29d747 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:15.036906 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6584e-a613-4b97-9dd7-4e6e3c29d747 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 08 16:32:15.044854 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-8cd6584e-a613-4b97-9dd7-4e6e3c29d747 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 08 16:32:15.046295 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 641/1274] 10.222.0.35 () {56 vars in 1117 bytes} [Tue Feb 8 16:32:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:15.052100 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0c8ac-2552-447b-bf3e-9c203688d016 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:15.061516 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0c8ac-2552-447b-bf3e-9c203688d016 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:15.066325 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f0049-3de3-4710-90a7-eab3eb9f5090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:15.067095 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f0049-3de3-4710-90a7-eab3eb9f5090 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:15.067439 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f0049-3de3-4710-90a7-eab3eb9f5090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:15.067803 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f0049-3de3-4710-90a7-eab3eb9f5090 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:15.068664 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f0049-3de3-4710-90a7-eab3eb9f5090 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:15.069034 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f0049-3de3-4710-90a7-eab3eb9f5090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:15.070857 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f0049-3de3-4710-90a7-eab3eb9f5090 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:15.084906 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 634/1275] 10.222.0.35 () {56 vars in 1120 bytes} [Tue Feb 8 16:32:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:15.087128 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6584e-a613-4b97-9dd7-4e6e3c29d747 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:15.097710 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6584e-a613-4b97-9dd7-4e6e3c29d747 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:15.103036 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42414324-0870-46ec-b0f6-6de3796f8be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:15.103861 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42414324-0870-46ec-b0f6-6de3796f8be7 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:15.104145 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42414324-0870-46ec-b0f6-6de3796f8be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:15.104419 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42414324-0870-46ec-b0f6-6de3796f8be7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:15.115712 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42414324-0870-46ec-b0f6-6de3796f8be7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:15.117639 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42414324-0870-46ec-b0f6-6de3796f8be7 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:15.135484 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-42414324-0870-46ec-b0f6-6de3796f8be7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:32:15.136692 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 642/1276] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:32:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:15.143036 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f0049-3de3-4710-90a7-eab3eb9f5090 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:15.153525 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f0049-3de3-4710-90a7-eab3eb9f5090 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:15.158183 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c567b0-e903-4e2b-b311-a728e1c24152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:15.158850 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c567b0-e903-4e2b-b311-a728e1c24152 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:15.159128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c567b0-e903-4e2b-b311-a728e1c24152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:15.159396 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c567b0-e903-4e2b-b311-a728e1c24152 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:15.160173 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c567b0-e903-4e2b-b311-a728e1c24152 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:15.160475 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c567b0-e903-4e2b-b311-a728e1c24152 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:15.162108 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c567b0-e903-4e2b-b311-a728e1c24152 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:15.177398 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 635/1277] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:15.183278 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42414324-0870-46ec-b0f6-6de3796f8be7 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:15.193367 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42414324-0870-46ec-b0f6-6de3796f8be7 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:15.198966 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1f9e2-6a1e-4ca9-92a0-db3c879ca952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:15.199798 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1f9e2-6a1e-4ca9-92a0-db3c879ca952 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:15.200089 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1f9e2-6a1e-4ca9-92a0-db3c879ca952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:15.200365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1f9e2-6a1e-4ca9-92a0-db3c879ca952 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:15.208318 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1f9e2-6a1e-4ca9-92a0-db3c879ca952 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:15.210366 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1f9e2-6a1e-4ca9-92a0-db3c879ca952 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:15.226388 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-f4d1f9e2-6a1e-4ca9-92a0-db3c879ca952 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 08 16:32:15.227822 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 643/1278] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:32:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:15.233578 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c567b0-e903-4e2b-b311-a728e1c24152 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:15.244571 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c567b0-e903-4e2b-b311-a728e1c24152 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:15.249238 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4d05f-0065-44df-ae5f-7b79e861a956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:15.249908 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4d05f-0065-44df-ae5f-7b79e861a956 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:15.250190 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4d05f-0065-44df-ae5f-7b79e861a956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:15.250465 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4d05f-0065-44df-ae5f-7b79e861a956 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:15.251325 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4d05f-0065-44df-ae5f-7b79e861a956 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:15.251631 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4d05f-0065-44df-ae5f-7b79e861a956 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:15.253581 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4d05f-0065-44df-ae5f-7b79e861a956 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:15.275193 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 636/1279] 10.222.0.35 () {56 vars in 1164 bytes} [Tue Feb 8 16:32:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:15.281119 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1f9e2-6a1e-4ca9-92a0-db3c879ca952 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:15.291388 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1f9e2-6a1e-4ca9-92a0-db3c879ca952 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:15.296019 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f222e-44e8-47e2-b521-faca202dda43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:15.296657 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f222e-44e8-47e2-b521-faca202dda43 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:15.296935 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f222e-44e8-47e2-b521-faca202dda43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:15.297206 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f222e-44e8-47e2-b521-faca202dda43 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:15.306585 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f222e-44e8-47e2-b521-faca202dda43 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:15.308404 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f222e-44e8-47e2-b521-faca202dda43 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:15.318334 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 644/1280] 10.222.0.35 () {58 vars in 1324 bytes} [Tue Feb 8 16:32:15 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:32:15.326215 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4d05f-0065-44df-ae5f-7b79e861a956 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:15.336480 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4d05f-0065-44df-ae5f-7b79e861a956 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:15.341357 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16d5b9-3203-4357-a1db-db4dae5ca513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:15.342129 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16d5b9-3203-4357-a1db-db4dae5ca513 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:15.342407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16d5b9-3203-4357-a1db-db4dae5ca513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:15.342679 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16d5b9-3203-4357-a1db-db4dae5ca513 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:15.354029 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16d5b9-3203-4357-a1db-db4dae5ca513 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:15.355929 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16d5b9-3203-4357-a1db-db4dae5ca513 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:15.373554 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-2b16d5b9-3203-4357-a1db-db4dae5ca513 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 08 16:32:15.374778 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 637/1281] 10.222.0.35 () {56 vars in 1129 bytes} [Tue Feb 8 16:32:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:15.380597 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f222e-44e8-47e2-b521-faca202dda43 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:15.390625 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f222e-44e8-47e2-b521-faca202dda43 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:15.395244 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048df497-5dab-4f25-a4d7-5e4aa71c9b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:15.395936 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048df497-5dab-4f25-a4d7-5e4aa71c9b18 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:15.396216 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048df497-5dab-4f25-a4d7-5e4aa71c9b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:15.396487 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048df497-5dab-4f25-a4d7-5e4aa71c9b18 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:15.397209 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048df497-5dab-4f25-a4d7-5e4aa71c9b18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:15.397541 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048df497-5dab-4f25-a4d7-5e4aa71c9b18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:15.399854 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048df497-5dab-4f25-a4d7-5e4aa71c9b18 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:15.411476 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 645/1282] 10.222.0.35 () {56 vars in 1130 bytes} [Tue Feb 8 16:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:15.418400 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16d5b9-3203-4357-a1db-db4dae5ca513 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:15.428449 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16d5b9-3203-4357-a1db-db4dae5ca513 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:15.433016 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ebd377-e000-4c62-a1fc-2d127e92e251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:15.433804 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebd377-e000-4c62-a1fc-2d127e92e251 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:15.434082 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebd377-e000-4c62-a1fc-2d127e92e251 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:15.434347 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebd377-e000-4c62-a1fc-2d127e92e251 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:15.441556 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ebd377-e000-4c62-a1fc-2d127e92e251 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:15.443490 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ebd377-e000-4c62-a1fc-2d127e92e251 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:15.457620 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-36ebd377-e000-4c62-a1fc-2d127e92e251 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 08 16:32:15.458872 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 638/1283] 10.222.0.35 () {56 vars in 1132 bytes} [Tue Feb 8 16:32:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 08 16:32:15.465655 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048df497-5dab-4f25-a4d7-5e4aa71c9b18 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:15.475506 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048df497-5dab-4f25-a4d7-5e4aa71c9b18 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:15.480837 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391a1b9-cee4-4485-b2ea-853df1ad0f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:15.481478 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391a1b9-cee4-4485-b2ea-853df1ad0f40 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:15.481759 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391a1b9-cee4-4485-b2ea-853df1ad0f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:15.482037 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391a1b9-cee4-4485-b2ea-853df1ad0f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:15.482829 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391a1b9-cee4-4485-b2ea-853df1ad0f40 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:15.483136 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391a1b9-cee4-4485-b2ea-853df1ad0f40 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:15.485068 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391a1b9-cee4-4485-b2ea-853df1ad0f40 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:15.498859 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 646/1284] 10.222.0.35 () {56 vars in 1169 bytes} [Tue Feb 8 16:32:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:15.505384 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ebd377-e000-4c62-a1fc-2d127e92e251 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:15.516888 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ebd377-e000-4c62-a1fc-2d127e92e251 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:15.521485 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4b7c0-bdc7-4af0-919a-238f950c5e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:15.522108 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4b7c0-bdc7-4af0-919a-238f950c5e75 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:15.522384 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4b7c0-bdc7-4af0-919a-238f950c5e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:15.522663 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4b7c0-bdc7-4af0-919a-238f950c5e75 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:15.524438 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4b7c0-bdc7-4af0-919a-238f950c5e75 admin admin] RBAC: Adding query filter params (role.id=e6d18df5c4e74dfd8ebd9c636f45936e, scope.project.id=6b01069799b34858bbebc201a3f2046d, user.id=75c8f232fc83474b8731ee6c1eb321fd) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:15.524438 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4b7c0-bdc7-4af0-919a-238f950c5e75 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:15.526281 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4b7c0-bdc7-4af0-919a-238f950c5e75 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:15.532426 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 639/1285] 10.222.0.35 () {56 vars in 1395 bytes} [Tue Feb 8 16:32:15 2022] GET /identity/v3/role_assignments?user.id=75c8f232fc83474b8731ee6c1eb321fd&scope.project.id=6b01069799b34858bbebc201a3f2046d&role.id=e6d18df5c4e74dfd8ebd9c636f45936e => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:17.811274 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8da14b-8d1a-4570-ac72-538a7c4bbb45 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:17.811820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8da14b-8d1a-4570-ac72-538a7c4bbb45 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:17.811914 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8da14b-8d1a-4570-ac72-538a7c4bbb45 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:17.813634 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 647/1286] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:32:17.818813 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6900b8-cd63-4b13-b14b-7b8930a87883 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:17.819242 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6900b8-cd63-4b13-b14b-7b8930a87883 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:17.819371 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6900b8-cd63-4b13-b14b-7b8930a87883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:17.837935 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-cd6900b8-cd63-4b13-b14b-7b8930a87883 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:32:17.839143 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cd6900b8-cd63-4b13-b14b-7b8930a87883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:32:17.846902 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 640/1287] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:32:17 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:32:17.869071 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8da14b-8d1a-4570-ac72-538a7c4bbb45 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:17.880999 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8da14b-8d1a-4570-ac72-538a7c4bbb45 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:17.885874 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b8b6e-16d7-44a8-9156-563c6f8bc678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:17.886628 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b8b6e-16d7-44a8-9156-563c6f8bc678 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:17.886905 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b8b6e-16d7-44a8-9156-563c6f8bc678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:17.887175 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b8b6e-16d7-44a8-9156-563c6f8bc678 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:17.887880 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b8b6e-16d7-44a8-9156-563c6f8bc678 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:17.889455 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b8b6e-16d7-44a8-9156-563c6f8bc678 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:17.900942 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-219b8b6e-16d7-44a8-9156-563c6f8bc678 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 08 16:32:17.902038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 648/1288] 10.222.0.35 () {56 vars in 1138 bytes} [Tue Feb 8 16:32:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:17.907717 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6900b8-cd63-4b13-b14b-7b8930a87883 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:17.916706 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6900b8-cd63-4b13-b14b-7b8930a87883 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:17.921197 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760470ec-da75-49ac-a194-8cf9b48e6bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:17.921831 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760470ec-da75-49ac-a194-8cf9b48e6bef admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:17.922111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760470ec-da75-49ac-a194-8cf9b48e6bef admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:17.922385 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760470ec-da75-49ac-a194-8cf9b48e6bef admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:17.923166 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760470ec-da75-49ac-a194-8cf9b48e6bef admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:17.923472 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760470ec-da75-49ac-a194-8cf9b48e6bef admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:17.925083 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760470ec-da75-49ac-a194-8cf9b48e6bef admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:17.929737 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 641/1289] 10.222.0.35 () {56 vars in 1137 bytes} [Tue Feb 8 16:32:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:17.934936 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b8b6e-16d7-44a8-9156-563c6f8bc678 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:17.945306 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b8b6e-16d7-44a8-9156-563c6f8bc678 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:17.950004 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445078f-9e4a-4571-b142-8a5de4879547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:17.950630 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445078f-9e4a-4571-b142-8a5de4879547 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:17.950911 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445078f-9e4a-4571-b142-8a5de4879547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:17.951186 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445078f-9e4a-4571-b142-8a5de4879547 admin admin] PATH_INFO: `/v3/services` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:17.951923 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445078f-9e4a-4571-b142-8a5de4879547 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:17.952229 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445078f-9e4a-4571-b142-8a5de4879547 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:17.953806 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445078f-9e4a-4571-b142-8a5de4879547 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:17.958035 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 649/1290] 10.222.0.35 () {56 vars in 1137 bytes} [Tue Feb 8 16:32:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:20.168371 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cb5ee-9606-486c-8a2a-b2d728130334 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:20.169021 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cb5ee-9606-486c-8a2a-b2d728130334 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:20.169021 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cb5ee-9606-486c-8a2a-b2d728130334 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:20.170662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 642/1291] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:32:20.175926 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbab60c-ee32-4803-b2b3-0ac16face296 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:20.176355 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbab60c-ee32-4803-b2b3-0ac16face296 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:20.176477 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbab60c-ee32-4803-b2b3-0ac16face296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:20.194756 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-4dbab60c-ee32-4803-b2b3-0ac16face296 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:32:20.196246 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-4dbab60c-ee32-4803-b2b3-0ac16face296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:32:20.203915 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 650/1292] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:32:20 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:32:20.228361 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cb5ee-9606-486c-8a2a-b2d728130334 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:20.240390 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cb5ee-9606-486c-8a2a-b2d728130334 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:20.244805 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c178d-70cf-43a1-a9cb-783e10b367ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:20.245430 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c178d-70cf-43a1-a9cb-783e10b367ba admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:20.245712 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c178d-70cf-43a1-a9cb-783e10b367ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:20.245985 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c178d-70cf-43a1-a9cb-783e10b367ba admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:20.246717 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c178d-70cf-43a1-a9cb-783e10b367ba admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:20.248323 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c178d-70cf-43a1-a9cb-783e10b367ba admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:20.261454 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 643/1293] 10.222.0.35 () {60 vars in 1162 bytes} [Tue Feb 8 16:32:20 2022] POST /identity/v3/services => generated 246 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:32:22.484598 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41adc4-0fce-4420-8a02-f8095b88d5ad None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:22.485151 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41adc4-0fce-4420-8a02-f8095b88d5ad None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:22.485151 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41adc4-0fce-4420-8a02-f8095b88d5ad None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:22.486872 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 651/1294] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:32:22.492178 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0920-c611-4395-8ee4-7e150683f965 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:22.492576 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0920-c611-4395-8ee4-7e150683f965 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:22.492732 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0920-c611-4395-8ee4-7e150683f965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:22.510098 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e5ba0920-c611-4395-8ee4-7e150683f965 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:32:22.511269 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e5ba0920-c611-4395-8ee4-7e150683f965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:32:22.528379 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 644/1295] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:32:22 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:32:22.551856 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41adc4-0fce-4420-8a02-f8095b88d5ad None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:22.563801 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41adc4-0fce-4420-8a02-f8095b88d5ad None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:22.568325 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b41e7-63cd-4fc5-b5fb-80fef98fd41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:22.569079 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b41e7-63cd-4fc5-b5fb-80fef98fd41b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:22.569356 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b41e7-63cd-4fc5-b5fb-80fef98fd41b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:22.569657 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b41e7-63cd-4fc5-b5fb-80fef98fd41b admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:22.570558 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b41e7-63cd-4fc5-b5fb-80fef98fd41b admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:22.572162 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b41e7-63cd-4fc5-b5fb-80fef98fd41b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:22.583861 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-e80b41e7-63cd-4fc5-b5fb-80fef98fd41b admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 08 16:32:22.584990 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 652/1296] 10.222.0.35 () {56 vars in 1138 bytes} [Tue Feb 8 16:32:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:22.592050 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba0920-c611-4395-8ee4-7e150683f965 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:22.602325 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba0920-c611-4395-8ee4-7e150683f965 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:22.607461 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b38ef-e345-47f6-a3bb-c3920926aea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:22.608178 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b38ef-e345-47f6-a3bb-c3920926aea5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:22.608509 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b38ef-e345-47f6-a3bb-c3920926aea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:22.608800 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b38ef-e345-47f6-a3bb-c3920926aea5 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:22.609591 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b38ef-e345-47f6-a3bb-c3920926aea5 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:22.609941 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b38ef-e345-47f6-a3bb-c3920926aea5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:22.611707 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b38ef-e345-47f6-a3bb-c3920926aea5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:22.617637 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 645/1297] 10.222.0.35 () {56 vars in 1137 bytes} [Tue Feb 8 16:32:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:22.624290 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b41e7-63cd-4fc5-b5fb-80fef98fd41b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:22.636903 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b41e7-63cd-4fc5-b5fb-80fef98fd41b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:22.642835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e697c7a-dcfb-42a8-9e99-cea2b0d2386e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:22.643477 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e697c7a-dcfb-42a8-9e99-cea2b0d2386e admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:22.643773 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e697c7a-dcfb-42a8-9e99-cea2b0d2386e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:22.644060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e697c7a-dcfb-42a8-9e99-cea2b0d2386e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:22.644851 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e697c7a-dcfb-42a8-9e99-cea2b0d2386e admin admin] RBAC: Adding query filter params (interface=public, service_id=cbefae6a30aa4f40908ddbd93b821bb9, region_id=RegionOne) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:22.645160 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e697c7a-dcfb-42a8-9e99-cea2b0d2386e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:22.646729 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e697c7a-dcfb-42a8-9e99-cea2b0d2386e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:22.652328 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 653/1298] 10.222.0.35 () {56 vars in 1272 bytes} [Tue Feb 8 16:32:22 2022] GET /identity/v3/endpoints?service_id=cbefae6a30aa4f40908ddbd93b821bb9&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:22.657746 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b38ef-e345-47f6-a3bb-c3920926aea5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:22.668004 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b38ef-e345-47f6-a3bb-c3920926aea5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:22.674285 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17386ae-e602-4c7b-a235-e05e0b10ef9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:22.675372 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17386ae-e602-4c7b-a235-e05e0b10ef9a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:22.675922 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17386ae-e602-4c7b-a235-e05e0b10ef9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:22.676416 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17386ae-e602-4c7b-a235-e05e0b10ef9a admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:22.677704 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17386ae-e602-4c7b-a235-e05e0b10ef9a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:22.680804 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17386ae-e602-4c7b-a235-e05e0b10ef9a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:22.692340 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 646/1299] 10.222.0.35 () {56 vars in 1108 bytes} [Tue Feb 8 16:32:22 2022] GET /identity/v3/services => generated 2191 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:32:24.926108 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5faf65-1f08-4e76-b6d5-48c2f082fc1b None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:24.926680 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5faf65-1f08-4e76-b6d5-48c2f082fc1b None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:24.926680 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5faf65-1f08-4e76-b6d5-48c2f082fc1b None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:24.928536 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 654/1300] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:32:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:32:24.934653 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50f4a6-8079-4139-85d4-f54a80aed09c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:24.935093 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50f4a6-8079-4139-85d4-f54a80aed09c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:24.935194 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50f4a6-8079-4139-85d4-f54a80aed09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:24.953205 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-1b50f4a6-8079-4139-85d4-f54a80aed09c None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:32:24.954385 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1b50f4a6-8079-4139-85d4-f54a80aed09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:32:24.962593 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 647/1301] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:32:24 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:32:24.986240 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5faf65-1f08-4e76-b6d5-48c2f082fc1b None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:24.999917 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5faf65-1f08-4e76-b6d5-48c2f082fc1b None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:25.004344 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a072899-fc28-489b-87d1-35fe9e5760b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:25.005111 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a072899-fc28-489b-87d1-35fe9e5760b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:25.005398 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a072899-fc28-489b-87d1-35fe9e5760b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:25.005671 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a072899-fc28-489b-87d1-35fe9e5760b5 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:25.006331 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a072899-fc28-489b-87d1-35fe9e5760b5 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:25.008231 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a072899-fc28-489b-87d1-35fe9e5760b5 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:25.019053 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING keystone.server.flask.application [None req-3a072899-fc28-489b-87d1-35fe9e5760b5 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 08 16:32:25.020200 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 655/1302] 10.222.0.35 () {56 vars in 1138 bytes} [Tue Feb 8 16:32:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 08 16:32:25.026669 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50f4a6-8079-4139-85d4-f54a80aed09c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:25.036111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50f4a6-8079-4139-85d4-f54a80aed09c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:25.041486 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac13d1-2641-487a-b818-4b5510642817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:25.042124 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac13d1-2641-487a-b818-4b5510642817 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:25.042404 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac13d1-2641-487a-b818-4b5510642817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:25.042682 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac13d1-2641-487a-b818-4b5510642817 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:25.043394 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac13d1-2641-487a-b818-4b5510642817 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:32:25.043695 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac13d1-2641-487a-b818-4b5510642817 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:25.045298 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac13d1-2641-487a-b818-4b5510642817 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:25.050341 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 648/1303] 10.222.0.35 () {56 vars in 1137 bytes} [Tue Feb 8 16:32:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:32:25.055745 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a072899-fc28-489b-87d1-35fe9e5760b5 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:32:25.065695 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a072899-fc28-489b-87d1-35fe9e5760b5 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:32:25.070784 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49f7f3-99f3-47c8-a4a9-4b0dab027fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:32:25.071401 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49f7f3-99f3-47c8-a4a9-4b0dab027fab admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:32:25.071684 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49f7f3-99f3-47c8-a4a9-4b0dab027fab admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:32:25.072006 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49f7f3-99f3-47c8-a4a9-4b0dab027fab admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:32:25.072807 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49f7f3-99f3-47c8-a4a9-4b0dab027fab admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:32:25.074363 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49f7f3-99f3-47c8-a4a9-4b0dab027fab admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:32:25.092747 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 656/1304] 10.222.0.35 () {60 vars in 1165 bytes} [Tue Feb 8 16:32:25 2022] POST /identity/v3/endpoints => generated 331 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:33:28.593344 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf5831-9cf6-4ca1-9d05-b40494ffcf59 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:28.594355 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf5831-9cf6-4ca1-9d05-b40494ffcf59 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:28.594839 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf5831-9cf6-4ca1-9d05-b40494ffcf59 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:28.601037 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 649/1305] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:33:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:33:28.602444 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b0b79-5589-4473-a4ee-a6600671f79d None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:28.603307 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b0b79-5589-4473-a4ee-a6600671f79d None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:28.603819 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b0b79-5589-4473-a4ee-a6600671f79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:28.691018 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-1b0b0b79-5589-4473-a4ee-a6600671f79d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:33:28.692638 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-1b0b0b79-5589-4473-a4ee-a6600671f79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:28.798475 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 657/1306] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:33:28.821212 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf5831-9cf6-4ca1-9d05-b40494ffcf59 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:33:28.823256 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cfaf5831-9cf6-4ca1-9d05-b40494ffcf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:29.049407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf5831-9cf6-4ca1-9d05-b40494ffcf59 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:33:29.182360 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69457078-f646-4d00-ba7a-03cca3f49cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:33:29.183022 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69457078-f646-4d00-ba7a-03cca3f49cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:29.183301 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69457078-f646-4d00-ba7a-03cca3f49cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:29.183575 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69457078-f646-4d00-ba7a-03cca3f49cf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:29.184470 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69457078-f646-4d00-ba7a-03cca3f49cf8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:33:29.186342 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69457078-f646-4d00-ba7a-03cca3f49cf8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:33:29.207793 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 650/1307] 10.222.0.35 () {56 vars in 1108 bytes} [Tue Feb 8 16:33:28 2022] GET /identity/v3/projects => generated 2553 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:33:31.501517 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ee05d-3d77-4a25-b0e7-50a0365e90d2 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:31.502039 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ee05d-3d77-4a25-b0e7-50a0365e90d2 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:31.502146 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ee05d-3d77-4a25-b0e7-50a0365e90d2 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:31.504048 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 658/1308] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:33:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:33:31.509457 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c86fc-42e0-44d6-8eae-68a667c99a46 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:31.509878 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c86fc-42e0-44d6-8eae-68a667c99a46 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:31.510010 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c86fc-42e0-44d6-8eae-68a667c99a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:31.586493 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-677c86fc-42e0-44d6-8eae-68a667c99a46 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:33:31.587745 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-677c86fc-42e0-44d6-8eae-68a667c99a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:31.691159 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 651/1309] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:33:31.715671 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ee05d-3d77-4a25-b0e7-50a0365e90d2 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:33:31.717427 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-bf4ee05d-3d77-4a25-b0e7-50a0365e90d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:31.855427 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ee05d-3d77-4a25-b0e7-50a0365e90d2 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:33:31.958513 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947d9aa-df16-42d5-8f06-a03b59f40989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:33:31.959718 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947d9aa-df16-42d5-8f06-a03b59f40989 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:31.960127 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947d9aa-df16-42d5-8f06-a03b59f40989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:31.960589 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947d9aa-df16-42d5-8f06-a03b59f40989 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:31.962676 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947d9aa-df16-42d5-8f06-a03b59f40989 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:33:31.966370 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947d9aa-df16-42d5-8f06-a03b59f40989 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:33:31.989545 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 659/1310] 10.222.0.35 () {56 vars in 1108 bytes} [Tue Feb 8 16:33:31 2022] GET /identity/v3/projects => generated 2553 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:33:34.324509 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc864-259a-4dcd-9041-64587c908e62 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:34.324950 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc864-259a-4dcd-9041-64587c908e62 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:34.324950 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dc864-259a-4dcd-9041-64587c908e62 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:34.326725 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 652/1311] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:33:34.331993 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b62ca-4181-45df-8655-06af98b10a5d None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:34.332442 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b62ca-4181-45df-8655-06af98b10a5d None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:34.332544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b62ca-4181-45df-8655-06af98b10a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:34.398665 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-026b62ca-4181-45df-8655-06af98b10a5d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:33:34.400031 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-026b62ca-4181-45df-8655-06af98b10a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:34.493848 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 660/1312] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:33:34.545096 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ccaaa-19cd-4945-8146-1d1b8fa20eb8 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:34.545373 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ccaaa-19cd-4945-8146-1d1b8fa20eb8 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:34.545642 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ccaaa-19cd-4945-8146-1d1b8fa20eb8 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:34.547427 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 653/1313] 10.222.0.35 () {54 vars in 964 bytes} [Tue Feb 8 16:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:33:34.553484 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a9d93-eaca-44ee-8386-816e1bd0cbdb None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:34.553774 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a9d93-eaca-44ee-8386-816e1bd0cbdb None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:34.554051 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a9d93-eaca-44ee-8386-816e1bd0cbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:34.626891 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-2f2a9d93-eaca-44ee-8386-816e1bd0cbdb None None] MFA Rules not processed for user `0b936dc9a67846f08e51648e64c3d6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:33:34.628026 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-2f2a9d93-eaca-44ee-8386-816e1bd0cbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:34.700072 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 661/1314] 10.222.0.35 () {58 vars in 1061 bytes} [Tue Feb 8 16:33:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:33:34.708886 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ccaaa-19cd-4945-8146-1d1b8fa20eb8 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:33:34.711036 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2b2ccaaa-19cd-4945-8146-1d1b8fa20eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:34.810173 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ccaaa-19cd-4945-8146-1d1b8fa20eb8 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:33:34.880622 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49204e3-a60d-4ee4-9ce4-6a0b70bfe89f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:33:34.881685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49204e3-a60d-4ee4-9ce4-6a0b70bfe89f service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:34.881963 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49204e3-a60d-4ee4-9ce4-6a0b70bfe89f service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:34.882412 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49204e3-a60d-4ee4-9ce4-6a0b70bfe89f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:34.884124 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e49204e3-a60d-4ee4-9ce4-6a0b70bfe89f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:34.988252 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49204e3-a60d-4ee4-9ce4-6a0b70bfe89f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:33:34.989687 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49204e3-a60d-4ee4-9ce4-6a0b70bfe89f service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:33:35.007784 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 654/1315] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:33:37.531979 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f039d4-b870-4d6a-858f-a0718734ff4a None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:37.532534 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f039d4-b870-4d6a-858f-a0718734ff4a None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:37.532534 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f039d4-b870-4d6a-858f-a0718734ff4a None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:37.534368 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 662/1316] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:33:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:33:37.540334 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2156b-fcf7-46e3-9870-c2e6702d8efe None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:37.540730 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2156b-fcf7-46e3-9870-c2e6702d8efe None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:37.540887 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2156b-fcf7-46e3-9870-c2e6702d8efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:37.604742 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-b4b2156b-fcf7-46e3-9870-c2e6702d8efe None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:33:37.605887 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b4b2156b-fcf7-46e3-9870-c2e6702d8efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:37.698827 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 655/1317] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:33:37.732917 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f039d4-b870-4d6a-858f-a0718734ff4a None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:33:37.734405 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-85f039d4-b870-4d6a-858f-a0718734ff4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:37.854590 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f039d4-b870-4d6a-858f-a0718734ff4a None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:33:37.944246 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b7d69-5e38-4bbd-8c06-dc7724b1ebba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:33:37.945001 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b7d69-5e38-4bbd-8c06-dc7724b1ebba admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:37.945280 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b7d69-5e38-4bbd-8c06-dc7724b1ebba admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:37.945553 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b7d69-5e38-4bbd-8c06-dc7724b1ebba admin admin] PATH_INFO: `/v3/projects/2b5e4fc6dd694372b7f8775a6f881cca` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:37.946492 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b7d69-5e38-4bbd-8c06-dc7724b1ebba admin admin] RBAC: Authorizing `identity:get_project(project_id=2b5e4fc6dd694372b7f8775a6f881cca)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:33:37.948324 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b7d69-5e38-4bbd-8c06-dc7724b1ebba admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:33:37.949988 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 663/1318] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:33:37 2022] GET /identity/v3/projects/2b5e4fc6dd694372b7f8775a6f881cca => generated 344 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:33:37.962431 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2156b-fcf7-46e3-9870-c2e6702d8efe None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:33:37.963645 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b4b2156b-fcf7-46e3-9870-c2e6702d8efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:38.051269 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2156b-fcf7-46e3-9870-c2e6702d8efe None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:33:38.121648 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791b5ad-4f92-4438-bc30-ddfda5eb584f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:33:38.122282 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791b5ad-4f92-4438-bc30-ddfda5eb584f service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:38.122564 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791b5ad-4f92-4438-bc30-ddfda5eb584f service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:38.122837 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791b5ad-4f92-4438-bc30-ddfda5eb584f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:38.124490 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1791b5ad-4f92-4438-bc30-ddfda5eb584f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:38.230344 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791b5ad-4f92-4438-bc30-ddfda5eb584f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:33:38.231702 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791b5ad-4f92-4438-bc30-ddfda5eb584f service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:33:38.248922 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 656/1319] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:33:40.780051 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f06902-5f96-44f3-8f07-ab0a1db04d7d None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:40.780560 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f06902-5f96-44f3-8f07-ab0a1db04d7d None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:40.780560 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f06902-5f96-44f3-8f07-ab0a1db04d7d None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:40.782265 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 664/1320] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:33:40.787973 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c6591-b772-4820-a188-7c514fb1aedc None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:40.788415 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c6591-b772-4820-a188-7c514fb1aedc None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:40.788613 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c6591-b772-4820-a188-7c514fb1aedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:40.851260 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e92c6591-b772-4820-a188-7c514fb1aedc None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:33:40.852601 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e92c6591-b772-4820-a188-7c514fb1aedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:40.948212 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 657/1321] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:33:40.983009 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f06902-5f96-44f3-8f07-ab0a1db04d7d None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:33:40.984534 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-81f06902-5f96-44f3-8f07-ab0a1db04d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:41.103899 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f06902-5f96-44f3-8f07-ab0a1db04d7d None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:33:41.192956 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3deef-1fbf-47ec-a083-9032d577c763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:33:41.193884 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3deef-1fbf-47ec-a083-9032d577c763 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:41.194162 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3deef-1fbf-47ec-a083-9032d577c763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:41.194436 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3deef-1fbf-47ec-a083-9032d577c763 admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:41.203990 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3deef-1fbf-47ec-a083-9032d577c763 admin admin] RBAC: Authorizing `identity:get_project(project_id=67f1c5c4abff46008cee0510849c586e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:33:41.206031 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3deef-1fbf-47ec-a083-9032d577c763 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:33:41.207717 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 665/1322] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:33:40 2022] GET /identity/v3/projects/67f1c5c4abff46008cee0510849c586e => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:33:41.236348 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e7218-81c1-4a4b-be93-8c2b2ae38fa7 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:41.236639 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e7218-81c1-4a4b-be93-8c2b2ae38fa7 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:41.236926 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e7218-81c1-4a4b-be93-8c2b2ae38fa7 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:41.238730 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 658/1323] 10.222.0.35 () {54 vars in 964 bytes} [Tue Feb 8 16:33:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:33:41.244690 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b4d8c-e693-43d4-bb31-177caf874772 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:41.244981 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b4d8c-e693-43d4-bb31-177caf874772 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:41.245263 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b4d8c-e693-43d4-bb31-177caf874772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:41.319492 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-322b4d8c-e693-43d4-bb31-177caf874772 None None] MFA Rules not processed for user `0b936dc9a67846f08e51648e64c3d6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:33:41.320727 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-322b4d8c-e693-43d4-bb31-177caf874772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:41.394857 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 666/1324] 10.222.0.35 () {58 vars in 1061 bytes} [Tue Feb 8 16:33:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:33:41.404340 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e7218-81c1-4a4b-be93-8c2b2ae38fa7 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:33:41.405865 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0e6e7218-81c1-4a4b-be93-8c2b2ae38fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:41.507048 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e7218-81c1-4a4b-be93-8c2b2ae38fa7 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:33:41.577362 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332d926-ba5a-4eb9-b24e-019198a7bb0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:33:41.578005 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332d926-ba5a-4eb9-b24e-019198a7bb0f service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:41.578288 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332d926-ba5a-4eb9-b24e-019198a7bb0f service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:41.578561 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332d926-ba5a-4eb9-b24e-019198a7bb0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:41.580301 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-8332d926-ba5a-4eb9-b24e-019198a7bb0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:41.690684 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332d926-ba5a-4eb9-b24e-019198a7bb0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:33:41.692061 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332d926-ba5a-4eb9-b24e-019198a7bb0f service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:33:41.710846 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 659/1325] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:33:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:33:44.938521 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529de11f-eecd-4fef-bbad-9321b098354b None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:44.939064 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529de11f-eecd-4fef-bbad-9321b098354b None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:44.939064 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529de11f-eecd-4fef-bbad-9321b098354b None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:44.941008 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 667/1326] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:33:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:33:44.947030 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06a13b-e546-48ed-ad51-45b0c7c4302d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:44.947438 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06a13b-e546-48ed-ad51-45b0c7c4302d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:44.947585 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06a13b-e546-48ed-ad51-45b0c7c4302d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:45.010565 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2f06a13b-e546-48ed-ad51-45b0c7c4302d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:33:45.011783 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2f06a13b-e546-48ed-ad51-45b0c7c4302d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:45.105126 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 660/1327] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:33:45.140757 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529de11f-eecd-4fef-bbad-9321b098354b None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:33:45.142256 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-529de11f-eecd-4fef-bbad-9321b098354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:45.266071 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529de11f-eecd-4fef-bbad-9321b098354b None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:33:45.357408 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb718b-4de3-4560-a4aa-5269af9bffb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:33:45.358263 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb718b-4de3-4560-a4aa-5269af9bffb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:45.358532 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb718b-4de3-4560-a4aa-5269af9bffb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:45.358805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb718b-4de3-4560-a4aa-5269af9bffb6 admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:45.368479 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb718b-4de3-4560-a4aa-5269af9bffb6 admin admin] RBAC: Authorizing `identity:get_project(project_id=67f1c5c4abff46008cee0510849c586e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:33:45.370523 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb718b-4de3-4560-a4aa-5269af9bffb6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:33:45.372244 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 668/1328] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:33:45 2022] GET /identity/v3/projects/67f1c5c4abff46008cee0510849c586e => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:33:45.384628 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06a13b-e546-48ed-ad51-45b0c7c4302d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:33:45.385826 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2f06a13b-e546-48ed-ad51-45b0c7c4302d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:45.471484 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06a13b-e546-48ed-ad51-45b0c7c4302d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:33:45.541573 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa72bf8-a6f4-42ec-837c-6ae0879d5125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:33:45.542132 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa72bf8-a6f4-42ec-837c-6ae0879d5125 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:45.542406 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa72bf8-a6f4-42ec-837c-6ae0879d5125 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:45.542674 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa72bf8-a6f4-42ec-837c-6ae0879d5125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:45.544313 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7fa72bf8-a6f4-42ec-837c-6ae0879d5125 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:45.651947 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa72bf8-a6f4-42ec-837c-6ae0879d5125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:33:45.653399 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa72bf8-a6f4-42ec-837c-6ae0879d5125 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:33:45.670781 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 661/1329] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:33:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:33:48.607681 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e0405-db57-4798-8a83-a1af9ce95def None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:48.608222 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e0405-db57-4798-8a83-a1af9ce95def None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:48.608222 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e0405-db57-4798-8a83-a1af9ce95def None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:48.609958 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 669/1330] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:33:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:33:48.615480 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9181f-ab8b-4279-b86b-71c1a6374f67 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:48.615900 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9181f-ab8b-4279-b86b-71c1a6374f67 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:48.616153 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9181f-ab8b-4279-b86b-71c1a6374f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:48.680381 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e4d9181f-ab8b-4279-b86b-71c1a6374f67 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:33:48.681567 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e4d9181f-ab8b-4279-b86b-71c1a6374f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:48.774331 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 662/1331] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:33:48.810876 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e0405-db57-4798-8a83-a1af9ce95def None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:33:48.812426 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-196e0405-db57-4798-8a83-a1af9ce95def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:48.912993 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e0405-db57-4798-8a83-a1af9ce95def None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:33:48.982165 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38249961-69e0-44aa-99c2-4e9d652b3d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:33:48.982798 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38249961-69e0-44aa-99c2-4e9d652b3d96 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:48.983082 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38249961-69e0-44aa-99c2-4e9d652b3d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:48.983352 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38249961-69e0-44aa-99c2-4e9d652b3d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:48.984980 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-38249961-69e0-44aa-99c2-4e9d652b3d96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:49.089737 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38249961-69e0-44aa-99c2-4e9d652b3d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:33:49.091148 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38249961-69e0-44aa-99c2-4e9d652b3d96 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:33:49.108427 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 670/1332] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:33:51.402997 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55cb7a-1273-49ac-b184-c30d60e8a749 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:51.403610 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55cb7a-1273-49ac-b184-c30d60e8a749 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:51.403610 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55cb7a-1273-49ac-b184-c30d60e8a749 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:51.405393 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 663/1333] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:33:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:33:51.410823 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee762d-de7e-4fd1-86b9-b879a59143d2 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:51.411267 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee762d-de7e-4fd1-86b9-b879a59143d2 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:51.411369 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee762d-de7e-4fd1-86b9-b879a59143d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:51.487132 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-c0ee762d-de7e-4fd1-86b9-b879a59143d2 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:33:51.488362 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-c0ee762d-de7e-4fd1-86b9-b879a59143d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:51.584865 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 671/1334] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:33:51.620475 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55cb7a-1273-49ac-b184-c30d60e8a749 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:33:51.622083 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3d55cb7a-1273-49ac-b184-c30d60e8a749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:51.723191 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55cb7a-1273-49ac-b184-c30d60e8a749 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:33:51.794457 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67300671-6a20-4602-872c-5112c20519f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:33:51.795088 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67300671-6a20-4602-872c-5112c20519f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:51.795370 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67300671-6a20-4602-872c-5112c20519f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:51.795645 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67300671-6a20-4602-872c-5112c20519f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:51.797306 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-67300671-6a20-4602-872c-5112c20519f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:51.903113 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67300671-6a20-4602-872c-5112c20519f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:33:51.904366 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67300671-6a20-4602-872c-5112c20519f9 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:33:51.922378 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 664/1335] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:33:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:33:54.237931 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b50e7-8573-4109-89ba-9588996257d4 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:54.238501 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b50e7-8573-4109-89ba-9588996257d4 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:54.238501 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b50e7-8573-4109-89ba-9588996257d4 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:54.241079 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 672/1336] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:33:54.246393 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7e406-3a6b-4096-920b-67c365119b09 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:54.246837 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7e406-3a6b-4096-920b-67c365119b09 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:54.246979 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7e406-3a6b-4096-920b-67c365119b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:54.312625 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-efe7e406-3a6b-4096-920b-67c365119b09 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:33:54.313827 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-efe7e406-3a6b-4096-920b-67c365119b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:54.410395 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 665/1337] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:33:54.442187 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b50e7-8573-4109-89ba-9588996257d4 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:33:54.444785 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-7c5b50e7-8573-4109-89ba-9588996257d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:54.563899 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b50e7-8573-4109-89ba-9588996257d4 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:33:54.654779 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ad002-7790-40c3-9d9c-b11b8b213490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:33:54.655622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ad002-7790-40c3-9d9c-b11b8b213490 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:54.655935 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ad002-7790-40c3-9d9c-b11b8b213490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:54.656209 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ad002-7790-40c3-9d9c-b11b8b213490 admin admin] PATH_INFO: `/v3/projects/67f1c5c4abff46008cee0510849c586e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:54.666464 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ad002-7790-40c3-9d9c-b11b8b213490 admin admin] RBAC: Authorizing `identity:get_project(project_id=67f1c5c4abff46008cee0510849c586e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:33:54.668554 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ad002-7790-40c3-9d9c-b11b8b213490 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:33:54.670393 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 673/1338] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:33:54 2022] GET /identity/v3/projects/67f1c5c4abff46008cee0510849c586e => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:33:54.681855 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7e406-3a6b-4096-920b-67c365119b09 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:33:54.683194 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-efe7e406-3a6b-4096-920b-67c365119b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:54.771694 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7e406-3a6b-4096-920b-67c365119b09 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:33:54.842789 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245ff24-684a-450a-acba-a0e45447f30a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:33:54.843357 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245ff24-684a-450a-acba-a0e45447f30a service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:54.843639 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245ff24-684a-450a-acba-a0e45447f30a service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:54.843955 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245ff24-684a-450a-acba-a0e45447f30a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:54.845580 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e245ff24-684a-450a-acba-a0e45447f30a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:54.952758 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245ff24-684a-450a-acba-a0e45447f30a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:33:54.954196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245ff24-684a-450a-acba-a0e45447f30a service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:33:54.972075 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 666/1339] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:33:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:33:57.452624 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a71ab-3f33-4cdf-b638-b3aa1955ed57 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:57.453105 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a71ab-3f33-4cdf-b638-b3aa1955ed57 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:57.453208 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a71ab-3f33-4cdf-b638-b3aa1955ed57 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:57.454979 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 674/1340] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:33:57.460699 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b511de-97cd-4e4b-80ac-429d409b8790 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:57.461231 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b511de-97cd-4e4b-80ac-429d409b8790 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:57.461231 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b511de-97cd-4e4b-80ac-429d409b8790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:57.531141 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-58b511de-97cd-4e4b-80ac-429d409b8790 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:33:57.532395 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-58b511de-97cd-4e4b-80ac-429d409b8790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:57.631072 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 667/1341] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:33:57.668446 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a71ab-3f33-4cdf-b638-b3aa1955ed57 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:33:57.669981 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-072a71ab-3f33-4cdf-b638-b3aa1955ed57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:57.770508 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a71ab-3f33-4cdf-b638-b3aa1955ed57 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:33:57.842832 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe4e9b-c221-42f5-bbf6-aff79a548377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:33:57.843394 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe4e9b-c221-42f5-bbf6-aff79a548377 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:33:57.843674 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe4e9b-c221-42f5-bbf6-aff79a548377 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:33:57.843976 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe4e9b-c221-42f5-bbf6-aff79a548377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:33:57.845604 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-1dbe4e9b-c221-42f5-bbf6-aff79a548377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:33:57.952142 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe4e9b-c221-42f5-bbf6-aff79a548377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:33:57.953757 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe4e9b-c221-42f5-bbf6-aff79a548377 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:33:57.975370 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 675/1342] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:34:00.280452 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def84be5-42ec-4dd4-a4ef-6de96454c646 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:00.280985 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def84be5-42ec-4dd4-a4ef-6de96454c646 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:00.280985 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def84be5-42ec-4dd4-a4ef-6de96454c646 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:00.282769 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 668/1343] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:00.288504 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a307b-a819-44c3-8315-4a55f892b315 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:00.288914 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a307b-a819-44c3-8315-4a55f892b315 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:00.289057 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a307b-a819-44c3-8315-4a55f892b315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:00.360318 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-235a307b-a819-44c3-8315-4a55f892b315 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:00.361517 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-235a307b-a819-44c3-8315-4a55f892b315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:00.467407 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 676/1344] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:34:00.502818 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def84be5-42ec-4dd4-a4ef-6de96454c646 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:00.517456 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def84be5-42ec-4dd4-a4ef-6de96454c646 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:00.522723 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d77a0-2ffe-4042-b739-b2f80c0ac2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:00.523557 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d77a0-2ffe-4042-b739-b2f80c0ac2ee admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:00.523870 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d77a0-2ffe-4042-b739-b2f80c0ac2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:00.524150 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d77a0-2ffe-4042-b739-b2f80c0ac2ee admin admin] PATH_INFO: `/v3/projects/2b5e4fc6dd694372b7f8775a6f881cca` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:00.525353 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d77a0-2ffe-4042-b739-b2f80c0ac2ee admin admin] RBAC: Authorizing `identity:get_project(project_id=2b5e4fc6dd694372b7f8775a6f881cca)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:00.527156 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d77a0-2ffe-4042-b739-b2f80c0ac2ee admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:00.529036 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 669/1345] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:34:00 2022] GET /identity/v3/projects/2b5e4fc6dd694372b7f8775a6f881cca => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:34:00.540991 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a307b-a819-44c3-8315-4a55f892b315 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:00.542422 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-235a307b-a819-44c3-8315-4a55f892b315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:00.634320 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a307b-a819-44c3-8315-4a55f892b315 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:00.638000 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13977e6c-a6bb-4267-99c5-28dd7d60d9b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:00.638883 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13977e6c-a6bb-4267-99c5-28dd7d60d9b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:00.639162 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13977e6c-a6bb-4267-99c5-28dd7d60d9b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:00.639437 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13977e6c-a6bb-4267-99c5-28dd7d60d9b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:00.648957 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13977e6c-a6bb-4267-99c5-28dd7d60d9b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:00.650378 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13977e6c-a6bb-4267-99c5-28dd7d60d9b4 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:00.659744 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 677/1346] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:34:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:34:03.228150 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d10c62-cbe0-4f11-a3da-04e4adbc29ee None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:03.228722 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d10c62-cbe0-4f11-a3da-04e4adbc29ee None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:03.228722 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d10c62-cbe0-4f11-a3da-04e4adbc29ee None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:03.230480 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 670/1347] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:03.235879 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ce25a-7d2f-4e4a-8a74-0cf248eb07f4 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:03.236285 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ce25a-7d2f-4e4a-8a74-0cf248eb07f4 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:03.236438 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ce25a-7d2f-4e4a-8a74-0cf248eb07f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:03.254151 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-936ce25a-7d2f-4e4a-8a74-0cf248eb07f4 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:03.256311 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-936ce25a-7d2f-4e4a-8a74-0cf248eb07f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:03.264574 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 678/1348] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:03.301065 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d10c62-cbe0-4f11-a3da-04e4adbc29ee None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:03.303714 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-74d10c62-cbe0-4f11-a3da-04e4adbc29ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:03.316523 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d10c62-cbe0-4f11-a3da-04e4adbc29ee None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:03.320948 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38248ce6-72fe-4e53-8097-6cce4a762de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:03.321628 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38248ce6-72fe-4e53-8097-6cce4a762de1 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:03.321909 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38248ce6-72fe-4e53-8097-6cce4a762de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:03.322182 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38248ce6-72fe-4e53-8097-6cce4a762de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:03.331012 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38248ce6-72fe-4e53-8097-6cce4a762de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:03.332525 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38248ce6-72fe-4e53-8097-6cce4a762de1 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:03.342150 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 671/1349] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:34:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:34:07.581031 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de061559-3626-496e-98b8-a3adf3798446 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:07.581566 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de061559-3626-496e-98b8-a3adf3798446 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:07.581686 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de061559-3626-496e-98b8-a3adf3798446 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:07.584544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 679/1350] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:34:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:07.590525 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4928e8-1fa6-4ac1-8baf-544a4c1e439f None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:07.590963 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4928e8-1fa6-4ac1-8baf-544a4c1e439f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:07.591081 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4928e8-1fa6-4ac1-8baf-544a4c1e439f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:07.609824 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-9b4928e8-1fa6-4ac1-8baf-544a4c1e439f None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:07.611033 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9b4928e8-1fa6-4ac1-8baf-544a4c1e439f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:07.619226 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 672/1351] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:07.642573 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de061559-3626-496e-98b8-a3adf3798446 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:07.655696 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de061559-3626-496e-98b8-a3adf3798446 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:07.660230 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072302c-a3bd-448d-8fa3-55e57613e513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:07.660935 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072302c-a3bd-448d-8fa3-55e57613e513 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:07.662069 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072302c-a3bd-448d-8fa3-55e57613e513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:07.662495 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072302c-a3bd-448d-8fa3-55e57613e513 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:07.663366 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072302c-a3bd-448d-8fa3-55e57613e513 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:07.665242 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072302c-a3bd-448d-8fa3-55e57613e513 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:07.679606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 680/1352] 10.222.0.35 () {56 vars in 1108 bytes} [Tue Feb 8 16:34:07 2022] GET /identity/v3/projects => generated 2553 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:34:09.944817 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680c974-9d52-4316-9479-81c3e7e00e76 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:09.945360 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680c974-9d52-4316-9479-81c3e7e00e76 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:09.945360 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680c974-9d52-4316-9479-81c3e7e00e76 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:09.947132 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 673/1353] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:34:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:09.952734 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73519182-42bf-4e5f-9479-eea78d8b72dc None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:09.953196 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73519182-42bf-4e5f-9479-eea78d8b72dc None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:09.953307 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73519182-42bf-4e5f-9479-eea78d8b72dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:09.970660 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-73519182-42bf-4e5f-9479-eea78d8b72dc None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:09.971871 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-73519182-42bf-4e5f-9479-eea78d8b72dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:09.979731 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 681/1354] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:10.014787 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680c974-9d52-4316-9479-81c3e7e00e76 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:10.027335 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680c974-9d52-4316-9479-81c3e7e00e76 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:10.031772 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051fe3e-537e-4064-86bd-16d430c45d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:10.032625 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051fe3e-537e-4064-86bd-16d430c45d04 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:10.033015 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051fe3e-537e-4064-86bd-16d430c45d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:10.033296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051fe3e-537e-4064-86bd-16d430c45d04 admin admin] PATH_INFO: `/v3/projects/2b5e4fc6dd694372b7f8775a6f881cca` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:10.034594 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051fe3e-537e-4064-86bd-16d430c45d04 admin admin] RBAC: Authorizing `identity:get_project(project_id=2b5e4fc6dd694372b7f8775a6f881cca)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:10.037160 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051fe3e-537e-4064-86bd-16d430c45d04 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:10.038825 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 674/1355] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:34:10 2022] GET /identity/v3/projects/2b5e4fc6dd694372b7f8775a6f881cca => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:34:10.050258 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73519182-42bf-4e5f-9479-eea78d8b72dc None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:10.060548 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73519182-42bf-4e5f-9479-eea78d8b72dc None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:10.064123 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16406b53-9dbc-4605-998c-8494e136c2c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:10.064761 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16406b53-9dbc-4605-998c-8494e136c2c6 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:10.065042 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16406b53-9dbc-4605-998c-8494e136c2c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:10.065318 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16406b53-9dbc-4605-998c-8494e136c2c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:10.074594 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16406b53-9dbc-4605-998c-8494e136c2c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:10.076044 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16406b53-9dbc-4605-998c-8494e136c2c6 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:10.086181 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 682/1356] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:34:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:34:12.944777 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d93a7-a4b9-4042-b1eb-b7e35ebf993d None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:12.945376 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d93a7-a4b9-4042-b1eb-b7e35ebf993d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:12.945550 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d93a7-a4b9-4042-b1eb-b7e35ebf993d None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:12.947372 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 675/1357] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:34:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:12.952665 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaabf40-f94a-4d2d-955c-e33922fbada4 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:12.953052 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaabf40-f94a-4d2d-955c-e33922fbada4 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:12.953340 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaabf40-f94a-4d2d-955c-e33922fbada4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:12.971584 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-2aaabf40-f94a-4d2d-955c-e33922fbada4 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:12.972827 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-2aaabf40-f94a-4d2d-955c-e33922fbada4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:12.981248 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 683/1358] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:13.019453 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d93a7-a4b9-4042-b1eb-b7e35ebf993d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:13.031283 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d93a7-a4b9-4042-b1eb-b7e35ebf993d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:13.034866 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154a4fd-564d-460f-8d36-0432f73ddba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:13.035498 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154a4fd-564d-460f-8d36-0432f73ddba4 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:13.036385 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154a4fd-564d-460f-8d36-0432f73ddba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:13.036720 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154a4fd-564d-460f-8d36-0432f73ddba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:13.045970 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154a4fd-564d-460f-8d36-0432f73ddba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:13.047401 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154a4fd-564d-460f-8d36-0432f73ddba4 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:13.056702 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 676/1359] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:34:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:34:17.316476 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f75eb-6dac-488b-907d-018060409e31 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:17.317557 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f75eb-6dac-488b-907d-018060409e31 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:17.317751 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f75eb-6dac-488b-907d-018060409e31 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:17.319581 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 684/1360] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:34:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:17.325210 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb41f0-d720-47b2-bc65-09d5faac4d9f None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:17.325678 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb41f0-d720-47b2-bc65-09d5faac4d9f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:17.325772 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb41f0-d720-47b2-bc65-09d5faac4d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:17.344942 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-a3cb41f0-d720-47b2-bc65-09d5faac4d9f None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:17.346255 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a3cb41f0-d720-47b2-bc65-09d5faac4d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:17.354918 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 677/1361] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:17.394518 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f75eb-6dac-488b-907d-018060409e31 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:17.405698 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f75eb-6dac-488b-907d-018060409e31 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:17.409284 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf9087-f091-4f45-9ea4-c47cb0e40233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:17.409924 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf9087-f091-4f45-9ea4-c47cb0e40233 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:17.410206 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf9087-f091-4f45-9ea4-c47cb0e40233 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:17.410490 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf9087-f091-4f45-9ea4-c47cb0e40233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:17.420583 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf9087-f091-4f45-9ea4-c47cb0e40233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:17.422120 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf9087-f091-4f45-9ea4-c47cb0e40233 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:17.432574 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 685/1362] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:34:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:34:22.572923 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2de52f-db69-4bf8-b713-99337407551a None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:22.573628 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2de52f-db69-4bf8-b713-99337407551a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:22.573628 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2de52f-db69-4bf8-b713-99337407551a None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:22.575262 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 678/1363] 10.222.0.35 () {54 vars in 921 bytes} [Tue Feb 8 16:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:22.580654 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e241ea1-7cdc-44ce-a0f2-9f3e1ba36af7 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:22.581570 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e241ea1-7cdc-44ce-a0f2-9f3e1ba36af7 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:22.582102 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e241ea1-7cdc-44ce-a0f2-9f3e1ba36af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:22.654498 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-9e241ea1-7cdc-44ce-a0f2-9f3e1ba36af7 None None] MFA Rules not processed for user `75c8f232fc83474b8731ee6c1eb321fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:22.655938 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-9e241ea1-7cdc-44ce-a0f2-9f3e1ba36af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:22.730249 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 686/1364] 10.222.0.35 () {58 vars in 1018 bytes} [Tue Feb 8 16:34:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:34:26.901061 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c3a85-cc23-45fb-a941-cf9b7bb6af98 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:26.901742 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c3a85-cc23-45fb-a941-cf9b7bb6af98 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:26.901742 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c3a85-cc23-45fb-a941-cf9b7bb6af98 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:26.903399 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 679/1365] 10.222.0.35 () {54 vars in 921 bytes} [Tue Feb 8 16:34:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:26.911219 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac039bd8-6aeb-4ab3-a8c2-f1bbce8daa66 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:26.911744 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac039bd8-6aeb-4ab3-a8c2-f1bbce8daa66 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:26.911744 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac039bd8-6aeb-4ab3-a8c2-f1bbce8daa66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:26.931370 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-ac039bd8-6aeb-4ab3-a8c2-f1bbce8daa66 None None] MFA Rules not processed for user `75c8f232fc83474b8731ee6c1eb321fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:26.932836 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-ac039bd8-6aeb-4ab3-a8c2-f1bbce8daa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:26.942475 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 687/1366] 10.222.0.35 () {58 vars in 1018 bytes} [Tue Feb 8 16:34:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:28.580335 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a1044-c54d-4ff9-b846-562a69f50043 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:28.581035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a1044-c54d-4ff9-b846-562a69f50043 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:28.581035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a1044-c54d-4ff9-b846-562a69f50043 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:28.583876 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 680/1367] 10.222.0.35 () {54 vars in 921 bytes} [Tue Feb 8 16:34:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:28.588972 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53f007-100b-4aa6-be0a-567065790710 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:28.589416 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53f007-100b-4aa6-be0a-567065790710 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:28.589595 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53f007-100b-4aa6-be0a-567065790710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:28.608061 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-0b53f007-100b-4aa6-be0a-567065790710 None None] MFA Rules not processed for user `75c8f232fc83474b8731ee6c1eb321fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:28.609237 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-0b53f007-100b-4aa6-be0a-567065790710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:28.618255 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 688/1368] 10.222.0.35 () {58 vars in 1018 bytes} [Tue Feb 8 16:34:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:34:32.455298 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e4d24-0c79-4836-8f0a-62639946327b None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:32.455887 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e4d24-0c79-4836-8f0a-62639946327b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:32.455887 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e4d24-0c79-4836-8f0a-62639946327b None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:32.458581 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 681/1369] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:34:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:32.463587 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794261fb-007b-4cee-8c90-e63a18056bfa None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:32.464013 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794261fb-007b-4cee-8c90-e63a18056bfa None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:32.464173 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794261fb-007b-4cee-8c90-e63a18056bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:32.482369 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-794261fb-007b-4cee-8c90-e63a18056bfa None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:32.483715 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-794261fb-007b-4cee-8c90-e63a18056bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:32.491837 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 689/1370] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:32.541084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9309bb-e815-4a2f-824e-79be14bd38a7 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:32.541644 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9309bb-e815-4a2f-824e-79be14bd38a7 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:32.542145 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9309bb-e815-4a2f-824e-79be14bd38a7 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:32.544128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 682/1371] 10.222.0.35 () {54 vars in 961 bytes} [Tue Feb 8 16:34:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:34:32.549868 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0bc06-7ed3-4890-98aa-6ec5864b4815 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:32.550414 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0bc06-7ed3-4890-98aa-6ec5864b4815 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:32.550925 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0bc06-7ed3-4890-98aa-6ec5864b4815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:32.601317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-0fe0bc06-7ed3-4890-98aa-6ec5864b4815 None None] MFA Rules not processed for user `ccb02e5d8ef14f8f85bbacfa5b1f5be3`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:32.602848 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-0fe0bc06-7ed3-4890-98aa-6ec5864b4815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:32.683480 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 690/1372] 10.222.0.35 () {58 vars in 1058 bytes} [Tue Feb 8 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:32.692059 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9309bb-e815-4a2f-824e-79be14bd38a7 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:32.706668 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9309bb-e815-4a2f-824e-79be14bd38a7 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:32.712585 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360ed0a-9df4-4aed-80ce-3f6b983567b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:32.713486 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360ed0a-9df4-4aed-80ce-3f6b983567b7 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:32.713967 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360ed0a-9df4-4aed-80ce-3f6b983567b7 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:32.714438 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360ed0a-9df4-4aed-80ce-3f6b983567b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:32.723715 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360ed0a-9df4-4aed-80ce-3f6b983567b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:32.725684 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360ed0a-9df4-4aed-80ce-3f6b983567b7 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:32.747937 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 683/1373] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:34:35.206419 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5ec27-1334-46b3-8ad7-b3bfeb26f4e4 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:35.206945 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5ec27-1334-46b3-8ad7-b3bfeb26f4e4 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:35.207189 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5ec27-1334-46b3-8ad7-b3bfeb26f4e4 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:35.209212 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 691/1374] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:35.214403 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487ad91-9e11-4c1c-a83f-589ca3e506a5 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:35.214871 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487ad91-9e11-4c1c-a83f-589ca3e506a5 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:35.214961 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487ad91-9e11-4c1c-a83f-589ca3e506a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:35.233178 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-3487ad91-9e11-4c1c-a83f-589ca3e506a5 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:35.234555 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3487ad91-9e11-4c1c-a83f-589ca3e506a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:35.243213 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 684/1375] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:35.288013 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5ec27-1334-46b3-8ad7-b3bfeb26f4e4 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:35.307954 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5ec27-1334-46b3-8ad7-b3bfeb26f4e4 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:35.314036 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54601048-0841-4bef-87ee-64be4477f676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:35.314744 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54601048-0841-4bef-87ee-64be4477f676 service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:35.315087 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54601048-0841-4bef-87ee-64be4477f676 service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:35.315425 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54601048-0841-4bef-87ee-64be4477f676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:35.325241 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54601048-0841-4bef-87ee-64be4477f676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:35.327011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54601048-0841-4bef-87ee-64be4477f676 service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:35.337149 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 692/1376] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:34:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:34:37.881242 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf29e8-f802-4b6a-939e-1acdddc89520 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:37.881797 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf29e8-f802-4b6a-939e-1acdddc89520 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:37.881797 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf29e8-f802-4b6a-939e-1acdddc89520 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:37.883583 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 685/1377] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:37.889117 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd5d8c-db1a-4aa9-acb3-ce21be78c144 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:37.889517 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd5d8c-db1a-4aa9-acb3-ce21be78c144 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:37.889659 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd5d8c-db1a-4aa9-acb3-ce21be78c144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:37.909245 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-0cbd5d8c-db1a-4aa9-acb3-ce21be78c144 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:37.910912 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-0cbd5d8c-db1a-4aa9-acb3-ce21be78c144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:37.919345 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 693/1378] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:37.966460 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41733c-8e36-4f0a-81c4-e10f69320862 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:37.966740 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41733c-8e36-4f0a-81c4-e10f69320862 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:37.967014 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41733c-8e36-4f0a-81c4-e10f69320862 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:37.968891 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 686/1379] 10.222.0.35 () {54 vars in 961 bytes} [Tue Feb 8 16:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:37.974503 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d98fc3-6cf7-4806-809c-fa9650940c03 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:37.974794 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d98fc3-6cf7-4806-809c-fa9650940c03 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:37.975076 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d98fc3-6cf7-4806-809c-fa9650940c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:37.993086 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-52d98fc3-6cf7-4806-809c-fa9650940c03 None None] MFA Rules not processed for user `ccb02e5d8ef14f8f85bbacfa5b1f5be3`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:37.994262 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-52d98fc3-6cf7-4806-809c-fa9650940c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:38.003963 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 694/1380] 10.222.0.35 () {58 vars in 1058 bytes} [Tue Feb 8 16:34:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:34:38.011551 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41733c-8e36-4f0a-81c4-e10f69320862 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:38.026797 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41733c-8e36-4f0a-81c4-e10f69320862 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:38.032474 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1d527-907d-481f-9f45-5c7342c4dd66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:38.033096 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1d527-907d-481f-9f45-5c7342c4dd66 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:38.033380 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1d527-907d-481f-9f45-5c7342c4dd66 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:38.033655 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1d527-907d-481f-9f45-5c7342c4dd66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:38.041955 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1d527-907d-481f-9f45-5c7342c4dd66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:38.043720 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1d527-907d-481f-9f45-5c7342c4dd66 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:38.054035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 687/1381] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:34:40.343102 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28057f-12c5-4b82-b516-d78c96d862f4 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:40.343651 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28057f-12c5-4b82-b516-d78c96d862f4 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:40.343651 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28057f-12c5-4b82-b516-d78c96d862f4 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:40.345422 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 695/1382] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:40.351545 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882a621-6162-43f3-ab00-b2d8b3574f65 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:40.352472 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882a621-6162-43f3-ab00-b2d8b3574f65 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:40.352967 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882a621-6162-43f3-ab00-b2d8b3574f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:40.371035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-b882a621-6162-43f3-ab00-b2d8b3574f65 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:40.372323 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b882a621-6162-43f3-ab00-b2d8b3574f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:40.380454 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 688/1383] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:40.427437 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28057f-12c5-4b82-b516-d78c96d862f4 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:40.446627 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28057f-12c5-4b82-b516-d78c96d862f4 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:40.452716 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806dee1-24b6-4842-8be6-7acd1539004e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:40.453447 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806dee1-24b6-4842-8be6-7acd1539004e service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:40.453802 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806dee1-24b6-4842-8be6-7acd1539004e service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:40.454149 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806dee1-24b6-4842-8be6-7acd1539004e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:40.462985 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806dee1-24b6-4842-8be6-7acd1539004e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:40.464678 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806dee1-24b6-4842-8be6-7acd1539004e service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:40.474493 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 696/1384] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:34:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:34:40.700031 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b2d7e-9c73-4862-9335-ba0b5e0a93d8 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:40.700224 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b2d7e-9c73-4862-9335-ba0b5e0a93d8 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:40.701441 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b2d7e-9c73-4862-9335-ba0b5e0a93d8 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:40.703471 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 689/1385] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:34:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:40.709997 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbb59a-1b89-4dd2-8573-1681367a8e32 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:40.710340 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbb59a-1b89-4dd2-8573-1681367a8e32 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:40.710636 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbb59a-1b89-4dd2-8573-1681367a8e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:40.729606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-61dbb59a-1b89-4dd2-8573-1681367a8e32 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:40.730817 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-61dbb59a-1b89-4dd2-8573-1681367a8e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:40.738991 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 697/1386] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:40.998995 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a9c9b-45be-4a3a-b8da-dbb31b47731c None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:40.999284 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a9c9b-45be-4a3a-b8da-dbb31b47731c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:40.999566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a9c9b-45be-4a3a-b8da-dbb31b47731c None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:41.001648 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 690/1387] 10.222.0.35 () {54 vars in 963 bytes} [Tue Feb 8 16:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:41.006825 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e40269-9b4e-4096-8881-20bce1c4fc1b None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:41.007116 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e40269-9b4e-4096-8881-20bce1c4fc1b None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:41.007396 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e40269-9b4e-4096-8881-20bce1c4fc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:41.057290 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-66e40269-9b4e-4096-8881-20bce1c4fc1b None None] MFA Rules not processed for user `591ac81647b8446ab342e44c3fb35174`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:41.058483 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-66e40269-9b4e-4096-8881-20bce1c4fc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:41.118464 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 698/1388] 10.222.0.35 () {58 vars in 1060 bytes} [Tue Feb 8 16:34:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:41.126376 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a9c9b-45be-4a3a-b8da-dbb31b47731c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:41.137517 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a9c9b-45be-4a3a-b8da-dbb31b47731c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:41.141456 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e7cc0-a798-4bbc-9ea9-6c676152c816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:41.142244 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e7cc0-a798-4bbc-9ea9-6c676152c816 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:41.142622 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e7cc0-a798-4bbc-9ea9-6c676152c816 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:41.143025 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e7cc0-a798-4bbc-9ea9-6c676152c816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:41.153508 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e7cc0-a798-4bbc-9ea9-6c676152c816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:41.155097 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e7cc0-a798-4bbc-9ea9-6c676152c816 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:41.165229 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 691/1389] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:34:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:34:42.811053 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7e793-c164-40f0-aaf4-472dd9fff199 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:42.811616 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7e793-c164-40f0-aaf4-472dd9fff199 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:42.811616 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7e793-c164-40f0-aaf4-472dd9fff199 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:42.813844 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 699/1390] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:34:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:34:42.820173 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e746f-eb96-4eeb-9d1d-c31eeddc0805 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:42.820642 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e746f-eb96-4eeb-9d1d-c31eeddc0805 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:42.820752 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e746f-eb96-4eeb-9d1d-c31eeddc0805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:42.844248 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-027e746f-eb96-4eeb-9d1d-c31eeddc0805 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:42.845641 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-027e746f-eb96-4eeb-9d1d-c31eeddc0805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:42.857959 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 692/1391] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:42.905393 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7e793-c164-40f0-aaf4-472dd9fff199 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:42.923815 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7e793-c164-40f0-aaf4-472dd9fff199 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:42.931533 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f0da7-6f7e-40da-bc04-c2b3af53079d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:42.932323 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f0da7-6f7e-40da-bc04-c2b3af53079d service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:42.932645 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f0da7-6f7e-40da-bc04-c2b3af53079d service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:42.932918 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f0da7-6f7e-40da-bc04-c2b3af53079d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:42.942625 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f0da7-6f7e-40da-bc04-c2b3af53079d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:42.944263 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f0da7-6f7e-40da-bc04-c2b3af53079d service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:42.955874 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 700/1392] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:34:45.419167 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c2822-7404-4f5e-acb1-86e375d63fbc None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:45.420728 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c2822-7404-4f5e-acb1-86e375d63fbc None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:45.420728 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c2822-7404-4f5e-acb1-86e375d63fbc None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:45.422565 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 693/1393] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:34:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:45.430272 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920fa18-ca17-47d5-96e8-26d5b853993a None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:45.430727 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920fa18-ca17-47d5-96e8-26d5b853993a None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:45.430853 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920fa18-ca17-47d5-96e8-26d5b853993a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:45.450852 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-0920fa18-ca17-47d5-96e8-26d5b853993a None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:45.452065 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-0920fa18-ca17-47d5-96e8-26d5b853993a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:45.460477 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 701/1394] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:45.506424 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c2822-7404-4f5e-acb1-86e375d63fbc None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:45.521388 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c2822-7404-4f5e-acb1-86e375d63fbc None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:45.527067 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fa85e-ff55-44fe-97c7-e14d2c7d00f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:45.527720 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fa85e-ff55-44fe-97c7-e14d2c7d00f0 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:45.528046 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fa85e-ff55-44fe-97c7-e14d2c7d00f0 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:45.528323 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fa85e-ff55-44fe-97c7-e14d2c7d00f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:45.537425 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fa85e-ff55-44fe-97c7-e14d2c7d00f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:45.539007 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fa85e-ff55-44fe-97c7-e14d2c7d00f0 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:45.548662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 694/1395] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:34:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:34:47.847687 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690dd38-f797-4b12-9a6f-83498f6d594b None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:47.848283 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690dd38-f797-4b12-9a6f-83498f6d594b None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:47.848283 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690dd38-f797-4b12-9a6f-83498f6d594b None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:47.850015 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 702/1396] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:47.855426 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ca708-56a5-4d56-ae90-a2f7ef45402f None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:47.855886 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ca708-56a5-4d56-ae90-a2f7ef45402f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:47.856017 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ca708-56a5-4d56-ae90-a2f7ef45402f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:47.874038 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-495ca708-56a5-4d56-ae90-a2f7ef45402f None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:47.875223 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-495ca708-56a5-4d56-ae90-a2f7ef45402f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:47.888190 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 695/1397] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:47.928394 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690dd38-f797-4b12-9a6f-83498f6d594b None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:47.944320 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690dd38-f797-4b12-9a6f-83498f6d594b None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:47.950291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a81dd-d970-4690-be88-1efba697093d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:47.951083 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a81dd-d970-4690-be88-1efba697093d service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:47.951575 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a81dd-d970-4690-be88-1efba697093d service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:47.951990 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a81dd-d970-4690-be88-1efba697093d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:47.961824 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a81dd-d970-4690-be88-1efba697093d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:47.963530 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a81dd-d970-4690-be88-1efba697093d service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:47.974774 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 703/1398] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:34:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:34:50.723645 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b0790-73c7-4ea4-8e88-1391975f3b76 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:50.724188 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b0790-73c7-4ea4-8e88-1391975f3b76 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:50.724188 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b0790-73c7-4ea4-8e88-1391975f3b76 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:50.726016 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 696/1399] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:34:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:50.731887 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc88a26-3756-4a91-88c2-10d4b5e92d69 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:50.732307 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc88a26-3756-4a91-88c2-10d4b5e92d69 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:50.732623 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc88a26-3756-4a91-88c2-10d4b5e92d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:50.753153 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-cdc88a26-3756-4a91-88c2-10d4b5e92d69 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:50.754506 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-cdc88a26-3756-4a91-88c2-10d4b5e92d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:50.762994 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 704/1400] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:50.810390 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b0790-73c7-4ea4-8e88-1391975f3b76 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:50.825661 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b0790-73c7-4ea4-8e88-1391975f3b76 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:50.831956 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fa8bd-3692-4b21-be79-997ce80d34ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:50.832619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fa8bd-3692-4b21-be79-997ce80d34ca service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:50.832904 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fa8bd-3692-4b21-be79-997ce80d34ca service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:50.833242 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fa8bd-3692-4b21-be79-997ce80d34ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:50.841969 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fa8bd-3692-4b21-be79-997ce80d34ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:50.843548 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fa8bd-3692-4b21-be79-997ce80d34ca service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:50.853348 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 697/1401] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:34:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:34:53.177041 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313ef8b-ecff-4014-bb0d-862412614ae4 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:53.177656 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313ef8b-ecff-4014-bb0d-862412614ae4 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:53.177760 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313ef8b-ecff-4014-bb0d-862412614ae4 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:53.180408 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 705/1402] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:34:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:53.188738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3ead1-44c3-405b-bae4-4eaabd48c3dd None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:53.189278 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3ead1-44c3-405b-bae4-4eaabd48c3dd None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:53.189498 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3ead1-44c3-405b-bae4-4eaabd48c3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:53.214814 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-1fe3ead1-44c3-405b-bae4-4eaabd48c3dd None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:53.216048 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1fe3ead1-44c3-405b-bae4-4eaabd48c3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:53.224664 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 698/1403] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:53.271806 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313ef8b-ecff-4014-bb0d-862412614ae4 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:53.286197 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313ef8b-ecff-4014-bb0d-862412614ae4 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:53.291618 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6c125-630e-4ed8-baa0-425f5e46e23e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:53.292272 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6c125-630e-4ed8-baa0-425f5e46e23e service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:53.292551 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6c125-630e-4ed8-baa0-425f5e46e23e service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:53.292826 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6c125-630e-4ed8-baa0-425f5e46e23e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:53.301699 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6c125-630e-4ed8-baa0-425f5e46e23e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:53.303265 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6c125-630e-4ed8-baa0-425f5e46e23e service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:53.313368 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 706/1404] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:34:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:34:55.623926 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e21518-f91e-4cf9-8755-7e9656fbe19f None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:55.624839 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e21518-f91e-4cf9-8755-7e9656fbe19f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:55.625038 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e21518-f91e-4cf9-8755-7e9656fbe19f None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:55.626927 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 699/1405] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:34:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:55.633261 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f5e81-ea6c-49fa-b64c-e7cb2720ae22 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:55.633739 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f5e81-ea6c-49fa-b64c-e7cb2720ae22 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:55.633981 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f5e81-ea6c-49fa-b64c-e7cb2720ae22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:55.653606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-219f5e81-ea6c-49fa-b64c-e7cb2720ae22 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:55.654850 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-219f5e81-ea6c-49fa-b64c-e7cb2720ae22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:55.663229 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 707/1406] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:55.708452 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e21518-f91e-4cf9-8755-7e9656fbe19f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:55.723304 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e21518-f91e-4cf9-8755-7e9656fbe19f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:55.728816 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d1fd2-d870-4076-a430-426cff8c84c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:55.729442 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d1fd2-d870-4076-a430-426cff8c84c2 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:55.729723 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d1fd2-d870-4076-a430-426cff8c84c2 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:55.729999 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d1fd2-d870-4076-a430-426cff8c84c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:55.738312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d1fd2-d870-4076-a430-426cff8c84c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:55.739926 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d1fd2-d870-4076-a430-426cff8c84c2 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:55.749344 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 700/1407] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:34:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:34:56.444794 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5449781-43d6-4b45-8817-b5532790ab76 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:56.445079 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5449781-43d6-4b45-8817-b5532790ab76 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:56.445355 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5449781-43d6-4b45-8817-b5532790ab76 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:56.447142 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 708/1408] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:56.452760 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80925d6-0398-493c-a053-019b8c84c3a6 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:56.453055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80925d6-0398-493c-a053-019b8c84c3a6 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:56.453335 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80925d6-0398-493c-a053-019b8c84c3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:56.471185 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e80925d6-0398-493c-a053-019b8c84c3a6 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:56.472438 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e80925d6-0398-493c-a053-019b8c84c3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:56.480423 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 701/1409] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:56.536230 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01b4ea-4f40-418b-8bfe-217391b67afe None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:56.536590 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01b4ea-4f40-418b-8bfe-217391b67afe None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:56.536937 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01b4ea-4f40-418b-8bfe-217391b67afe None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:56.538804 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 709/1410] 10.222.0.35 () {54 vars in 962 bytes} [Tue Feb 8 16:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:56.543784 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93867186-7c64-4a93-b550-1f0f88ac5a3f None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:56.544085 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93867186-7c64-4a93-b550-1f0f88ac5a3f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:56.544361 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93867186-7c64-4a93-b550-1f0f88ac5a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:56.594664 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-93867186-7c64-4a93-b550-1f0f88ac5a3f None None] MFA Rules not processed for user `10453496872a45a9867fc6a13a13de49`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:56.595777 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-93867186-7c64-4a93-b550-1f0f88ac5a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:56.653951 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 702/1411] 10.222.0.35 () {58 vars in 1059 bytes} [Tue Feb 8 16:34:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:56.662270 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01b4ea-4f40-418b-8bfe-217391b67afe None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:56.672636 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01b4ea-4f40-418b-8bfe-217391b67afe None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:56.677130 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbeb9c2-91f7-4f2a-9b04-cad805aaedc2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10453496872a45a9867fc6a13a13de49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:56.677831 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbeb9c2-91f7-4f2a-9b04-cad805aaedc2 service glance] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:56.678178 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbeb9c2-91f7-4f2a-9b04-cad805aaedc2 service glance] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:56.678540 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbeb9c2-91f7-4f2a-9b04-cad805aaedc2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:56.687502 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbeb9c2-91f7-4f2a-9b04-cad805aaedc2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:56.689021 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbeb9c2-91f7-4f2a-9b04-cad805aaedc2 service glance] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:56.698756 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 710/1412] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:34:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:34:57.135387 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56fe77-ace6-4e95-a58e-a525755dd3ed None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:57.135680 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56fe77-ace6-4e95-a58e-a525755dd3ed None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:57.136005 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56fe77-ace6-4e95-a58e-a525755dd3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:57.184797 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-8e56fe77-ace6-4e95-a58e-a525755dd3ed None None] MFA Rules not processed for user `9761863f36284bd4be1ce29c86b631cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:57.185915 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-8e56fe77-ace6-4e95-a58e-a525755dd3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:57.248037 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 703/1413] 10.222.0.35 () {58 vars in 1009 bytes} [Tue Feb 8 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:57.293138 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31df6b-8654-4875-a6f5-11fa0035184b None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:57.293424 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31df6b-8654-4875-a6f5-11fa0035184b None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:57.293700 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31df6b-8654-4875-a6f5-11fa0035184b None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:57.295532 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 711/1414] 10.222.0.35 () {54 vars in 942 bytes} [Tue Feb 8 16:34:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:57.301695 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a04471-decf-4e49-9170-8581e729d68c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:57.301980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a04471-decf-4e49-9170-8581e729d68c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:57.302300 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a04471-decf-4e49-9170-8581e729d68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:57.350244 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-89a04471-decf-4e49-9170-8581e729d68c None None] MFA Rules not processed for user `00fd3c05cd8e4167946a1f567df2cc6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:57.351436 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-89a04471-decf-4e49-9170-8581e729d68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:57.422211 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 704/1415] 10.222.0.35 () {58 vars in 1039 bytes} [Tue Feb 8 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:57.432215 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31df6b-8654-4875-a6f5-11fa0035184b None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:57.445461 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31df6b-8654-4875-a6f5-11fa0035184b None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:57.450424 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958612b6-c88d-4148-b101-2f0508b9db43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00fd3c05cd8e4167946a1f567df2cc6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:57.451065 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958612b6-c88d-4148-b101-2f0508b9db43 service swift] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:57.451344 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958612b6-c88d-4148-b101-2f0508b9db43 service swift] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:57.451904 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958612b6-c88d-4148-b101-2f0508b9db43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:57.460246 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958612b6-c88d-4148-b101-2f0508b9db43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:57.462122 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958612b6-c88d-4148-b101-2f0508b9db43 service swift] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:57.470198 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 712/1416] 10.222.0.35 () {60 vars in 1384 bytes} [Tue Feb 8 16:34:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:34:58.030754 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d3f36-62eb-4ab4-ad04-c3539ebdd447 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:58.031290 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d3f36-62eb-4ab4-ad04-c3539ebdd447 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:58.031290 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d3f36-62eb-4ab4-ad04-c3539ebdd447 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:58.033214 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 705/1417] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:34:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:34:58.039361 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c3789-a03b-4cf9-ae02-95d164a06194 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:58.039841 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c3789-a03b-4cf9-ae02-95d164a06194 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:58.039951 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c3789-a03b-4cf9-ae02-95d164a06194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:58.060051 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-029c3789-a03b-4cf9-ae02-95d164a06194 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:34:58.061259 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-029c3789-a03b-4cf9-ae02-95d164a06194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:34:58.069955 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 713/1418] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:34:58.114872 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d3f36-62eb-4ab4-ad04-c3539ebdd447 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:34:58.136042 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d3f36-62eb-4ab4-ad04-c3539ebdd447 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:34:58.144177 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2871c3-154b-4a16-b942-0c5545f3fede service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:34:58.144824 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2871c3-154b-4a16-b942-0c5545f3fede service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:34:58.145104 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2871c3-154b-4a16-b942-0c5545f3fede service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:34:58.145381 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2871c3-154b-4a16-b942-0c5545f3fede service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:34:58.154726 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2871c3-154b-4a16-b942-0c5545f3fede service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:34:58.156367 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2871c3-154b-4a16-b942-0c5545f3fede service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:34:58.170786 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 706/1419] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:00.501250 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ce93a-0674-4b3f-9289-3634208ac7c3 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:00.501793 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ce93a-0674-4b3f-9289-3634208ac7c3 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:00.501793 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ce93a-0674-4b3f-9289-3634208ac7c3 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:00.503810 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 714/1420] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:35:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:00.509303 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee804ffe-4701-47f7-af51-d3f9fa2f2277 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:00.509761 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee804ffe-4701-47f7-af51-d3f9fa2f2277 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:00.509855 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee804ffe-4701-47f7-af51-d3f9fa2f2277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:00.529058 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ee804ffe-4701-47f7-af51-d3f9fa2f2277 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:35:00.530311 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ee804ffe-4701-47f7-af51-d3f9fa2f2277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:35:00.539360 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 707/1421] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:35:00.588635 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ce93a-0674-4b3f-9289-3634208ac7c3 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:35:00.621129 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ce93a-0674-4b3f-9289-3634208ac7c3 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:35:00.642481 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa829a-5bb4-467d-a035-cfc34b2a5dbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:35:00.645366 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa829a-5bb4-467d-a035-cfc34b2a5dbc service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:00.645915 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa829a-5bb4-467d-a035-cfc34b2a5dbc service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:00.646414 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa829a-5bb4-467d-a035-cfc34b2a5dbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:00.663992 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa829a-5bb4-467d-a035-cfc34b2a5dbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:35:00.666274 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa829a-5bb4-467d-a035-cfc34b2a5dbc service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:35:00.677534 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 715/1422] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:35:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:20.337693 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94c4d6-61fe-4fb2-b83d-6e382a133291 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:20.338321 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94c4d6-61fe-4fb2-b83d-6e382a133291 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:20.338321 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94c4d6-61fe-4fb2-b83d-6e382a133291 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:20.340094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 708/1423] 10.222.0.35 () {54 vars in 918 bytes} [Tue Feb 8 16:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:20.345681 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29826f4c-aee5-4f00-966a-9d0f56d9b47b None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:20.346180 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29826f4c-aee5-4f00-966a-9d0f56d9b47b None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:20.346282 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29826f4c-aee5-4f00-966a-9d0f56d9b47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:20.364991 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-29826f4c-aee5-4f00-966a-9d0f56d9b47b None None] MFA Rules not processed for user `75c8f232fc83474b8731ee6c1eb321fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:35:20.366170 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-29826f4c-aee5-4f00-966a-9d0f56d9b47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:35:20.374619 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 716/1424] 10.222.0.35 () {58 vars in 1015 bytes} [Tue Feb 8 16:35:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:35:20.390295 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78f06d-9b48-4078-a0d1-c9de88707f08 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:20.390577 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78f06d-9b48-4078-a0d1-c9de88707f08 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:20.390856 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78f06d-9b48-4078-a0d1-c9de88707f08 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:20.392838 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 709/1425] 10.222.0.35 () {54 vars in 918 bytes} [Tue Feb 8 16:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:20.397391 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e9cab-77c3-4507-9146-e15d9c6be4cb None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:20.397672 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e9cab-77c3-4507-9146-e15d9c6be4cb None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:20.397945 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e9cab-77c3-4507-9146-e15d9c6be4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:20.415528 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-e89e9cab-77c3-4507-9146-e15d9c6be4cb None None] MFA Rules not processed for user `ccb02e5d8ef14f8f85bbacfa5b1f5be3`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:35:20.416728 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-e89e9cab-77c3-4507-9146-e15d9c6be4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:35:20.432259 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 717/1426] 10.222.0.35 () {58 vars in 1015 bytes} [Tue Feb 8 16:35:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:35:23.103248 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550ccc8-3a0d-4fd1-8a31-cdaae890d72d None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:23.103966 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550ccc8-3a0d-4fd1-8a31-cdaae890d72d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:23.103966 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550ccc8-3a0d-4fd1-8a31-cdaae890d72d None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:23.105746 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 710/1427] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 8 16:35:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:23.111295 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d19fbb-d347-43af-b162-918b076cd083 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:23.111778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d19fbb-d347-43af-b162-918b076cd083 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:23.111890 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d19fbb-d347-43af-b162-918b076cd083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:23.129786 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-25d19fbb-d347-43af-b162-918b076cd083 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:35:23.130961 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-25d19fbb-d347-43af-b162-918b076cd083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:35:23.139153 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 718/1428] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 8 16:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:35:23.182312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550ccc8-3a0d-4fd1-8a31-cdaae890d72d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:35:23.196696 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550ccc8-3a0d-4fd1-8a31-cdaae890d72d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:35:23.202002 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09676fca-ab48-4151-b738-bd3e7e814c0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:35:23.202611 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09676fca-ab48-4151-b738-bd3e7e814c0a service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:23.202889 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09676fca-ab48-4151-b738-bd3e7e814c0a service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:23.203238 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09676fca-ab48-4151-b738-bd3e7e814c0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:23.211225 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09676fca-ab48-4151-b738-bd3e7e814c0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:35:23.212817 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09676fca-ab48-4151-b738-bd3e7e814c0a service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:35:23.222092 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 711/1429] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:35:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:24.584819 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2db1bd-6986-47cd-8c94-fb8f5d9ff367 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:24.585398 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2db1bd-6986-47cd-8c94-fb8f5d9ff367 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:24.585538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2db1bd-6986-47cd-8c94-fb8f5d9ff367 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:24.587532 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 719/1430] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 8 16:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:24.592613 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd0402-51af-4c23-9071-b63cbc96a384 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:24.593076 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd0402-51af-4c23-9071-b63cbc96a384 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:24.593174 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd0402-51af-4c23-9071-b63cbc96a384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:24.611833 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-35dd0402-51af-4c23-9071-b63cbc96a384 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:35:24.613035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-35dd0402-51af-4c23-9071-b63cbc96a384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:35:24.620674 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 712/1431] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 8 16:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:35:24.784236 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2db1bd-6986-47cd-8c94-fb8f5d9ff367 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:35:24.798467 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2db1bd-6986-47cd-8c94-fb8f5d9ff367 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:35:24.803899 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abe9e0-27ae-4fe4-985d-75aea76e7eb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:35:24.804523 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abe9e0-27ae-4fe4-985d-75aea76e7eb2 service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:24.804807 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abe9e0-27ae-4fe4-985d-75aea76e7eb2 service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:24.805085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abe9e0-27ae-4fe4-985d-75aea76e7eb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:24.813318 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40abe9e0-27ae-4fe4-985d-75aea76e7eb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:35:24.815002 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40abe9e0-27ae-4fe4-985d-75aea76e7eb2 service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:35:24.824110 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 720/1432] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:35:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:26.162999 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6b5ff-1bcb-46df-8a69-a2f279deee32 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:26.163603 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6b5ff-1bcb-46df-8a69-a2f279deee32 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:26.163603 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6b5ff-1bcb-46df-8a69-a2f279deee32 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:26.165446 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 713/1433] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 8 16:35:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:26.170549 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f824f05-6b67-4ef8-bf9b-2802228618c2 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:26.170983 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f824f05-6b67-4ef8-bf9b-2802228618c2 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:26.171134 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f824f05-6b67-4ef8-bf9b-2802228618c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:26.190803 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-0f824f05-6b67-4ef8-bf9b-2802228618c2 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:35:26.192013 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-0f824f05-6b67-4ef8-bf9b-2802228618c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:35:26.199943 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 721/1434] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 8 16:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:35:26.360177 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6b5ff-1bcb-46df-8a69-a2f279deee32 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:35:26.375084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6b5ff-1bcb-46df-8a69-a2f279deee32 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:35:26.380721 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa4fff-01d2-463b-b3c4-405b5dad2e81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:35:26.381342 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa4fff-01d2-463b-b3c4-405b5dad2e81 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:26.381620 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa4fff-01d2-463b-b3c4-405b5dad2e81 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:26.381894 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa4fff-01d2-463b-b3c4-405b5dad2e81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:26.390242 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa4fff-01d2-463b-b3c4-405b5dad2e81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:35:26.392353 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa4fff-01d2-463b-b3c4-405b5dad2e81 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:35:26.401806 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 714/1435] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:27.731601 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daa249-cd78-45e1-89c9-57ed945a9de3 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:27.732196 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daa249-cd78-45e1-89c9-57ed945a9de3 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:27.732196 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daa249-cd78-45e1-89c9-57ed945a9de3 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:27.733955 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 722/1436] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 8 16:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:27.739745 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4695d-67e1-4b3c-a848-5c4ff24f4b21 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:27.740244 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4695d-67e1-4b3c-a848-5c4ff24f4b21 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:27.740356 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4695d-67e1-4b3c-a848-5c4ff24f4b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:27.759980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f0b4695d-67e1-4b3c-a848-5c4ff24f4b21 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:35:27.761199 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f0b4695d-67e1-4b3c-a848-5c4ff24f4b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:35:27.769469 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 715/1437] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 8 16:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:35:27.920983 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7daa249-cd78-45e1-89c9-57ed945a9de3 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:35:27.935510 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7daa249-cd78-45e1-89c9-57ed945a9de3 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:35:27.941576 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c6204-cbb9-47a0-9ed9-7ae47370708d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:35:27.942194 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c6204-cbb9-47a0-9ed9-7ae47370708d service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:27.942476 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c6204-cbb9-47a0-9ed9-7ae47370708d service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:27.942748 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c6204-cbb9-47a0-9ed9-7ae47370708d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:27.950968 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c6204-cbb9-47a0-9ed9-7ae47370708d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:35:27.952628 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c6204-cbb9-47a0-9ed9-7ae47370708d service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:35:27.962650 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 723/1438] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:35:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:29.307185 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da314770-c681-47dd-98c0-def67b62ff28 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:29.307916 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da314770-c681-47dd-98c0-def67b62ff28 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:29.307916 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da314770-c681-47dd-98c0-def67b62ff28 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:29.309600 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 716/1439] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 8 16:35:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:29.315304 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6ff08-60c1-4885-a00d-22558816f677 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:29.315713 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6ff08-60c1-4885-a00d-22558816f677 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:29.315897 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6ff08-60c1-4885-a00d-22558816f677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:29.334229 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-0dc6ff08-60c1-4885-a00d-22558816f677 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:35:29.335421 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-0dc6ff08-60c1-4885-a00d-22558816f677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:35:29.343154 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 724/1440] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 8 16:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:35:29.499148 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da314770-c681-47dd-98c0-def67b62ff28 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:35:29.513978 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da314770-c681-47dd-98c0-def67b62ff28 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:35:29.519872 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12b32f-40c4-4df9-bec2-e5559b5c7a3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:35:29.520495 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12b32f-40c4-4df9-bec2-e5559b5c7a3a service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:29.520776 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12b32f-40c4-4df9-bec2-e5559b5c7a3a service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:29.521051 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12b32f-40c4-4df9-bec2-e5559b5c7a3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:29.528986 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12b32f-40c4-4df9-bec2-e5559b5c7a3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:35:29.530568 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12b32f-40c4-4df9-bec2-e5559b5c7a3a service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:35:29.540642 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 717/1441] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:35:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:30.795472 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80823666-af6d-46b8-b9da-bb60df8b97c4 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:30.796061 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80823666-af6d-46b8-b9da-bb60df8b97c4 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:30.796061 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80823666-af6d-46b8-b9da-bb60df8b97c4 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:30.797848 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 725/1442] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 8 16:35:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:30.802949 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4467ec-d340-41c2-8717-b3b80a46b604 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:30.803375 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4467ec-d340-41c2-8717-b3b80a46b604 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:30.803523 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4467ec-d340-41c2-8717-b3b80a46b604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:30.822797 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-3a4467ec-d340-41c2-8717-b3b80a46b604 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:35:30.824019 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3a4467ec-d340-41c2-8717-b3b80a46b604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:35:30.832831 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 718/1443] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 8 16:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:35:30.985247 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80823666-af6d-46b8-b9da-bb60df8b97c4 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:35:30.999211 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80823666-af6d-46b8-b9da-bb60df8b97c4 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:35:31.005364 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291711e7-b6ee-4028-84bf-e08330f292a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:35:31.006017 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291711e7-b6ee-4028-84bf-e08330f292a9 service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:31.006303 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291711e7-b6ee-4028-84bf-e08330f292a9 service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:31.006578 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291711e7-b6ee-4028-84bf-e08330f292a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:31.014919 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291711e7-b6ee-4028-84bf-e08330f292a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:35:31.017279 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291711e7-b6ee-4028-84bf-e08330f292a9 service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:35:31.026616 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 726/1444] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:35:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:32.307198 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b9d1b-68bd-46fc-b016-f5870fc1e2ae None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:32.307739 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b9d1b-68bd-46fc-b016-f5870fc1e2ae None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:32.307739 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b9d1b-68bd-46fc-b016-f5870fc1e2ae None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:32.309547 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 719/1445] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 8 16:35:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:32.315021 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc9e5d-f840-45e4-bb4d-c049bb38b2be None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:32.315418 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc9e5d-f840-45e4-bb4d-c049bb38b2be None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:32.315572 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc9e5d-f840-45e4-bb4d-c049bb38b2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:32.334006 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-9acc9e5d-f840-45e4-bb4d-c049bb38b2be None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:35:32.335180 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-9acc9e5d-f840-45e4-bb4d-c049bb38b2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:35:32.343256 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 727/1446] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 8 16:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:35:32.500489 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b9d1b-68bd-46fc-b016-f5870fc1e2ae None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:35:32.514944 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b9d1b-68bd-46fc-b016-f5870fc1e2ae None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:35:32.520561 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d24ec5-547b-4dc3-8a73-3529a17d7e11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:35:32.521177 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d24ec5-547b-4dc3-8a73-3529a17d7e11 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:32.521455 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d24ec5-547b-4dc3-8a73-3529a17d7e11 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:32.521728 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d24ec5-547b-4dc3-8a73-3529a17d7e11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:32.529589 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d24ec5-547b-4dc3-8a73-3529a17d7e11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:35:32.531165 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d24ec5-547b-4dc3-8a73-3529a17d7e11 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:35:32.541863 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 720/1447] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:35:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:33.808568 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324bf14-9ef3-4744-ae67-9bcf05dbcd6c None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:33.809120 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324bf14-9ef3-4744-ae67-9bcf05dbcd6c None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:33.809120 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324bf14-9ef3-4744-ae67-9bcf05dbcd6c None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:33.810873 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 728/1448] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 8 16:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:33.816282 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cd905-e1d9-47bf-9634-5187b3ff32b2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:33.816708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cd905-e1d9-47bf-9634-5187b3ff32b2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:33.816835 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cd905-e1d9-47bf-9634-5187b3ff32b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:33.834956 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d20cd905-e1d9-47bf-9634-5187b3ff32b2 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:35:33.836171 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d20cd905-e1d9-47bf-9634-5187b3ff32b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:35:33.843779 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 721/1449] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 8 16:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:35:34.003871 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324bf14-9ef3-4744-ae67-9bcf05dbcd6c None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:35:34.021360 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324bf14-9ef3-4744-ae67-9bcf05dbcd6c None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:35:34.026803 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fad69-b490-4783-8784-5a72f7c435ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:35:34.027429 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fad69-b490-4783-8784-5a72f7c435ab service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:34.027712 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fad69-b490-4783-8784-5a72f7c435ab service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:34.028020 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fad69-b490-4783-8784-5a72f7c435ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:34.036357 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fad69-b490-4783-8784-5a72f7c435ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:35:34.037926 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fad69-b490-4783-8784-5a72f7c435ab service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:35:34.047107 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 729/1450] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:35:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:35.325717 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efbe3b-d162-44f9-ae6f-5d03b58f8bb3 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:35.326202 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efbe3b-d162-44f9-ae6f-5d03b58f8bb3 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:35.326297 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efbe3b-d162-44f9-ae6f-5d03b58f8bb3 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:35.328098 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 722/1451] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 8 16:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:35.333363 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0ccdd-d8f9-42cf-88c2-0bba346e802b None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:35.333798 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0ccdd-d8f9-42cf-88c2-0bba346e802b None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:35.333932 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0ccdd-d8f9-42cf-88c2-0bba346e802b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:35.352492 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-a4b0ccdd-d8f9-42cf-88c2-0bba346e802b None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:35:35.353654 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a4b0ccdd-d8f9-42cf-88c2-0bba346e802b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:35:35.361892 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 730/1452] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 8 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:35:35.512657 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efbe3b-d162-44f9-ae6f-5d03b58f8bb3 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:35:35.527658 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efbe3b-d162-44f9-ae6f-5d03b58f8bb3 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:35:35.533136 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf1e2e-44dc-42e9-bfc0-431b3a3f295f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:35:35.533781 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf1e2e-44dc-42e9-bfc0-431b3a3f295f service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:35.534061 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf1e2e-44dc-42e9-bfc0-431b3a3f295f service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:35.534335 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf1e2e-44dc-42e9-bfc0-431b3a3f295f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:35.543375 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf1e2e-44dc-42e9-bfc0-431b3a3f295f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:35:35.545014 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf1e2e-44dc-42e9-bfc0-431b3a3f295f service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:35:35.554823 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 723/1453] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:35:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:37.706006 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e79484-d737-4600-b401-0622a3e64f31 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:37.706528 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e79484-d737-4600-b401-0622a3e64f31 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:37.706528 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e79484-d737-4600-b401-0622a3e64f31 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:37.708340 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 731/1454] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 8 16:35:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:37.713798 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4959fe2-4da9-4dad-b93d-4736df0e84cb None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:37.714236 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4959fe2-4da9-4dad-b93d-4736df0e84cb None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:37.714335 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4959fe2-4da9-4dad-b93d-4736df0e84cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:37.732313 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-a4959fe2-4da9-4dad-b93d-4736df0e84cb None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:35:37.733505 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a4959fe2-4da9-4dad-b93d-4736df0e84cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:35:37.741914 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 724/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 8 16:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:35:37.780703 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e79484-d737-4600-b401-0622a3e64f31 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:35:37.791850 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e79484-d737-4600-b401-0622a3e64f31 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:35:37.795298 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac301e7-5e48-41a3-b520-a5ceae04e0c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:35:37.795952 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac301e7-5e48-41a3-b520-a5ceae04e0c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:37.796234 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac301e7-5e48-41a3-b520-a5ceae04e0c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:37.796511 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac301e7-5e48-41a3-b520-a5ceae04e0c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:37.806195 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac301e7-5e48-41a3-b520-a5ceae04e0c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:35:37.807610 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac301e7-5e48-41a3-b520-a5ceae04e0c2 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:35:37.817125 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 732/1456] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:35:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:40.305817 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0a387-07dc-4db9-8dfd-7108bbe9674d None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:40.306523 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0a387-07dc-4db9-8dfd-7108bbe9674d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:40.306523 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0a387-07dc-4db9-8dfd-7108bbe9674d None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:40.308215 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 725/1457] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 8 16:35:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:40.314537 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb9f5e-1675-4a3d-96f2-30925e2f35a8 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:40.314962 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb9f5e-1675-4a3d-96f2-30925e2f35a8 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:40.315112 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb9f5e-1675-4a3d-96f2-30925e2f35a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:40.332577 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-d7bb9f5e-1675-4a3d-96f2-30925e2f35a8 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:35:40.333821 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d7bb9f5e-1675-4a3d-96f2-30925e2f35a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:35:40.341582 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 733/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 8 16:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:35:40.380863 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0a387-07dc-4db9-8dfd-7108bbe9674d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:35:40.392095 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0a387-07dc-4db9-8dfd-7108bbe9674d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:35:40.395724 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0482d-4a46-4934-a17e-b31496d6a949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:35:40.396376 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0482d-4a46-4934-a17e-b31496d6a949 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:40.396683 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0482d-4a46-4934-a17e-b31496d6a949 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:40.396952 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0482d-4a46-4934-a17e-b31496d6a949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:40.405773 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0482d-4a46-4934-a17e-b31496d6a949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:35:40.407579 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0482d-4a46-4934-a17e-b31496d6a949 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:35:40.416787 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 726/1459] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:35:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:42.976133 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e753f08-55aa-4b52-b464-80a105a2e708 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:42.976741 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e753f08-55aa-4b52-b464-80a105a2e708 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:42.976741 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e753f08-55aa-4b52-b464-80a105a2e708 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:42.978488 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 734/1460] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 8 16:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:42.983866 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bab256-623f-485e-945c-3ff725f02104 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:42.984341 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bab256-623f-485e-945c-3ff725f02104 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:42.984447 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bab256-623f-485e-945c-3ff725f02104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:43.002421 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-34bab256-623f-485e-945c-3ff725f02104 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:35:43.003629 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-34bab256-623f-485e-945c-3ff725f02104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:35:43.011233 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 727/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 8 16:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:35:43.052217 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e753f08-55aa-4b52-b464-80a105a2e708 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:35:43.062854 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e753f08-55aa-4b52-b464-80a105a2e708 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:35:43.066453 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8dc24-4b6b-4c1b-a104-1f407fcafd72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:35:43.067076 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8dc24-4b6b-4c1b-a104-1f407fcafd72 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:43.067357 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8dc24-4b6b-4c1b-a104-1f407fcafd72 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:43.067631 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8dc24-4b6b-4c1b-a104-1f407fcafd72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:43.076399 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8dc24-4b6b-4c1b-a104-1f407fcafd72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:35:43.077801 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8dc24-4b6b-4c1b-a104-1f407fcafd72 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:35:43.087592 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 735/1462] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:45.543413 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7de3a-1344-4f35-9760-8235f2315ff5 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:45.544016 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7de3a-1344-4f35-9760-8235f2315ff5 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:45.544016 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7de3a-1344-4f35-9760-8235f2315ff5 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:45.545814 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 728/1463] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 8 16:35:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:45.551330 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62210191-e821-4b71-b892-76a1d61ca86b None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:45.551743 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62210191-e821-4b71-b892-76a1d61ca86b None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:45.551914 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62210191-e821-4b71-b892-76a1d61ca86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:45.569567 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-62210191-e821-4b71-b892-76a1d61ca86b None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:35:45.570678 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-62210191-e821-4b71-b892-76a1d61ca86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:35:45.579496 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 736/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 8 16:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:35:45.619537 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7de3a-1344-4f35-9760-8235f2315ff5 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:35:45.630493 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7de3a-1344-4f35-9760-8235f2315ff5 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:35:45.633962 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f375571-1239-4258-af73-dbb23f910a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:35:45.634580 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f375571-1239-4258-af73-dbb23f910a21 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:45.634860 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f375571-1239-4258-af73-dbb23f910a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:45.635135 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f375571-1239-4258-af73-dbb23f910a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:45.645033 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f375571-1239-4258-af73-dbb23f910a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:35:45.646450 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f375571-1239-4258-af73-dbb23f910a21 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:35:45.655999 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 729/1465] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:35:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:47.951781 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316478c6-d114-4de4-9cbd-da3c08f9532a None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:47.952328 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316478c6-d114-4de4-9cbd-da3c08f9532a None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:47.952446 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316478c6-d114-4de4-9cbd-da3c08f9532a None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:47.954399 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 737/1466] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 8 16:35:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:47.959805 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b87ecb-95b2-49fb-937c-77158dfaf792 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:47.960281 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b87ecb-95b2-49fb-937c-77158dfaf792 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:47.960392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b87ecb-95b2-49fb-937c-77158dfaf792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:47.978231 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d4b87ecb-95b2-49fb-937c-77158dfaf792 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:35:47.979408 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d4b87ecb-95b2-49fb-937c-77158dfaf792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:35:47.987812 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 730/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 8 16:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:35:48.026222 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316478c6-d114-4de4-9cbd-da3c08f9532a None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:35:48.037312 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316478c6-d114-4de4-9cbd-da3c08f9532a None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:35:48.040824 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bc12c-f3cf-4efb-9360-5108a2379a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:35:48.041448 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bc12c-f3cf-4efb-9360-5108a2379a34 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:48.041726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bc12c-f3cf-4efb-9360-5108a2379a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:48.041996 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bc12c-f3cf-4efb-9360-5108a2379a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:48.051456 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5bc12c-f3cf-4efb-9360-5108a2379a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:35:48.052938 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5bc12c-f3cf-4efb-9360-5108a2379a34 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:35:48.062069 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 738/1468] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:35:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:50.421027 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159fd9d-4cc0-4124-8141-896d070f0fc3 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:50.421594 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159fd9d-4cc0-4124-8141-896d070f0fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:50.421594 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159fd9d-4cc0-4124-8141-896d070f0fc3 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:50.423499 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 731/1469] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 8 16:35:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:50.429340 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5a47f-a807-48bb-9ac4-114673f244a6 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:50.429805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5a47f-a807-48bb-9ac4-114673f244a6 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:50.429902 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5a47f-a807-48bb-9ac4-114673f244a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:50.448125 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-bbc5a47f-a807-48bb-9ac4-114673f244a6 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:35:50.449319 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-bbc5a47f-a807-48bb-9ac4-114673f244a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:35:50.457894 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 739/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 8 16:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:35:50.497111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159fd9d-4cc0-4124-8141-896d070f0fc3 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:35:50.507372 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159fd9d-4cc0-4124-8141-896d070f0fc3 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:35:50.510801 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20689a69-736e-40b1-9b59-80aa466355f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:35:50.511407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20689a69-736e-40b1-9b59-80aa466355f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:50.511966 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20689a69-736e-40b1-9b59-80aa466355f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:50.512239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20689a69-736e-40b1-9b59-80aa466355f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:50.520764 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20689a69-736e-40b1-9b59-80aa466355f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:35:50.522175 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20689a69-736e-40b1-9b59-80aa466355f6 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:35:50.531704 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 732/1471] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:52.837441 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f51e72-7900-415c-a8c3-46bc793b96cb None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:52.837999 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f51e72-7900-415c-a8c3-46bc793b96cb None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:52.837999 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f51e72-7900-415c-a8c3-46bc793b96cb None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:52.839831 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 740/1472] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 8 16:35:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:52.845756 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436ef12-24ce-4db6-8a17-79c2d0db1997 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:52.846209 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436ef12-24ce-4db6-8a17-79c2d0db1997 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:52.846328 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436ef12-24ce-4db6-8a17-79c2d0db1997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:52.863820 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-6436ef12-24ce-4db6-8a17-79c2d0db1997 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:35:52.865043 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6436ef12-24ce-4db6-8a17-79c2d0db1997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:35:52.872872 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 733/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 8 16:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:35:52.911369 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f51e72-7900-415c-a8c3-46bc793b96cb None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:35:52.922138 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f51e72-7900-415c-a8c3-46bc793b96cb None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:35:52.925601 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ab646-5d31-4157-814a-c77840b0a869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:35:52.926220 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ab646-5d31-4157-814a-c77840b0a869 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:52.926496 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ab646-5d31-4157-814a-c77840b0a869 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:52.926762 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ab646-5d31-4157-814a-c77840b0a869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:52.935416 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ab646-5d31-4157-814a-c77840b0a869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:35:52.936854 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ab646-5d31-4157-814a-c77840b0a869 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:35:52.946595 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 741/1474] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:35:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:55.245058 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559a783-3e64-43e9-85c2-64bb4eb37f88 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:55.245627 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559a783-3e64-43e9-85c2-64bb4eb37f88 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:55.245627 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559a783-3e64-43e9-85c2-64bb4eb37f88 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:55.247367 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 734/1475] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 8 16:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:55.253576 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc3d55-0f26-4862-8447-0f7354695a88 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:55.254011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc3d55-0f26-4862-8447-0f7354695a88 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:55.254284 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc3d55-0f26-4862-8447-0f7354695a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:55.272294 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-a3fc3d55-0f26-4862-8447-0f7354695a88 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:35:55.273464 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a3fc3d55-0f26-4862-8447-0f7354695a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:35:55.281353 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 742/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 8 16:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:35:55.319196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559a783-3e64-43e9-85c2-64bb4eb37f88 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:35:55.329731 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559a783-3e64-43e9-85c2-64bb4eb37f88 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:35:55.337103 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5897c1-b0a6-4f11-a616-a94eb3517d0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:35:55.337738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5897c1-b0a6-4f11-a616-a94eb3517d0f service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:55.338020 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5897c1-b0a6-4f11-a616-a94eb3517d0f service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:55.338295 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5897c1-b0a6-4f11-a616-a94eb3517d0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:55.347782 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5897c1-b0a6-4f11-a616-a94eb3517d0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:35:55.349318 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5897c1-b0a6-4f11-a616-a94eb3517d0f service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:35:55.358928 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 735/1477] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:57.603290 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee24e6-a97a-405b-a7d7-7da8e0587dfb None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:57.603856 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee24e6-a97a-405b-a7d7-7da8e0587dfb None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:57.603856 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee24e6-a97a-405b-a7d7-7da8e0587dfb None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:57.605601 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 743/1478] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 8 16:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:57.611528 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f680862-e727-4f7e-aae4-48d797b7aae0 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:57.611994 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f680862-e727-4f7e-aae4-48d797b7aae0 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:57.612125 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f680862-e727-4f7e-aae4-48d797b7aae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:57.629783 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-3f680862-e727-4f7e-aae4-48d797b7aae0 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:35:57.630974 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3f680862-e727-4f7e-aae4-48d797b7aae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:35:57.639385 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 736/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 8 16:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:35:57.678011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee24e6-a97a-405b-a7d7-7da8e0587dfb None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:35:57.689734 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee24e6-a97a-405b-a7d7-7da8e0587dfb None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:35:57.693244 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5554d-4cf9-456b-a3d6-4574773740d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:35:57.693860 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5554d-4cf9-456b-a3d6-4574773740d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:57.694141 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5554d-4cf9-456b-a3d6-4574773740d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:57.694415 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5554d-4cf9-456b-a3d6-4574773740d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:57.703884 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5554d-4cf9-456b-a3d6-4574773740d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:35:57.705424 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5554d-4cf9-456b-a3d6-4574773740d2 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:35:57.714584 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 744/1480] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:35:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:59.976078 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb323a7-67dd-4010-aea5-9fd346916233 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:59.976696 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb323a7-67dd-4010-aea5-9fd346916233 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:59.976696 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb323a7-67dd-4010-aea5-9fd346916233 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:35:59.978412 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 737/1481] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 8 16:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:35:59.983763 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d377733-2915-4325-9b43-03302736da47 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:35:59.984869 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d377733-2915-4325-9b43-03302736da47 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:35:59.985160 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d377733-2915-4325-9b43-03302736da47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:00.002882 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-2d377733-2915-4325-9b43-03302736da47 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:36:00.004103 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-2d377733-2915-4325-9b43-03302736da47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:36:00.012116 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 745/1482] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 8 16:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:36:00.049468 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb323a7-67dd-4010-aea5-9fd346916233 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:36:00.059894 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb323a7-67dd-4010-aea5-9fd346916233 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:36:00.063410 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae888f35-d024-404c-9969-415f91b351fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:36:00.064067 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae888f35-d024-404c-9969-415f91b351fd service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:00.064349 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae888f35-d024-404c-9969-415f91b351fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:00.064627 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae888f35-d024-404c-9969-415f91b351fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:00.073245 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae888f35-d024-404c-9969-415f91b351fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:36:00.074673 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae888f35-d024-404c-9969-415f91b351fd service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:36:00.084026 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 738/1483] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:36:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:36:17.226484 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be288db-1e78-410b-aaeb-2601fb48055a None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:17.227111 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be288db-1e78-410b-aaeb-2601fb48055a None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:17.227111 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be288db-1e78-410b-aaeb-2601fb48055a None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:17.228836 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 746/1484] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:36:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:36:17.234751 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571ecee-f055-4da6-b50f-74e831bafcc9 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:17.235190 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571ecee-f055-4da6-b50f-74e831bafcc9 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:17.235291 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571ecee-f055-4da6-b50f-74e831bafcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:17.252811 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f571ecee-f055-4da6-b50f-74e831bafcc9 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:36:17.253996 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f571ecee-f055-4da6-b50f-74e831bafcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:36:17.261989 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 739/1485] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:36:17.309250 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f49af9-b9d1-4c6e-8dd6-87c03dbb6e4f None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:17.309539 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f49af9-b9d1-4c6e-8dd6-87c03dbb6e4f None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:17.309815 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f49af9-b9d1-4c6e-8dd6-87c03dbb6e4f None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:17.311595 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 747/1486] 10.222.0.35 () {54 vars in 962 bytes} [Tue Feb 8 16:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:36:17.316765 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f862ab-5902-4a4d-bd83-b575d50022bb None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:17.317093 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f862ab-5902-4a4d-bd83-b575d50022bb None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:17.317373 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f862ab-5902-4a4d-bd83-b575d50022bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:17.335773 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f3f862ab-5902-4a4d-bd83-b575d50022bb None None] MFA Rules not processed for user `10453496872a45a9867fc6a13a13de49`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:36:17.336976 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f3f862ab-5902-4a4d-bd83-b575d50022bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:36:17.344315 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 740/1487] 10.222.0.35 () {58 vars in 1059 bytes} [Tue Feb 8 16:36:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:36:17.351727 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f49af9-b9d1-4c6e-8dd6-87c03dbb6e4f None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:36:17.362913 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f49af9-b9d1-4c6e-8dd6-87c03dbb6e4f None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:36:17.366558 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcc184-9dab-4022-9e2c-6d17ec6e6cd7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10453496872a45a9867fc6a13a13de49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:36:17.367178 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcc184-9dab-4022-9e2c-6d17ec6e6cd7 service glance] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:17.367619 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcc184-9dab-4022-9e2c-6d17ec6e6cd7 service glance] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:17.367938 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcc184-9dab-4022-9e2c-6d17ec6e6cd7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:17.376948 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcc184-9dab-4022-9e2c-6d17ec6e6cd7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:36:17.378361 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcc184-9dab-4022-9e2c-6d17ec6e6cd7 service glance] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:36:17.388303 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 748/1488] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:36:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:36:19.732762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384be88c-a852-4972-a2fa-30996961bf4b None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:19.733445 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384be88c-a852-4972-a2fa-30996961bf4b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:19.733445 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384be88c-a852-4972-a2fa-30996961bf4b None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:19.735170 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 741/1489] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:36:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:36:19.740560 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556afd41-3bcd-495c-b4b6-52eb394c4930 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:19.741028 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556afd41-3bcd-495c-b4b6-52eb394c4930 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:19.741134 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556afd41-3bcd-495c-b4b6-52eb394c4930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:19.759193 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-556afd41-3bcd-495c-b4b6-52eb394c4930 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:36:19.760409 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-556afd41-3bcd-495c-b4b6-52eb394c4930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:36:19.769341 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 749/1490] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:36:19.792862 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384be88c-a852-4972-a2fa-30996961bf4b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:36:19.805446 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384be88c-a852-4972-a2fa-30996961bf4b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:36:19.809897 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e06928-f4f4-4737-b793-ec4c6ed3e2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:36:19.810523 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e06928-f4f4-4737-b793-ec4c6ed3e2cf admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:19.810800 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e06928-f4f4-4737-b793-ec4c6ed3e2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:19.811071 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e06928-f4f4-4737-b793-ec4c6ed3e2cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:19.812418 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e06928-f4f4-4737-b793-ec4c6ed3e2cf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:36:19.814237 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e06928-f4f4-4737-b793-ec4c6ed3e2cf admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:36:19.827641 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 742/1491] 10.222.0.35 () {56 vars in 1108 bytes} [Tue Feb 8 16:36:19 2022] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:36:22.103717 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be32553-cb0b-44ad-a29a-188d20364bfa None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:22.104353 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be32553-cb0b-44ad-a29a-188d20364bfa None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:22.104353 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be32553-cb0b-44ad-a29a-188d20364bfa None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:22.106099 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 750/1492] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:36:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:36:22.111483 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec029ea-750e-48d7-b751-2f1d6c8f6bfb None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:22.111993 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec029ea-750e-48d7-b751-2f1d6c8f6bfb None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:22.112098 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec029ea-750e-48d7-b751-2f1d6c8f6bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:22.130062 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-8ec029ea-750e-48d7-b751-2f1d6c8f6bfb None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:36:22.131249 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-8ec029ea-750e-48d7-b751-2f1d6c8f6bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:36:22.140624 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 743/1493] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:36:22.183693 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be32553-cb0b-44ad-a29a-188d20364bfa None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:36:22.197723 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be32553-cb0b-44ad-a29a-188d20364bfa None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:36:22.203636 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e49be-69cf-44e5-9855-4812d1e48512 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:36:22.204348 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e49be-69cf-44e5-9855-4812d1e48512 service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:22.204627 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e49be-69cf-44e5-9855-4812d1e48512 service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:22.204897 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e49be-69cf-44e5-9855-4812d1e48512 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:22.212778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e49be-69cf-44e5-9855-4812d1e48512 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:36:22.214324 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e49be-69cf-44e5-9855-4812d1e48512 service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:36:22.224050 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 751/1494] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:36:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:36:24.604773 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0190cd-b492-4a5d-aae9-68593e209815 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:24.605308 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0190cd-b492-4a5d-aae9-68593e209815 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:24.605308 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0190cd-b492-4a5d-aae9-68593e209815 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:24.606988 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 744/1495] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:36:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:36:24.612546 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d97268-5c00-4603-b32b-3b6057c09f3d None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:24.612959 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d97268-5c00-4603-b32b-3b6057c09f3d None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:24.613108 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d97268-5c00-4603-b32b-3b6057c09f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:24.630759 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-03d97268-5c00-4603-b32b-3b6057c09f3d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:36:24.631986 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-03d97268-5c00-4603-b32b-3b6057c09f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:36:24.640903 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 752/1496] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:36:24.678051 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0190cd-b492-4a5d-aae9-68593e209815 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:36:24.688888 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0190cd-b492-4a5d-aae9-68593e209815 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:36:24.692307 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f2c30-a107-4fc0-ad85-8d787c8c5651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:36:24.693201 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f2c30-a107-4fc0-ad85-8d787c8c5651 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:24.693470 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f2c30-a107-4fc0-ad85-8d787c8c5651 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:24.693737 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f2c30-a107-4fc0-ad85-8d787c8c5651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:24.703526 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f2c30-a107-4fc0-ad85-8d787c8c5651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:36:24.704992 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f2c30-a107-4fc0-ad85-8d787c8c5651 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:36:24.714306 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 745/1497] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:36:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:36:27.005337 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d762d-d52f-4515-ae2d-9a08229a26bd None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:27.005933 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d762d-d52f-4515-ae2d-9a08229a26bd None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:27.005933 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d762d-d52f-4515-ae2d-9a08229a26bd None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:27.007653 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 753/1498] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:36:27.013138 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c718d3-4032-42e5-bb54-08c117f93d0b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:27.013558 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c718d3-4032-42e5-bb54-08c117f93d0b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:27.013691 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c718d3-4032-42e5-bb54-08c117f93d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:27.032006 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-61c718d3-4032-42e5-bb54-08c117f93d0b None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:36:27.033188 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-61c718d3-4032-42e5-bb54-08c117f93d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:36:27.041359 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 746/1499] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:36:27.079471 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d762d-d52f-4515-ae2d-9a08229a26bd None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:36:27.089941 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d762d-d52f-4515-ae2d-9a08229a26bd None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:36:27.094315 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580dde8-6c03-439a-9003-e2885d05a5eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:36:27.094934 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580dde8-6c03-439a-9003-e2885d05a5eb service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:27.095215 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580dde8-6c03-439a-9003-e2885d05a5eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:27.095490 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580dde8-6c03-439a-9003-e2885d05a5eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:27.104242 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580dde8-6c03-439a-9003-e2885d05a5eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:36:27.105718 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580dde8-6c03-439a-9003-e2885d05a5eb service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:36:27.115672 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 754/1500] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:36:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:36:29.597872 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d37963-6d5d-4a65-82e4-c2942eb2984f None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:29.598433 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d37963-6d5d-4a65-82e4-c2942eb2984f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:29.598433 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d37963-6d5d-4a65-82e4-c2942eb2984f None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:29.600221 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 747/1501] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:36:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:36:29.605512 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5491b58-e468-4166-993c-e22931c7d8d5 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:29.605941 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5491b58-e468-4166-993c-e22931c7d8d5 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:29.606051 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5491b58-e468-4166-993c-e22931c7d8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:29.623986 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-e5491b58-e468-4166-993c-e22931c7d8d5 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:36:29.625249 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-e5491b58-e468-4166-993c-e22931c7d8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:36:29.632919 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 755/1502] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:36:29.669866 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d37963-6d5d-4a65-82e4-c2942eb2984f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:36:29.682586 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d37963-6d5d-4a65-82e4-c2942eb2984f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:36:29.687051 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d1e6f-9c09-452b-9900-902e5e243d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:36:29.687914 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d1e6f-9c09-452b-9900-902e5e243d3b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:29.688223 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d1e6f-9c09-452b-9900-902e5e243d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:29.688529 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d1e6f-9c09-452b-9900-902e5e243d3b admin admin] PATH_INFO: `/v3/projects/2b5e4fc6dd694372b7f8775a6f881cca` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:29.689721 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d1e6f-9c09-452b-9900-902e5e243d3b admin admin] RBAC: Authorizing `identity:get_project(project_id=2b5e4fc6dd694372b7f8775a6f881cca)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:36:29.691506 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d1e6f-9c09-452b-9900-902e5e243d3b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:36:29.693259 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 748/1503] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:36:29 2022] GET /identity/v3/projects/2b5e4fc6dd694372b7f8775a6f881cca => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:36:29.705364 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5491b58-e468-4166-993c-e22931c7d8d5 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:36:29.714565 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5491b58-e468-4166-993c-e22931c7d8d5 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:36:29.719104 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304c72c-4060-411c-90b7-fa88aaee9633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:36:29.719741 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304c72c-4060-411c-90b7-fa88aaee9633 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:29.720058 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304c72c-4060-411c-90b7-fa88aaee9633 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:29.720335 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304c72c-4060-411c-90b7-fa88aaee9633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:29.729167 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304c72c-4060-411c-90b7-fa88aaee9633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:36:29.730570 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304c72c-4060-411c-90b7-fa88aaee9633 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:36:29.739956 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 756/1504] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:36:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:36:32.197532 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994bb8d-fe8b-423e-9601-2b9a690bab9d None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:32.198072 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994bb8d-fe8b-423e-9601-2b9a690bab9d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:32.198072 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994bb8d-fe8b-423e-9601-2b9a690bab9d None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:32.199858 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 749/1505] 10.222.0.35 () {54 vars in 926 bytes} [Tue Feb 8 16:36:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:36:32.205641 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa0899-9b52-4b2f-86e9-1305bb59f139 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:32.206124 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa0899-9b52-4b2f-86e9-1305bb59f139 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:32.206233 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa0899-9b52-4b2f-86e9-1305bb59f139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:32.225028 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-5afa0899-9b52-4b2f-86e9-1305bb59f139 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:36:32.226236 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5afa0899-9b52-4b2f-86e9-1305bb59f139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:36:32.234559 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 757/1506] 10.222.0.35 () {58 vars in 1023 bytes} [Tue Feb 8 16:36:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:36:32.270685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994bb8d-fe8b-423e-9601-2b9a690bab9d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:36:32.284479 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994bb8d-fe8b-423e-9601-2b9a690bab9d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:36:32.288953 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77346e6c-face-480d-8b41-97947d8dab3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:36:32.289791 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77346e6c-face-480d-8b41-97947d8dab3b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:32.290080 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77346e6c-face-480d-8b41-97947d8dab3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:32.290356 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77346e6c-face-480d-8b41-97947d8dab3b admin admin] PATH_INFO: `/v3/projects/2b5e4fc6dd694372b7f8775a6f881cca` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:32.291556 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77346e6c-face-480d-8b41-97947d8dab3b admin admin] RBAC: Authorizing `identity:get_project(project_id=2b5e4fc6dd694372b7f8775a6f881cca)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:36:32.293388 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77346e6c-face-480d-8b41-97947d8dab3b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:36:32.295069 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 750/1507] 10.222.0.35 () {56 vars in 1207 bytes} [Tue Feb 8 16:36:32 2022] GET /identity/v3/projects/2b5e4fc6dd694372b7f8775a6f881cca => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:36:32.306807 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa0899-9b52-4b2f-86e9-1305bb59f139 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:36:32.316953 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa0899-9b52-4b2f-86e9-1305bb59f139 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:36:32.320489 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef84894-1414-4e2b-b279-154f1b7f7afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:36:32.321122 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef84894-1414-4e2b-b279-154f1b7f7afc service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:36:32.321408 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef84894-1414-4e2b-b279-154f1b7f7afc service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:36:32.321684 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef84894-1414-4e2b-b279-154f1b7f7afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:36:32.331891 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef84894-1414-4e2b-b279-154f1b7f7afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:36:32.333316 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef84894-1414-4e2b-b279-154f1b7f7afc service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:36:32.342873 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 758/1508] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:36:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:37:55.623424 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a8587-d65e-457d-8274-7dd55f23a8fc None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:37:55.624038 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a8587-d65e-457d-8274-7dd55f23a8fc None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:37:55.624038 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a8587-d65e-457d-8274-7dd55f23a8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:37:55.642944 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-922a8587-d65e-457d-8274-7dd55f23a8fc None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:37:55.644348 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-922a8587-d65e-457d-8274-7dd55f23a8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:37:55.653329 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 751/1509] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:37:55.661835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574333ea-c0db-4676-94c8-1a8d5ae47456 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:37:55.662366 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574333ea-c0db-4676-94c8-1a8d5ae47456 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:37:55.662366 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574333ea-c0db-4676-94c8-1a8d5ae47456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:37:55.680785 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-574333ea-c0db-4676-94c8-1a8d5ae47456 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:37:55.682005 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-574333ea-c0db-4676-94c8-1a8d5ae47456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:37:55.690047 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 759/1510] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:37:55.694684 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a8587-d65e-457d-8274-7dd55f23a8fc None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:37:55.704234 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a8587-d65e-457d-8274-7dd55f23a8fc None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:37:55.708889 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631ed12-b3d5-47e8-bd5d-39accf44dd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:37:55.709514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631ed12-b3d5-47e8-bd5d-39accf44dd03 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:37:55.709793 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631ed12-b3d5-47e8-bd5d-39accf44dd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:37:55.710068 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631ed12-b3d5-47e8-bd5d-39accf44dd03 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:37:55.710800 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631ed12-b3d5-47e8-bd5d-39accf44dd03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:37:55.711130 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631ed12-b3d5-47e8-bd5d-39accf44dd03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:37:55.712756 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631ed12-b3d5-47e8-bd5d-39accf44dd03 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:37:55.725141 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 752/1511] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:37:55.733709 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574333ea-c0db-4676-94c8-1a8d5ae47456 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:37:55.743276 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574333ea-c0db-4676-94c8-1a8d5ae47456 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:37:55.748017 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24db89a-a412-470c-acb0-a96549578446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:37:55.748655 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24db89a-a412-470c-acb0-a96549578446 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:37:55.748932 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24db89a-a412-470c-acb0-a96549578446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:37:55.749204 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24db89a-a412-470c-acb0-a96549578446 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:37:55.749922 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24db89a-a412-470c-acb0-a96549578446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:37:55.751938 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24db89a-a412-470c-acb0-a96549578446 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:37:55.787261 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 760/1512] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:37:55 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:37:55.791575 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631ed12-b3d5-47e8-bd5d-39accf44dd03 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:37:55.801426 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631ed12-b3d5-47e8-bd5d-39accf44dd03 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:37:55.856843 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78cda8-4a63-489c-8d53-cbce9127a35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:37:55.857505 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78cda8-4a63-489c-8d53-cbce9127a35d admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:37:55.857784 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78cda8-4a63-489c-8d53-cbce9127a35d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:37:55.858051 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78cda8-4a63-489c-8d53-cbce9127a35d admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:37:55.858743 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78cda8-4a63-489c-8d53-cbce9127a35d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:37:55.860733 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78cda8-4a63-489c-8d53-cbce9127a35d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:37:55.884177 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 753/1513] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:37:55 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:37:55.889220 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24db89a-a412-470c-acb0-a96549578446 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:37:55.899622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24db89a-a412-470c-acb0-a96549578446 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:37:55.904890 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c660a-815e-4258-8cca-82767ccaf470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:37:55.905539 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c660a-815e-4258-8cca-82767ccaf470 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:37:55.905821 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c660a-815e-4258-8cca-82767ccaf470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:37:55.906089 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c660a-815e-4258-8cca-82767ccaf470 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:37:55.906818 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c660a-815e-4258-8cca-82767ccaf470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:37:55.908437 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c660a-815e-4258-8cca-82767ccaf470 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:37:55.921559 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 761/1514] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:37:55.925600 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78cda8-4a63-489c-8d53-cbce9127a35d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:37:55.935979 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78cda8-4a63-489c-8d53-cbce9127a35d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:37:55.940545 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025abdd-4105-4289-8127-20dd5aa62e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:37:55.941189 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025abdd-4105-4289-8127-20dd5aa62e03 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:37:55.941463 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025abdd-4105-4289-8127-20dd5aa62e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:37:55.941735 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025abdd-4105-4289-8127-20dd5aa62e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:37:55.942459 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025abdd-4105-4289-8127-20dd5aa62e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:37:55.944079 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025abdd-4105-4289-8127-20dd5aa62e03 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:37:55.957401 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 754/1515] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:37:55.961670 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c660a-815e-4258-8cca-82767ccaf470 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:37:55.971775 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c660a-815e-4258-8cca-82767ccaf470 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:37:55.976348 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6441e-3e02-463c-a8db-88981875834e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:37:55.977259 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6441e-3e02-463c-a8db-88981875834e admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:37:55.977690 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6441e-3e02-463c-a8db-88981875834e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:37:55.977854 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6441e-3e02-463c-a8db-88981875834e admin admin] PATH_INFO: `/v3/projects/9639c1ba94e946b480172e3716b18059/users/08b91045525e4a0392cdd8043cf5a0c0/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:37:55.993504 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6441e-3e02-463c-a8db-88981875834e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9639c1ba94e946b480172e3716b18059, user_id=08b91045525e4a0392cdd8043cf5a0c0, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:37:55.996746 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6441e-3e02-463c-a8db-88981875834e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:37:56.010261 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 762/1516] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:37:55 2022] PUT /identity/v3/projects/9639c1ba94e946b480172e3716b18059/users/08b91045525e4a0392cdd8043cf5a0c0/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:37:56.023035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ca4e0-6e06-4db9-a0ff-c6ef205417d2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:37:56.023344 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ca4e0-6e06-4db9-a0ff-c6ef205417d2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:37:56.023621 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ca4e0-6e06-4db9-a0ff-c6ef205417d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:37:56.049795 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c65ca4e0-6e06-4db9-a0ff-c6ef205417d2 None None] MFA Rules not processed for user `08b91045525e4a0392cdd8043cf5a0c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:37:56.050980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c65ca4e0-6e06-4db9-a0ff-c6ef205417d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:37:56.112583 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 755/1517] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:37:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:37:56.124476 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6441e-3e02-463c-a8db-88981875834e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:37:56.192163 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6441e-3e02-463c-a8db-88981875834e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:37:56.197444 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750b422-75c3-4618-9d65-4e345776eef2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:37:56.198085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750b422-75c3-4618-9d65-4e345776eef2 service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:37:56.198362 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750b422-75c3-4618-9d65-4e345776eef2 service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:37:56.198634 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750b422-75c3-4618-9d65-4e345776eef2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:37:56.206931 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750b422-75c3-4618-9d65-4e345776eef2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:37:56.208529 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750b422-75c3-4618-9d65-4e345776eef2 service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:37:56.217725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 763/1518] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:37:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:37:56.287874 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0cc28-8697-4b11-89fe-7357d74c20b7 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:37:56.288181 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0cc28-8697-4b11-89fe-7357d74c20b7 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:37:56.288446 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0cc28-8697-4b11-89fe-7357d74c20b7 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:37:56.290139 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 756/1519] 10.222.0.35 () {52 vars in 829 bytes} [Tue Feb 8 16:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:37:56.294469 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750b422-75c3-4618-9d65-4e345776eef2 service nova] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:37:56.354692 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750b422-75c3-4618-9d65-4e345776eef2 service nova] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:37:56.359736 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bd82a-c3ce-4cf4-a84a-47140480a100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:37:56.360622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bd82a-c3ce-4cf4-a84a-47140480a100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:37:56.360899 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bd82a-c3ce-4cf4-a84a-47140480a100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:37:56.361173 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bd82a-c3ce-4cf4-a84a-47140480a100 admin admin] PATH_INFO: `/v3/users/08b91045525e4a0392cdd8043cf5a0c0` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:37:56.362383 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bd82a-c3ce-4cf4-a84a-47140480a100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08b91045525e4a0392cdd8043cf5a0c0)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:37:56.363401 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING py.warnings [None req-db4bd82a-c3ce-4cf4-a84a-47140480a100 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:37:56.363401 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: warnings.warn(msg) Feb 08 16:37:56.363401 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: Feb 08 16:37:56.364665 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bd82a-c3ce-4cf4-a84a-47140480a100 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:37:56.429550 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-db4bd82a-c3ce-4cf4-a84a-47140480a100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08b91045525e4a0392cdd8043cf5a0c0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:37:56.448658 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-db4bd82a-c3ce-4cf4-a84a-47140480a100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08b91045525e4a0392cdd8043cf5a0c0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:37:56.460433 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-db4bd82a-c3ce-4cf4-a84a-47140480a100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08b91045525e4a0392cdd8043cf5a0c0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:37:56.470144 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-db4bd82a-c3ce-4cf4-a84a-47140480a100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08b91045525e4a0392cdd8043cf5a0c0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:37:56.470840 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-db4bd82a-c3ce-4cf4-a84a-47140480a100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08b91045525e4a0392cdd8043cf5a0c0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:37:56.477116 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 764/1520] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:37:56 2022] DELETE /identity/v3/users/08b91045525e4a0392cdd8043cf5a0c0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:37:56.482149 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b48ca-c711-4af7-86d6-3a01eb1ea141 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:37:56.482436 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b48ca-c711-4af7-86d6-3a01eb1ea141 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:37:56.482710 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b48ca-c711-4af7-86d6-3a01eb1ea141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:37:56.500144 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-326b48ca-c711-4af7-86d6-3a01eb1ea141 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:37:56.501326 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-326b48ca-c711-4af7-86d6-3a01eb1ea141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:37:56.559083 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 757/1521] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:37:56.569731 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bd82a-c3ce-4cf4-a84a-47140480a100 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:37:56.572111 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-db4bd82a-c3ce-4cf4-a84a-47140480a100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:37:56.654486 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bd82a-c3ce-4cf4-a84a-47140480a100 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:37:56.658383 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf671d0-77cd-4217-843d-8b2ffb34df74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:37:56.659014 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf671d0-77cd-4217-843d-8b2ffb34df74 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:37:56.659291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf671d0-77cd-4217-843d-8b2ffb34df74 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:37:56.659563 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf671d0-77cd-4217-843d-8b2ffb34df74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:37:56.668816 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf671d0-77cd-4217-843d-8b2ffb34df74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:37:56.670228 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf671d0-77cd-4217-843d-8b2ffb34df74 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:37:56.679281 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 765/1522] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:37:57.023557 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b48ca-c711-4af7-86d6-3a01eb1ea141 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:37:57.025086 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-326b48ca-c711-4af7-86d6-3a01eb1ea141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:37:57.047422 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b48ca-c711-4af7-86d6-3a01eb1ea141 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:37:57.052199 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d818f76-3108-49e7-8150-ddf3c935e25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:37:57.053260 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d818f76-3108-49e7-8150-ddf3c935e25d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:37:57.053629 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d818f76-3108-49e7-8150-ddf3c935e25d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:37:57.054012 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d818f76-3108-49e7-8150-ddf3c935e25d admin admin] PATH_INFO: `/v3/projects/9639c1ba94e946b480172e3716b18059` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:37:57.055314 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d818f76-3108-49e7-8150-ddf3c935e25d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9639c1ba94e946b480172e3716b18059)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:37:57.056448 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-4d818f76-3108-49e7-8150-ddf3c935e25d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:37:57.056448 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Feb 08 16:37:57.056448 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: Feb 08 16:37:57.057791 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d818f76-3108-49e7-8150-ddf3c935e25d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:37:57.117123 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4d818f76-3108-49e7-8150-ddf3c935e25d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9639c1ba94e946b480172e3716b18059', 'request_id': 'req-4d818f76-3108-49e7-8150-ddf3c935e25d'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:37:57.130952 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4d818f76-3108-49e7-8150-ddf3c935e25d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9639c1ba94e946b480172e3716b18059', 'request_id': 'req-4d818f76-3108-49e7-8150-ddf3c935e25d'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:37:57.138107 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4d818f76-3108-49e7-8150-ddf3c935e25d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9639c1ba94e946b480172e3716b18059', 'request_id': 'req-4d818f76-3108-49e7-8150-ddf3c935e25d'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:37:57.153006 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4d818f76-3108-49e7-8150-ddf3c935e25d admin admin] The token cache is being invalidate because project 9639c1ba94e946b480172e3716b18059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:37:57.153295 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4d818f76-3108-49e7-8150-ddf3c935e25d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:37:57.154005 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4d818f76-3108-49e7-8150-ddf3c935e25d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:37:57.155543 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 758/1523] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:37:57 2022] DELETE /identity/v3/projects/9639c1ba94e946b480172e3716b18059 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:39:32.700659 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20af416-acda-4823-9255-494737d898d2 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:32.701557 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20af416-acda-4823-9255-494737d898d2 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:32.701734 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20af416-acda-4823-9255-494737d898d2 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:32.703614 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 766/1524] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 8 16:39:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:39:32.708606 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370a8b7-4a69-44ce-903f-390e4d38536f None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:32.709044 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370a8b7-4a69-44ce-903f-390e4d38536f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:32.709149 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370a8b7-4a69-44ce-903f-390e4d38536f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:32.727745 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c370a8b7-4a69-44ce-903f-390e4d38536f None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:39:32.728958 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c370a8b7-4a69-44ce-903f-390e4d38536f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:39:32.786036 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 759/1525] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 8 16:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:39:32.944858 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20af416-acda-4823-9255-494737d898d2 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:39:32.947170 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a20af416-acda-4823-9255-494737d898d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:39:33.020282 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20af416-acda-4823-9255-494737d898d2 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:39:33.025868 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d228101-5b6f-436a-9bdd-d92ab4bbfdec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:39:33.026507 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d228101-5b6f-436a-9bdd-d92ab4bbfdec service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:33.026790 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d228101-5b6f-436a-9bdd-d92ab4bbfdec service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:33.027067 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d228101-5b6f-436a-9bdd-d92ab4bbfdec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:33.035413 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d228101-5b6f-436a-9bdd-d92ab4bbfdec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:39:33.037073 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d228101-5b6f-436a-9bdd-d92ab4bbfdec service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:39:33.046382 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 767/1526] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:39:33.687063 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5595c21-ff1f-4481-ba90-3b03a286bade None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:33.687258 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5595c21-ff1f-4481-ba90-3b03a286bade None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:33.687536 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5595c21-ff1f-4481-ba90-3b03a286bade None None] PATH_INFO: `/v3` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:33.688874 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 760/1527] 10.222.0.42 () {54 vars in 925 bytes} [Tue Feb 8 16:39:33 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:39:33.695113 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f84dc5-9cbe-45d1-abec-edc654050fae None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:33.695524 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f84dc5-9cbe-45d1-abec-edc654050fae None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:33.696040 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f84dc5-9cbe-45d1-abec-edc654050fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:33.715606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-69f84dc5-9cbe-45d1-abec-edc654050fae None None] MFA Rules not processed for user `75c8f232fc83474b8731ee6c1eb321fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:39:33.716879 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-69f84dc5-9cbe-45d1-abec-edc654050fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:39:33.781124 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 768/1528] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Feb 8 16:39:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:39:34.366186 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3d7ac-50a8-472f-8f17-9d36def45602 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:34.366729 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3d7ac-50a8-472f-8f17-9d36def45602 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:34.366729 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3d7ac-50a8-472f-8f17-9d36def45602 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:34.369214 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 761/1529] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 8 16:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:39:34.374211 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db9b7e-02f9-4d1f-b3e7-8745354d7de7 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:34.374495 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db9b7e-02f9-4d1f-b3e7-8745354d7de7 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:34.374767 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db9b7e-02f9-4d1f-b3e7-8745354d7de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:34.393525 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-27db9b7e-02f9-4d1f-b3e7-8745354d7de7 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:39:34.394696 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-27db9b7e-02f9-4d1f-b3e7-8745354d7de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:39:34.402595 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 769/1530] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 8 16:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:39:34.557503 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3d7ac-50a8-472f-8f17-9d36def45602 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:39:34.571554 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3d7ac-50a8-472f-8f17-9d36def45602 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:39:34.577145 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd17f71-d2a4-4993-98d4-2f5ba0b48d7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:39:34.577761 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd17f71-d2a4-4993-98d4-2f5ba0b48d7f service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:34.578039 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd17f71-d2a4-4993-98d4-2f5ba0b48d7f service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:34.578312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd17f71-d2a4-4993-98d4-2f5ba0b48d7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:34.587291 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd17f71-d2a4-4993-98d4-2f5ba0b48d7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:39:34.589061 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd17f71-d2a4-4993-98d4-2f5ba0b48d7f service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:39:34.598493 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 762/1531] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:39:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:39:37.702560 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725eb260-46c0-4d59-a6ce-3aa38e02251c None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:37.703113 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725eb260-46c0-4d59-a6ce-3aa38e02251c None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:37.703113 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725eb260-46c0-4d59-a6ce-3aa38e02251c None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:37.704958 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 770/1532] 10.222.0.35 () {54 vars in 960 bytes} [Tue Feb 8 16:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:39:37.710051 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2427b-989c-4133-96f3-ed3da9ab795f None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:37.710504 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2427b-989c-4133-96f3-ed3da9ab795f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:37.710601 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2427b-989c-4133-96f3-ed3da9ab795f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:37.729966 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-7be2427b-989c-4133-96f3-ed3da9ab795f None None] MFA Rules not processed for user `75c8f232fc83474b8731ee6c1eb321fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:39:37.731174 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7be2427b-989c-4133-96f3-ed3da9ab795f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:39:37.739790 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 763/1533] 10.222.0.35 () {58 vars in 1057 bytes} [Tue Feb 8 16:39:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:39:37.747581 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725eb260-46c0-4d59-a6ce-3aa38e02251c None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:39:37.761739 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725eb260-46c0-4d59-a6ce-3aa38e02251c None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:39:37.766686 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63844edc-c093-446d-b982-f6f0b2e031cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c8f232fc83474b8731ee6c1eb321fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:39:37.767313 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63844edc-c093-446d-b982-f6f0b2e031cd service placement] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:37.767595 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63844edc-c093-446d-b982-f6f0b2e031cd service placement] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:37.767910 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63844edc-c093-446d-b982-f6f0b2e031cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:37.776949 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63844edc-c093-446d-b982-f6f0b2e031cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:39:37.778525 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63844edc-c093-446d-b982-f6f0b2e031cd service placement] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:39:37.788067 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 771/1534] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:39:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:39:46.330066 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5653cee-572f-47e8-9aca-334da60d17a1 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:46.330571 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5653cee-572f-47e8-9aca-334da60d17a1 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:46.330686 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5653cee-572f-47e8-9aca-334da60d17a1 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:46.332419 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 764/1535] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 8 16:39:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:39:46.338400 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37d09e-59d2-43a6-8b5d-0a304404f18f None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:46.338878 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37d09e-59d2-43a6-8b5d-0a304404f18f None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:46.338988 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37d09e-59d2-43a6-8b5d-0a304404f18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:46.356361 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-4e37d09e-59d2-43a6-8b5d-0a304404f18f None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:39:46.357522 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-4e37d09e-59d2-43a6-8b5d-0a304404f18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:39:46.365288 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 772/1536] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 8 16:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:39:46.523493 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5653cee-572f-47e8-9aca-334da60d17a1 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:39:46.537436 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5653cee-572f-47e8-9aca-334da60d17a1 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:39:46.542785 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdff500-0824-4c0e-88de-adb3a8e8bf02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:39:46.543406 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdff500-0824-4c0e-88de-adb3a8e8bf02 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:46.543681 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdff500-0824-4c0e-88de-adb3a8e8bf02 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:46.544016 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdff500-0824-4c0e-88de-adb3a8e8bf02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:46.552062 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdff500-0824-4c0e-88de-adb3a8e8bf02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:39:46.553630 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdff500-0824-4c0e-88de-adb3a8e8bf02 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:39:46.563459 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 765/1537] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:39:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:39:47.901513 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe1da8-13d2-48cd-a117-9c535f3f8fe3 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:47.902053 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe1da8-13d2-48cd-a117-9c535f3f8fe3 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:47.902053 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe1da8-13d2-48cd-a117-9c535f3f8fe3 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:47.903769 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 773/1538] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 8 16:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:39:47.909006 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdf8a4-e5dd-415d-bb9e-e71072ce7c64 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:47.909443 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdf8a4-e5dd-415d-bb9e-e71072ce7c64 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:47.909543 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdf8a4-e5dd-415d-bb9e-e71072ce7c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:47.928954 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-cecdf8a4-e5dd-415d-bb9e-e71072ce7c64 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:39:47.930787 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cecdf8a4-e5dd-415d-bb9e-e71072ce7c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:39:47.938582 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 766/1539] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 8 16:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:39:48.094474 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe1da8-13d2-48cd-a117-9c535f3f8fe3 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:39:48.108521 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe1da8-13d2-48cd-a117-9c535f3f8fe3 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:39:48.113927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2cb7a-3617-4755-b53a-e37ac28008f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:39:48.114556 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2cb7a-3617-4755-b53a-e37ac28008f3 service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:48.114835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2cb7a-3617-4755-b53a-e37ac28008f3 service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:48.115107 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2cb7a-3617-4755-b53a-e37ac28008f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:48.124152 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2cb7a-3617-4755-b53a-e37ac28008f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:39:48.125776 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2cb7a-3617-4755-b53a-e37ac28008f3 service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:39:48.135672 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 774/1540] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:39:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:39:52.558738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75053848-4801-44e9-bf1f-14067418462e None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:52.559351 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75053848-4801-44e9-bf1f-14067418462e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:52.559351 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75053848-4801-44e9-bf1f-14067418462e None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:52.561536 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 767/1541] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 8 16:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:39:52.566926 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3489686-ed4c-4230-b56d-939d4bd763c4 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:52.567455 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3489686-ed4c-4230-b56d-939d4bd763c4 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:52.567455 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3489686-ed4c-4230-b56d-939d4bd763c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:52.585614 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-b3489686-ed4c-4230-b56d-939d4bd763c4 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:39:52.587298 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-b3489686-ed4c-4230-b56d-939d4bd763c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:39:52.595289 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 775/1542] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 8 16:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:39:52.634156 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75053848-4801-44e9-bf1f-14067418462e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:39:52.636059 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-75053848-4801-44e9-bf1f-14067418462e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:39:52.691850 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75053848-4801-44e9-bf1f-14067418462e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:39:52.695396 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47582d-c9d4-45c6-a503-a29b1a67bc30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:39:52.696170 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47582d-c9d4-45c6-a503-a29b1a67bc30 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:52.696451 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47582d-c9d4-45c6-a503-a29b1a67bc30 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:52.696727 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47582d-c9d4-45c6-a503-a29b1a67bc30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:52.705713 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47582d-c9d4-45c6-a503-a29b1a67bc30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:39:52.707153 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47582d-c9d4-45c6-a503-a29b1a67bc30 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:39:52.717571 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 768/1543] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:39:54.999998 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1972f-36d4-4786-9b6a-080db0e475b8 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:55.000582 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1972f-36d4-4786-9b6a-080db0e475b8 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:55.000582 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1972f-36d4-4786-9b6a-080db0e475b8 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:55.002243 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 776/1544] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 8 16:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:39:55.008690 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cfbc7-7571-43cd-8348-e9063f5e00e1 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:55.009284 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cfbc7-7571-43cd-8348-e9063f5e00e1 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:55.009473 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cfbc7-7571-43cd-8348-e9063f5e00e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:55.028130 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c44cfbc7-7571-43cd-8348-e9063f5e00e1 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:39:55.029324 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c44cfbc7-7571-43cd-8348-e9063f5e00e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:39:55.037047 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 769/1545] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 8 16:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:39:55.074310 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1972f-36d4-4786-9b6a-080db0e475b8 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:39:55.087458 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1972f-36d4-4786-9b6a-080db0e475b8 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:39:55.091115 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1752941-066f-4e3d-8759-09f7a3a54f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:39:55.091770 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1752941-066f-4e3d-8759-09f7a3a54f12 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:55.092061 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1752941-066f-4e3d-8759-09f7a3a54f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:55.092338 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1752941-066f-4e3d-8759-09f7a3a54f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:55.102118 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1752941-066f-4e3d-8759-09f7a3a54f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:39:55.103551 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1752941-066f-4e3d-8759-09f7a3a54f12 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:39:55.115776 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 777/1546] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:39:59.136916 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ac389-2039-4aa7-9bd8-adb224a72f5b None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:59.137554 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ac389-2039-4aa7-9bd8-adb224a72f5b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:59.137883 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ac389-2039-4aa7-9bd8-adb224a72f5b None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:59.141221 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 770/1547] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 8 16:39:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:39:59.147041 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a91913-2261-48cb-ac03-50abe6bafab9 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:59.147624 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a91913-2261-48cb-ac03-50abe6bafab9 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:59.147624 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a91913-2261-48cb-ac03-50abe6bafab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:59.167941 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-d7a91913-2261-48cb-ac03-50abe6bafab9 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:39:59.169902 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d7a91913-2261-48cb-ac03-50abe6bafab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:39:59.178403 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 778/1548] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 8 16:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:39:59.436046 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ac389-2039-4aa7-9bd8-adb224a72f5b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:39:59.437700 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-188ac389-2039-4aa7-9bd8-adb224a72f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:39:59.493940 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ac389-2039-4aa7-9bd8-adb224a72f5b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:39:59.497544 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7956d9-b49b-4499-a066-2106bbf66186 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:39:59.498185 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7956d9-b49b-4499-a066-2106bbf66186 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:39:59.498469 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7956d9-b49b-4499-a066-2106bbf66186 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:39:59.498746 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7956d9-b49b-4499-a066-2106bbf66186 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:39:59.508689 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7956d9-b49b-4499-a066-2106bbf66186 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:39:59.510188 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7956d9-b49b-4499-a066-2106bbf66186 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:39:59.519766 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 771/1549] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:40:01.842187 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f450ee1-d17f-4a10-94c9-ae94f70fe854 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:40:01.842788 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f450ee1-d17f-4a10-94c9-ae94f70fe854 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:40:01.842788 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f450ee1-d17f-4a10-94c9-ae94f70fe854 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:40:01.844575 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 779/1550] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 8 16:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:40:01.850059 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8706edc-54ef-469c-a0bc-d535ba79b9d1 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:40:01.850549 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8706edc-54ef-469c-a0bc-d535ba79b9d1 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:40:01.850662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8706edc-54ef-469c-a0bc-d535ba79b9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:40:01.869539 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-b8706edc-54ef-469c-a0bc-d535ba79b9d1 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:40:01.870757 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b8706edc-54ef-469c-a0bc-d535ba79b9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:40:01.878904 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 772/1551] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 8 16:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:40:02.139785 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea875a52-21f2-48b1-b040-af96f485f030 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:40:02.140080 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea875a52-21f2-48b1-b040-af96f485f030 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:40:02.140353 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea875a52-21f2-48b1-b040-af96f485f030 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:40:02.142229 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 780/1552] 10.222.0.35 () {54 vars in 963 bytes} [Tue Feb 8 16:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:40:02.148582 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49487b-792b-4651-9b5f-80730aebc346 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:40:02.148950 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49487b-792b-4651-9b5f-80730aebc346 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:40:02.149228 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49487b-792b-4651-9b5f-80730aebc346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:40:02.167272 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ff49487b-792b-4651-9b5f-80730aebc346 None None] MFA Rules not processed for user `591ac81647b8446ab342e44c3fb35174`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:40:02.168478 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ff49487b-792b-4651-9b5f-80730aebc346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:40:02.175037 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 773/1553] 10.222.0.35 () {58 vars in 1060 bytes} [Tue Feb 8 16:40:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:40:02.183722 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea875a52-21f2-48b1-b040-af96f485f030 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:40:02.194111 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea875a52-21f2-48b1-b040-af96f485f030 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:40:02.198205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77d7e6-a89a-4023-be00-dfd9f60bd3fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:40:02.198828 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77d7e6-a89a-4023-be00-dfd9f60bd3fa service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:40:02.199110 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77d7e6-a89a-4023-be00-dfd9f60bd3fa service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:40:02.199386 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77d7e6-a89a-4023-be00-dfd9f60bd3fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:40:02.208383 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77d7e6-a89a-4023-be00-dfd9f60bd3fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:40:02.209813 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77d7e6-a89a-4023-be00-dfd9f60bd3fa service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:40:02.219459 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 781/1554] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:40:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:26.770127 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3a598-5850-4256-a90c-47fa58ef400d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:26.772588 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3a598-5850-4256-a90c-47fa58ef400d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:26.772588 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3a598-5850-4256-a90c-47fa58ef400d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:26.796718 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-04b3a598-5850-4256-a90c-47fa58ef400d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:26.798263 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-04b3a598-5850-4256-a90c-47fa58ef400d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:26.809292 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 774/1555] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:26.820047 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3e70f-0334-4237-95ac-d6d12ed53c43 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:26.821413 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3e70f-0334-4237-95ac-d6d12ed53c43 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:26.821915 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3e70f-0334-4237-95ac-d6d12ed53c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:26.862308 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-81a3e70f-0334-4237-95ac-d6d12ed53c43 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:26.863932 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-81a3e70f-0334-4237-95ac-d6d12ed53c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:26.877751 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 782/1556] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:26.883291 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3a598-5850-4256-a90c-47fa58ef400d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:26.898906 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3a598-5850-4256-a90c-47fa58ef400d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:26.905767 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc3aed-63be-4c4f-8b30-dc109319d6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:26.906743 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc3aed-63be-4c4f-8b30-dc109319d6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:26.908138 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc3aed-63be-4c4f-8b30-dc109319d6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:26.908659 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc3aed-63be-4c4f-8b30-dc109319d6a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:26.909634 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc3aed-63be-4c4f-8b30-dc109319d6a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:41:26.910168 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc3aed-63be-4c4f-8b30-dc109319d6a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:26.912994 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc3aed-63be-4c4f-8b30-dc109319d6a6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:26.933808 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 775/1557] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:41:26.941791 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3e70f-0334-4237-95ac-d6d12ed53c43 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:26.957544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3e70f-0334-4237-95ac-d6d12ed53c43 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:26.968523 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13591e77-d0ad-4fa3-9ccc-6ff23e379e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:26.969516 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13591e77-d0ad-4fa3-9ccc-6ff23e379e8a admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:26.970021 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13591e77-d0ad-4fa3-9ccc-6ff23e379e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:26.970524 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13591e77-d0ad-4fa3-9ccc-6ff23e379e8a admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:26.971538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13591e77-d0ad-4fa3-9ccc-6ff23e379e8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:26.973675 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13591e77-d0ad-4fa3-9ccc-6ff23e379e8a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:27.029380 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 783/1558] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:41:26 2022] POST /identity/v3/projects => generated 393 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:27.039659 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc3aed-63be-4c4f-8b30-dc109319d6a6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:27.053594 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc3aed-63be-4c4f-8b30-dc109319d6a6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:27.119716 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d1d95-0817-4949-b5a8-203cb34e9328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:27.120803 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d1d95-0817-4949-b5a8-203cb34e9328 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.121329 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d1d95-0817-4949-b5a8-203cb34e9328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.121830 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d1d95-0817-4949-b5a8-203cb34e9328 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.122987 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d1d95-0817-4949-b5a8-203cb34e9328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:27.125212 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d1d95-0817-4949-b5a8-203cb34e9328 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:27.185583 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 776/1559] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:41:27 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:27.190041 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13591e77-d0ad-4fa3-9ccc-6ff23e379e8a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:27.202812 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13591e77-d0ad-4fa3-9ccc-6ff23e379e8a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:27.217698 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a7471-4fb2-4a8b-a42c-c05a70570ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:27.218765 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a7471-4fb2-4a8b-a42c-c05a70570ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.219401 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a7471-4fb2-4a8b-a42c-c05a70570ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.219937 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a7471-4fb2-4a8b-a42c-c05a70570ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.220931 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a7471-4fb2-4a8b-a42c-c05a70570ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:27.222939 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a7471-4fb2-4a8b-a42c-c05a70570ce3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:27.239135 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 784/1560] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:27.245088 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d1d95-0817-4949-b5a8-203cb34e9328 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:27.257130 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d1d95-0817-4949-b5a8-203cb34e9328 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:27.266290 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e09097-cba1-4676-bed2-2545f73660e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:27.267398 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e09097-cba1-4676-bed2-2545f73660e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.267948 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e09097-cba1-4676-bed2-2545f73660e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.268469 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e09097-cba1-4676-bed2-2545f73660e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.269453 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e09097-cba1-4676-bed2-2545f73660e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:27.271311 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e09097-cba1-4676-bed2-2545f73660e9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:27.274299 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0262f31-67e7-4894-8ddb-d71083f996dc None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.274854 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0262f31-67e7-4894-8ddb-d71083f996dc None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.275355 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0262f31-67e7-4894-8ddb-d71083f996dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.306640 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 777/1561] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:27.307100 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-d0262f31-67e7-4894-8ddb-d71083f996dc None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:27.308805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d0262f31-67e7-4894-8ddb-d71083f996dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:27.312069 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e09097-cba1-4676-bed2-2545f73660e9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:27.327737 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 785/1562] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:41:27.329206 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e09097-cba1-4676-bed2-2545f73660e9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:27.338628 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b16cdd-7fcc-4f7a-8342-99540786a6e2 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.339247 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b16cdd-7fcc-4f7a-8342-99540786a6e2 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.339775 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b16cdd-7fcc-4f7a-8342-99540786a6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.349197 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0390a-279b-4b61-ad63-6b9da55616a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:27.350971 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0390a-279b-4b61-ad63-6b9da55616a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.353196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0390a-279b-4b61-ad63-6b9da55616a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.354534 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0390a-279b-4b61-ad63-6b9da55616a8 admin admin] PATH_INFO: `/v3/projects/637df1e7f2cb48c0b97d67658900335d/users/21e3f764b9f34256bc91f08bc220c7c1/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.382566 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-06b16cdd-7fcc-4f7a-8342-99540786a6e2 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:27.385889 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-06b16cdd-7fcc-4f7a-8342-99540786a6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:27.392641 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0390a-279b-4b61-ad63-6b9da55616a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=637df1e7f2cb48c0b97d67658900335d, user_id=21e3f764b9f34256bc91f08bc220c7c1, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:27.399803 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0390a-279b-4b61-ad63-6b9da55616a8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:27.407264 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 786/1563] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:41:27.409128 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804c8c5-4460-496f-9045-ed1f01510ea2 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.409692 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804c8c5-4460-496f-9045-ed1f01510ea2 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.410228 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804c8c5-4460-496f-9045-ed1f01510ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.426423 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 778/1564] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:27 2022] PUT /identity/v3/projects/637df1e7f2cb48c0b97d67658900335d/users/21e3f764b9f34256bc91f08bc220c7c1/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:27.426932 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0390a-279b-4b61-ad63-6b9da55616a8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:27.446048 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-9804c8c5-4460-496f-9045-ed1f01510ea2 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:27.448168 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-9804c8c5-4460-496f-9045-ed1f01510ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:27.525027 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 787/1565] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:27.526660 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bd2d1-79fa-45fb-871f-e0f0f5caacea None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.527275 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bd2d1-79fa-45fb-871f-e0f0f5caacea None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.527561 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bd2d1-79fa-45fb-871f-e0f0f5caacea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.564056 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0390a-279b-4b61-ad63-6b9da55616a8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:27.567127 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-0a4bd2d1-79fa-45fb-871f-e0f0f5caacea None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:27.569368 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-0a4bd2d1-79fa-45fb-871f-e0f0f5caacea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:27.573628 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14b030-be46-4d1c-87eb-c63fbca436f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:27.574508 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14b030-be46-4d1c-87eb-c63fbca436f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.574941 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14b030-be46-4d1c-87eb-c63fbca436f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.575364 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14b030-be46-4d1c-87eb-c63fbca436f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.576415 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14b030-be46-4d1c-87eb-c63fbca436f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:41:27.576898 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14b030-be46-4d1c-87eb-c63fbca436f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:27.578690 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14b030-be46-4d1c-87eb-c63fbca436f9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:27.593271 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 788/1566] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:27.594824 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ece0e-acf0-40de-b804-1b6984dddd3b None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.595284 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ece0e-acf0-40de-b804-1b6984dddd3b None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.596489 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ece0e-acf0-40de-b804-1b6984dddd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.607898 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 779/1567] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:41:27.607898 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bcc00-4e03-4b26-aafc-a7743e828794 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.607898 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bcc00-4e03-4b26-aafc-a7743e828794 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.607898 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bcc00-4e03-4b26-aafc-a7743e828794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.631078 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-828ece0e-acf0-40de-b804-1b6984dddd3b None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:27.632872 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-828ece0e-acf0-40de-b804-1b6984dddd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:27.640870 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-199bcc00-4e03-4b26-aafc-a7743e828794 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:27.642393 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 789/1568] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:27.642733 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-199bcc00-4e03-4b26-aafc-a7743e828794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:27.643650 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81240f99-cc76-4972-9cc7-cf5d51207c52 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.645477 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81240f99-cc76-4972-9cc7-cf5d51207c52 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.646440 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81240f99-cc76-4972-9cc7-cf5d51207c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.661489 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 780/1569] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:27.662521 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bcc00-4e03-4b26-aafc-a7743e828794 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:27.677027 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-81240f99-cc76-4972-9cc7-cf5d51207c52 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:27.679429 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-81240f99-cc76-4972-9cc7-cf5d51207c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:27.688149 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 790/1570] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:27.689401 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81240f99-cc76-4972-9cc7-cf5d51207c52 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:27.701419 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81240f99-cc76-4972-9cc7-cf5d51207c52 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:27.706956 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69d499-bd02-46d7-886f-5bce5d6fecc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:27.707957 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69d499-bd02-46d7-886f-5bce5d6fecc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.708418 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69d499-bd02-46d7-886f-5bce5d6fecc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.708859 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69d499-bd02-46d7-886f-5bce5d6fecc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.710988 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c69d499-bd02-46d7-886f-5bce5d6fecc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:27.713113 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c69d499-bd02-46d7-886f-5bce5d6fecc0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:27.728946 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bcc00-4e03-4b26-aafc-a7743e828794 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:27.733495 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c9b08-02f9-4be5-8a11-398392028315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:27.734495 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c9b08-02f9-4be5-8a11-398392028315 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.734805 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c9b08-02f9-4be5-8a11-398392028315 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.735083 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c9b08-02f9-4be5-8a11-398392028315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.743683 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 791/1571] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:41:27 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:27.745159 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856eca5-d1f8-45a1-92c8-604f3c926e27 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.745484 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856eca5-d1f8-45a1-92c8-604f3c926e27 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.745765 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856eca5-d1f8-45a1-92c8-604f3c926e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.748012 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c9b08-02f9-4be5-8a11-398392028315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:27.749532 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c9b08-02f9-4be5-8a11-398392028315 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:27.760514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 781/1572] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:27.761853 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172369b-ef19-47d1-976f-e1d7235b7f21 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.762142 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172369b-ef19-47d1-976f-e1d7235b7f21 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.762421 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172369b-ef19-47d1-976f-e1d7235b7f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.765573 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-e856eca5-d1f8-45a1-92c8-604f3c926e27 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:27.766775 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-e856eca5-d1f8-45a1-92c8-604f3c926e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:27.780480 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-7172369b-ef19-47d1-976f-e1d7235b7f21 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:27.781697 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7172369b-ef19-47d1-976f-e1d7235b7f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:27.835135 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 792/1573] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:27.836771 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364df83-29ee-49ef-8bee-eca340029467 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.837065 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364df83-29ee-49ef-8bee-eca340029467 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.837349 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364df83-29ee-49ef-8bee-eca340029467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.847772 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 782/1574] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:27.849009 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172369b-ef19-47d1-976f-e1d7235b7f21 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:27.857886 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-7364df83-29ee-49ef-8bee-eca340029467 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:27.859274 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-7364df83-29ee-49ef-8bee-eca340029467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:27.860809 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172369b-ef19-47d1-976f-e1d7235b7f21 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:27.866670 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e52554-7e88-402c-a194-6acf20588c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:27.867326 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e52554-7e88-402c-a194-6acf20588c18 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.867609 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e52554-7e88-402c-a194-6acf20588c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.867921 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e52554-7e88-402c-a194-6acf20588c18 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.868777 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e52554-7e88-402c-a194-6acf20588c18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:41:27.869013 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e52554-7e88-402c-a194-6acf20588c18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:27.873475 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 793/1575] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:27.873637 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e52554-7e88-402c-a194-6acf20588c18 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:27.873783 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86130cc3-05b4-46bb-b80a-ae97be153a97 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.873783 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86130cc3-05b4-46bb-b80a-ae97be153a97 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.873783 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86130cc3-05b4-46bb-b80a-ae97be153a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.885984 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 783/1576] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:41:27.888210 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa481bc-3955-4060-a3f4-4d609bf6de4c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.888210 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa481bc-3955-4060-a3f4-4d609bf6de4c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.888210 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa481bc-3955-4060-a3f4-4d609bf6de4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.898161 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-86130cc3-05b4-46bb-b80a-ae97be153a97 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:27.899419 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-86130cc3-05b4-46bb-b80a-ae97be153a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:27.908785 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 794/1577] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:27.910307 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-1fa481bc-3955-4060-a3f4-4d609bf6de4c None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:27.912286 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1fa481bc-3955-4060-a3f4-4d609bf6de4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:27.919124 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86130cc3-05b4-46bb-b80a-ae97be153a97 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:27.927791 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 784/1578] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:27.927791 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d59b2-5f98-4880-b731-8f71323a1caa None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.927791 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d59b2-5f98-4880-b731-8f71323a1caa None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.927791 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d59b2-5f98-4880-b731-8f71323a1caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.936993 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86130cc3-05b4-46bb-b80a-ae97be153a97 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:27.947794 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369380fd-e952-4b1b-840e-e9d923470514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:27.949196 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369380fd-e952-4b1b-840e-e9d923470514 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.949569 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-4c7d59b2-5f98-4880-b731-8f71323a1caa None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:27.949797 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369380fd-e952-4b1b-840e-e9d923470514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.952407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4c7d59b2-5f98-4880-b731-8f71323a1caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:27.952862 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369380fd-e952-4b1b-840e-e9d923470514 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.953793 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369380fd-e952-4b1b-840e-e9d923470514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:27.957642 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369380fd-e952-4b1b-840e-e9d923470514 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:27.958831 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 785/1579] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:27.960635 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d59b2-5f98-4880-b731-8f71323a1caa None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:27.970990 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d59b2-5f98-4880-b731-8f71323a1caa None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:27.979976 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc663378-96e0-4182-84de-4c23732d9b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:27.981592 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc663378-96e0-4182-84de-4c23732d9b96 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:27.981947 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc663378-96e0-4182-84de-4c23732d9b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:27.982748 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc663378-96e0-4182-84de-4c23732d9b96 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:27.983578 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc663378-96e0-4182-84de-4c23732d9b96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:41:27.984157 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc663378-96e0-4182-84de-4c23732d9b96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:27.986010 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc663378-96e0-4182-84de-4c23732d9b96 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:27.994779 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 795/1580] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:41:27 2022] POST /identity/v3/users => generated 289 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:27.995855 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369380fd-e952-4b1b-840e-e9d923470514 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.002730 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 786/1581] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:41:28.004426 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc663378-96e0-4182-84de-4c23732d9b96 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.011795 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369380fd-e952-4b1b-840e-e9d923470514 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.015300 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc663378-96e0-4182-84de-4c23732d9b96 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.017669 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64550625-ae3e-420f-a058-00680353ea43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.018167 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64550625-ae3e-420f-a058-00680353ea43 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.018525 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64550625-ae3e-420f-a058-00680353ea43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.018878 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64550625-ae3e-420f-a058-00680353ea43 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.019870 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64550625-ae3e-420f-a058-00680353ea43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:41:28.020137 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64550625-ae3e-420f-a058-00680353ea43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.020382 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62476462-eed1-41da-bade-4d294c1f1be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.021049 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62476462-eed1-41da-bade-4d294c1f1be0 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.021330 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62476462-eed1-41da-bade-4d294c1f1be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.021780 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62476462-eed1-41da-bade-4d294c1f1be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.023080 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62476462-eed1-41da-bade-4d294c1f1be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.023224 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64550625-ae3e-420f-a058-00680353ea43 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:28.025000 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62476462-eed1-41da-bade-4d294c1f1be0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:28.048682 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 796/1582] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:41:28.048682 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aa63a-9730-44a6-a483-b669f996b840 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.048682 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aa63a-9730-44a6-a483-b669f996b840 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.048682 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aa63a-9730-44a6-a483-b669f996b840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.072077 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-9a5aa63a-9730-44a6-a483-b669f996b840 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:28.073389 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-9a5aa63a-9730-44a6-a483-b669f996b840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:28.075296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 787/1583] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:41:28 2022] POST /identity/v3/projects => generated 389 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:28.076619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c15dae-8cea-48f2-b35e-7231752b8eea None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.076910 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c15dae-8cea-48f2-b35e-7231752b8eea None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.077184 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c15dae-8cea-48f2-b35e-7231752b8eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.098548 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-77c15dae-8cea-48f2-b35e-7231752b8eea None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:28.101381 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-77c15dae-8cea-48f2-b35e-7231752b8eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:28.139390 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 797/1584] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:28.140922 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5aa63a-9730-44a6-a483-b669f996b840 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.155542 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5aa63a-9730-44a6-a483-b669f996b840 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.160554 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729e5cb-2a39-4f19-8aee-6689c2881643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.161291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729e5cb-2a39-4f19-8aee-6689c2881643 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.161649 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729e5cb-2a39-4f19-8aee-6689c2881643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.161987 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729e5cb-2a39-4f19-8aee-6689c2881643 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.163614 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729e5cb-2a39-4f19-8aee-6689c2881643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:41:28.164038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729e5cb-2a39-4f19-8aee-6689c2881643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.165717 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729e5cb-2a39-4f19-8aee-6689c2881643 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:28.169332 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 788/1585] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:28.172971 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c15dae-8cea-48f2-b35e-7231752b8eea None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.187072 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 798/1586] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:41:28.187072 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729e5cb-2a39-4f19-8aee-6689c2881643 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.190888 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729e5cb-2a39-4f19-8aee-6689c2881643 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.192107 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c15dae-8cea-48f2-b35e-7231752b8eea None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.197797 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa553636-8863-4c3c-b237-03ba10302482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.198538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa553636-8863-4c3c-b237-03ba10302482 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.198823 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa553636-8863-4c3c-b237-03ba10302482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.199138 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e44255-9722-406e-89a0-c37471472b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.199251 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa553636-8863-4c3c-b237-03ba10302482 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.199893 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa553636-8863-4c3c-b237-03ba10302482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.200013 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e44255-9722-406e-89a0-c37471472b39 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.201118 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e44255-9722-406e-89a0-c37471472b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.201118 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e44255-9722-406e-89a0-c37471472b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.201551 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e44255-9722-406e-89a0-c37471472b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.201910 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa553636-8863-4c3c-b237-03ba10302482 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:28.203481 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e44255-9722-406e-89a0-c37471472b39 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:28.220919 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 789/1587] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:28.221861 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e44255-9722-406e-89a0-c37471472b39 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.233103 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e44255-9722-406e-89a0-c37471472b39 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.238610 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38418f-f797-4197-a3b6-413616589148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.239310 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38418f-f797-4197-a3b6-413616589148 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.239714 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38418f-f797-4197-a3b6-413616589148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.240020 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38418f-f797-4197-a3b6-413616589148 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.244021 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 799/1588] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:41:28 2022] POST /identity/v3/projects => generated 405 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:28.244175 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38418f-f797-4197-a3b6-413616589148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.244260 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa553636-8863-4c3c-b237-03ba10302482 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.244358 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38418f-f797-4197-a3b6-413616589148 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:28.282098 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 790/1589] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:41:28 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:28.283023 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38418f-f797-4197-a3b6-413616589148 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.328608 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa553636-8863-4c3c-b237-03ba10302482 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.354783 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38418f-f797-4197-a3b6-413616589148 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.359510 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f461d-c717-4b36-96cc-4dd1f5157436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.360199 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f461d-c717-4b36-96cc-4dd1f5157436 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.360473 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f461d-c717-4b36-96cc-4dd1f5157436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.360794 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f461d-c717-4b36-96cc-4dd1f5157436 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.361578 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f461d-c717-4b36-96cc-4dd1f5157436 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:41:28.362136 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f461d-c717-4b36-96cc-4dd1f5157436 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.363438 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f461d-c717-4b36-96cc-4dd1f5157436 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:28.378247 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 791/1590] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:41:28.385009 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f461d-c717-4b36-96cc-4dd1f5157436 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.392667 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5e581-d42f-4111-965f-87c4b8cc497a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.394064 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5e581-d42f-4111-965f-87c4b8cc497a admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.394564 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5e581-d42f-4111-965f-87c4b8cc497a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.394914 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5e581-d42f-4111-965f-87c4b8cc497a admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.395629 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5e581-d42f-4111-965f-87c4b8cc497a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.397518 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f461d-c717-4b36-96cc-4dd1f5157436 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.398367 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5e581-d42f-4111-965f-87c4b8cc497a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:28.404155 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fa608-94a1-4d7e-8200-23a6ad2f84ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.404894 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fa608-94a1-4d7e-8200-23a6ad2f84ee admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.405360 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fa608-94a1-4d7e-8200-23a6ad2f84ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.405657 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fa608-94a1-4d7e-8200-23a6ad2f84ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.406426 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fa608-94a1-4d7e-8200-23a6ad2f84ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:41:28.406730 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fa608-94a1-4d7e-8200-23a6ad2f84ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.408719 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fa608-94a1-4d7e-8200-23a6ad2f84ee admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:28.422960 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 792/1591] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:41:28.423485 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fa608-94a1-4d7e-8200-23a6ad2f84ee admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.431482 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 800/1592] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:41:28 2022] POST /identity/v3/users => generated 295 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:28.433239 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5e581-d42f-4111-965f-87c4b8cc497a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.437010 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fa608-94a1-4d7e-8200-23a6ad2f84ee admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.441778 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6b0f7-67d3-4992-ab67-a1f506c5afef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.442611 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6b0f7-67d3-4992-ab67-a1f506c5afef admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.442888 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6b0f7-67d3-4992-ab67-a1f506c5afef admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.443429 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6b0f7-67d3-4992-ab67-a1f506c5afef admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.445152 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6b0f7-67d3-4992-ab67-a1f506c5afef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.445534 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5e581-d42f-4111-965f-87c4b8cc497a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.447488 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6b0f7-67d3-4992-ab67-a1f506c5afef admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:28.450812 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142210b-83e8-444f-bcfb-2f7bb0f4e99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.451794 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142210b-83e8-444f-bcfb-2f7bb0f4e99e admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.451927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142210b-83e8-444f-bcfb-2f7bb0f4e99e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.452369 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142210b-83e8-444f-bcfb-2f7bb0f4e99e admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.453085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142210b-83e8-444f-bcfb-2f7bb0f4e99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.454714 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142210b-83e8-444f-bcfb-2f7bb0f4e99e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:28.465574 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 801/1593] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:28.466718 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142210b-83e8-444f-bcfb-2f7bb0f4e99e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.477606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142210b-83e8-444f-bcfb-2f7bb0f4e99e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.479471 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 793/1594] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:41:28 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:28.480493 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6b0f7-67d3-4992-ab67-a1f506c5afef admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.558438 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6b0f7-67d3-4992-ab67-a1f506c5afef admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.563495 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5aaa93-99ff-409b-ab9c-324302e5ac6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.564221 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5aaa93-99ff-409b-ab9c-324302e5ac6a admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.564499 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5aaa93-99ff-409b-ab9c-324302e5ac6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.564768 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5aaa93-99ff-409b-ab9c-324302e5ac6a admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.565519 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5aaa93-99ff-409b-ab9c-324302e5ac6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.567603 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5aaa93-99ff-409b-ab9c-324302e5ac6a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:28.586463 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad1283-de6b-4511-80ed-4f51125ff2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.587834 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad1283-de6b-4511-80ed-4f51125ff2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.588468 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad1283-de6b-4511-80ed-4f51125ff2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.588750 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad1283-de6b-4511-80ed-4f51125ff2b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.589487 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad1283-de6b-4511-80ed-4f51125ff2b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.591981 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad1283-de6b-4511-80ed-4f51125ff2b0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:28.595654 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 794/1595] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:41:28 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:28.596480 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5aaa93-99ff-409b-ab9c-324302e5ac6a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.609308 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5aaa93-99ff-409b-ab9c-324302e5ac6a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.620539 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab82a9-4180-409d-a819-c9d7b61d848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.621679 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab82a9-4180-409d-a819-c9d7b61d848e admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.622151 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab82a9-4180-409d-a819-c9d7b61d848e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.622640 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab82a9-4180-409d-a819-c9d7b61d848e admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.623570 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab82a9-4180-409d-a819-c9d7b61d848e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.626164 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab82a9-4180-409d-a819-c9d7b61d848e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:28.628451 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 802/1596] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:41:28 2022] POST /identity/v3/users => generated 303 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:28.629454 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad1283-de6b-4511-80ed-4f51125ff2b0 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.640596 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad1283-de6b-4511-80ed-4f51125ff2b0 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.646046 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735cf26-8bb2-4374-bf84-f64dbb2a65b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.647304 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735cf26-8bb2-4374-bf84-f64dbb2a65b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.648414 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735cf26-8bb2-4374-bf84-f64dbb2a65b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.648414 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735cf26-8bb2-4374-bf84-f64dbb2a65b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.648939 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735cf26-8bb2-4374-bf84-f64dbb2a65b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.651357 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735cf26-8bb2-4374-bf84-f64dbb2a65b9 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:28.671267 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 795/1597] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:41:28 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:28.672554 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab82a9-4180-409d-a819-c9d7b61d848e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.699369 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 803/1598] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:41:28 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:28.700964 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735cf26-8bb2-4374-bf84-f64dbb2a65b9 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.749646 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab82a9-4180-409d-a819-c9d7b61d848e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.778133 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735cf26-8bb2-4374-bf84-f64dbb2a65b9 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.784029 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7be07d-27fd-46c6-ae29-bab6a2f860eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.784950 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7be07d-27fd-46c6-ae29-bab6a2f860eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.785231 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7be07d-27fd-46c6-ae29-bab6a2f860eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.785506 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7be07d-27fd-46c6-ae29-bab6a2f860eb admin admin] PATH_INFO: `/v3/projects/2214758b43e6434b8c27d97f7fd1151c/users/c5f36415ea7148d79f9fdb9cfac129e0/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.801531 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7be07d-27fd-46c6-ae29-bab6a2f860eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2214758b43e6434b8c27d97f7fd1151c, user_id=c5f36415ea7148d79f9fdb9cfac129e0, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.805327 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7be07d-27fd-46c6-ae29-bab6a2f860eb admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:28.814911 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb235a-eaac-49bf-9dc9-7a2bb2357f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.815766 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb235a-eaac-49bf-9dc9-7a2bb2357f27 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.815973 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb235a-eaac-49bf-9dc9-7a2bb2357f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.816251 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb235a-eaac-49bf-9dc9-7a2bb2357f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.817025 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb235a-eaac-49bf-9dc9-7a2bb2357f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.818803 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb235a-eaac-49bf-9dc9-7a2bb2357f27 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:28.821255 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 804/1599] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:28 2022] PUT /identity/v3/projects/2214758b43e6434b8c27d97f7fd1151c/users/c5f36415ea7148d79f9fdb9cfac129e0/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:28.821957 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7be07d-27fd-46c6-ae29-bab6a2f860eb admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.833196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 796/1600] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:28.835041 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb235a-eaac-49bf-9dc9-7a2bb2357f27 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.845332 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb235a-eaac-49bf-9dc9-7a2bb2357f27 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.890466 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7be07d-27fd-46c6-ae29-bab6a2f860eb admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.897736 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77e7e3-a246-474e-b381-8b9451db7cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.898943 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77e7e3-a246-474e-b381-8b9451db7cda admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.899297 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77e7e3-a246-474e-b381-8b9451db7cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.899582 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77e7e3-a246-474e-b381-8b9451db7cda admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.900384 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77e7e3-a246-474e-b381-8b9451db7cda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.902434 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77e7e3-a246-474e-b381-8b9451db7cda admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:28.905461 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386c99d-17ab-44e3-a133-2ec00407f2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.906143 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386c99d-17ab-44e3-a133-2ec00407f2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.906344 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386c99d-17ab-44e3-a133-2ec00407f2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.906592 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386c99d-17ab-44e3-a133-2ec00407f2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.907331 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386c99d-17ab-44e3-a133-2ec00407f2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.908975 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386c99d-17ab-44e3-a133-2ec00407f2d4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:28.921615 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 797/1601] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:28.922525 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386c99d-17ab-44e3-a133-2ec00407f2d4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.932050 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 805/1602] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:41:28 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:28.932908 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77e7e3-a246-474e-b381-8b9451db7cda admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.935634 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386c99d-17ab-44e3-a133-2ec00407f2d4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.940439 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1999338-7ded-4eab-a40a-75040722dcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.941092 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1999338-7ded-4eab-a40a-75040722dcfe admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.941376 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1999338-7ded-4eab-a40a-75040722dcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.941655 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1999338-7ded-4eab-a40a-75040722dcfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.942382 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1999338-7ded-4eab-a40a-75040722dcfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.943146 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77e7e3-a246-474e-b381-8b9451db7cda admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.944225 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1999338-7ded-4eab-a40a-75040722dcfe admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:28.948834 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a24ba-2a5d-4489-907d-8794a3eb7170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.949549 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a24ba-2a5d-4489-907d-8794a3eb7170 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.950317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a24ba-2a5d-4489-907d-8794a3eb7170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.950317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a24ba-2a5d-4489-907d-8794a3eb7170 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.950850 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a24ba-2a5d-4489-907d-8794a3eb7170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.952940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a24ba-2a5d-4489-907d-8794a3eb7170 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:28.955103 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 798/1603] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:28.956661 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1999338-7ded-4eab-a40a-75040722dcfe admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:28.969912 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1999338-7ded-4eab-a40a-75040722dcfe admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:28.976567 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 806/1604] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:41:28 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:28.977939 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31955861-dd95-49be-8115-0e05dbf587cb None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.978235 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31955861-dd95-49be-8115-0e05dbf587cb None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.978521 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31955861-dd95-49be-8115-0e05dbf587cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.979737 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b59255-858d-4d65-bb27-e6600fdd1d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:28.980552 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59255-858d-4d65-bb27-e6600fdd1d01 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:28.980904 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59255-858d-4d65-bb27-e6600fdd1d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:28.981277 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59255-858d-4d65-bb27-e6600fdd1d01 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:28.982068 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b59255-858d-4d65-bb27-e6600fdd1d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:28.984130 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b59255-858d-4d65-bb27-e6600fdd1d01 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:29.002377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-31955861-dd95-49be-8115-0e05dbf587cb None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:29.004535 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-31955861-dd95-49be-8115-0e05dbf587cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:29.008276 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 799/1605] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:41:28 2022] POST /identity/v3/users => generated 287 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:29.009152 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b59255-858d-4d65-bb27-e6600fdd1d01 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:29.017091 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 807/1606] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:29.018322 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31955861-dd95-49be-8115-0e05dbf587cb None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:29.019624 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b59255-858d-4d65-bb27-e6600fdd1d01 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:29.025471 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b71786-f521-4bfb-b9e7-58d41f13efd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:29.025664 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b71786-f521-4bfb-b9e7-58d41f13efd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:29.025883 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b71786-f521-4bfb-b9e7-58d41f13efd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:29.026131 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b71786-f521-4bfb-b9e7-58d41f13efd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:29.026868 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b71786-f521-4bfb-b9e7-58d41f13efd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:29.028508 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b71786-f521-4bfb-b9e7-58d41f13efd1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:29.029075 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31955861-dd95-49be-8115-0e05dbf587cb None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:29.034179 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038e036-d4cb-45fc-b4c6-7f245cfbbb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:29.034820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038e036-d4cb-45fc-b4c6-7f245cfbbb1f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:29.035105 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038e036-d4cb-45fc-b4c6-7f245cfbbb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:29.035512 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038e036-d4cb-45fc-b4c6-7f245cfbbb1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:29.036278 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038e036-d4cb-45fc-b4c6-7f245cfbbb1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:29.038522 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038e036-d4cb-45fc-b4c6-7f245cfbbb1f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:29.041985 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 800/1607] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:29.042987 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b71786-f521-4bfb-b9e7-58d41f13efd1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:29.049930 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 808/1608] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:29.055088 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038e036-d4cb-45fc-b4c6-7f245cfbbb1f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:29.055526 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b71786-f521-4bfb-b9e7-58d41f13efd1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:29.060339 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d20f55-e22f-4416-abf1-1bc140ca6eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:29.061039 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d20f55-e22f-4416-abf1-1bc140ca6eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:29.061332 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d20f55-e22f-4416-abf1-1bc140ca6eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:29.061607 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d20f55-e22f-4416-abf1-1bc140ca6eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:29.062341 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d20f55-e22f-4416-abf1-1bc140ca6eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:29.063963 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d20f55-e22f-4416-abf1-1bc140ca6eb2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:29.065265 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038e036-d4cb-45fc-b4c6-7f245cfbbb1f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:29.071893 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb7b60-db70-41ab-ae52-ccecd5418344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:29.072683 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb7b60-db70-41ab-ae52-ccecd5418344 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:29.072822 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb7b60-db70-41ab-ae52-ccecd5418344 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:29.073081 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb7b60-db70-41ab-ae52-ccecd5418344 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:29.073812 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb7b60-db70-41ab-ae52-ccecd5418344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:29.074759 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 801/1609] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:29.075587 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb7b60-db70-41ab-ae52-ccecd5418344 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:29.078584 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d20f55-e22f-4416-abf1-1bc140ca6eb2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:29.091226 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 809/1610] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:29.091226 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb7b60-db70-41ab-ae52-ccecd5418344 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:29.091544 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d20f55-e22f-4416-abf1-1bc140ca6eb2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:29.094652 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34694f8f-9333-4ae4-a3eb-f03bd0736c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:29.095408 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34694f8f-9333-4ae4-a3eb-f03bd0736c76 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:29.095790 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34694f8f-9333-4ae4-a3eb-f03bd0736c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:29.096128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34694f8f-9333-4ae4-a3eb-f03bd0736c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:29.096947 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34694f8f-9333-4ae4-a3eb-f03bd0736c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:29.098654 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34694f8f-9333-4ae4-a3eb-f03bd0736c76 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:29.103005 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb7b60-db70-41ab-ae52-ccecd5418344 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:29.108329 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae666528-d033-4f6d-979f-07170d844f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:29.109093 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae666528-d033-4f6d-979f-07170d844f45 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:29.109447 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae666528-d033-4f6d-979f-07170d844f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:29.109796 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae666528-d033-4f6d-979f-07170d844f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:29.110514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 802/1611] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:29.110755 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae666528-d033-4f6d-979f-07170d844f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:29.112556 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae666528-d033-4f6d-979f-07170d844f45 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:29.114244 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34694f8f-9333-4ae4-a3eb-f03bd0736c76 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:29.125662 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 810/1612] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:29.126803 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae666528-d033-4f6d-979f-07170d844f45 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:29.139099 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae666528-d033-4f6d-979f-07170d844f45 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:29.143992 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad44e3-1bc8-4bc3-a9aa-6c528392cb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:29.145057 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad44e3-1bc8-4bc3-a9aa-6c528392cb31 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:29.145340 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad44e3-1bc8-4bc3-a9aa-6c528392cb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:29.145613 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad44e3-1bc8-4bc3-a9aa-6c528392cb31 admin admin] PATH_INFO: `/v3/projects/23325df6a88748fc9261e22c093ac67e/users/c858d129681846aba9e366c37c2213a0/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:29.172037 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad44e3-1bc8-4bc3-a9aa-6c528392cb31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23325df6a88748fc9261e22c093ac67e, user_id=c858d129681846aba9e366c37c2213a0, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:29.174812 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad44e3-1bc8-4bc3-a9aa-6c528392cb31 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:29.182264 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34694f8f-9333-4ae4-a3eb-f03bd0736c76 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:29.186660 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63944472-4147-4f02-81d8-cbc179204c0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:29.187611 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63944472-4147-4f02-81d8-cbc179204c0c service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:29.187924 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63944472-4147-4f02-81d8-cbc179204c0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:29.188201 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63944472-4147-4f02-81d8-cbc179204c0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:29.191399 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 811/1613] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:29 2022] PUT /identity/v3/projects/23325df6a88748fc9261e22c093ac67e/users/c858d129681846aba9e366c37c2213a0/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:29.192313 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad44e3-1bc8-4bc3-a9aa-6c528392cb31 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:29.202488 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63944472-4147-4f02-81d8-cbc179204c0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:29.203997 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63944472-4147-4f02-81d8-cbc179204c0c service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:29.214822 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 803/1614] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:29.216666 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63944472-4147-4f02-81d8-cbc179204c0c service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:29.235769 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63944472-4147-4f02-81d8-cbc179204c0c service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:29.275606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad44e3-1bc8-4bc3-a9aa-6c528392cb31 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:29.282037 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe987b61-d95c-496f-83b0-614b626f91ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:29.282933 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe987b61-d95c-496f-83b0-614b626f91ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:29.283889 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe987b61-d95c-496f-83b0-614b626f91ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:29.284188 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe987b61-d95c-496f-83b0-614b626f91ad admin admin] PATH_INFO: `/v3/projects/dbcf2a29fa234f62a1c82620e2c1cbcd/users/b846098f335a42e0892f7f35007ef234/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:29.311030 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe987b61-d95c-496f-83b0-614b626f91ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbcf2a29fa234f62a1c82620e2c1cbcd, user_id=b846098f335a42e0892f7f35007ef234, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:29.314981 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe987b61-d95c-496f-83b0-614b626f91ad admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:29.332326 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d7b23-3fdb-488d-9fb9-8fdcf36ebde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:29.333180 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d7b23-3fdb-488d-9fb9-8fdcf36ebde8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:29.333322 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d7b23-3fdb-488d-9fb9-8fdcf36ebde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:29.333526 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d7b23-3fdb-488d-9fb9-8fdcf36ebde8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:29.335670 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d7b23-3fdb-488d-9fb9-8fdcf36ebde8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:29.337534 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d7b23-3fdb-488d-9fb9-8fdcf36ebde8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:29.340086 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 812/1615] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:29 2022] PUT /identity/v3/projects/dbcf2a29fa234f62a1c82620e2c1cbcd/users/b846098f335a42e0892f7f35007ef234/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:29.341414 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe987b61-d95c-496f-83b0-614b626f91ad admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:29.351728 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 804/1616] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:29.351728 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d7b23-3fdb-488d-9fb9-8fdcf36ebde8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:29.360540 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d7b23-3fdb-488d-9fb9-8fdcf36ebde8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:29.426255 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e3f6c-a921-4dba-96c7-598965d66f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:29.427136 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e3f6c-a921-4dba-96c7-598965d66f20 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:29.428194 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e3f6c-a921-4dba-96c7-598965d66f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:29.428194 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e3f6c-a921-4dba-96c7-598965d66f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:29.429662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e3f6c-a921-4dba-96c7-598965d66f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:29.432340 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e3f6c-a921-4dba-96c7-598965d66f20 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:29.450864 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe987b61-d95c-496f-83b0-614b626f91ad admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:29.451941 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 805/1617] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:29.453729 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e3f6c-a921-4dba-96c7-598965d66f20 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:29.456753 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3a72a-a691-439c-9227-6d2f3e71c7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:29.457815 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3a72a-a691-439c-9227-6d2f3e71c7be admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:29.458202 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3a72a-a691-439c-9227-6d2f3e71c7be admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:29.458580 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3a72a-a691-439c-9227-6d2f3e71c7be admin admin] PATH_INFO: `/v3/projects/2085ae28d8ee44efab5818c68a793e14/users/ec84e81618b94475aef2fe0464c33b22/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:29.466241 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e3f6c-a921-4dba-96c7-598965d66f20 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:29.471997 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e5fd9-66fd-4f0f-95e1-525dd561a88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:29.472984 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e5fd9-66fd-4f0f-95e1-525dd561a88e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:29.473268 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e5fd9-66fd-4f0f-95e1-525dd561a88e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:29.473543 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e5fd9-66fd-4f0f-95e1-525dd561a88e admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:29.474572 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e5fd9-66fd-4f0f-95e1-525dd561a88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:29.477439 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e5fd9-66fd-4f0f-95e1-525dd561a88e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:29.479204 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3a72a-a691-439c-9227-6d2f3e71c7be admin admin] RBAC: Authorizing `identity:create_grant(project_id=2085ae28d8ee44efab5818c68a793e14, user_id=ec84e81618b94475aef2fe0464c33b22, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:29.482862 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3a72a-a691-439c-9227-6d2f3e71c7be admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:29.488576 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 806/1618] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:29.490005 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fbb3d-6767-4fae-a3dc-65b1f9cad303 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:29.490337 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fbb3d-6767-4fae-a3dc-65b1f9cad303 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:29.490616 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fbb3d-6767-4fae-a3dc-65b1f9cad303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:29.516019 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 813/1619] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:29 2022] PUT /identity/v3/projects/2085ae28d8ee44efab5818c68a793e14/users/ec84e81618b94475aef2fe0464c33b22/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:29.517813 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2f630-02d6-4a39-836f-e92b85ea210f None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:29.518151 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2f630-02d6-4a39-836f-e92b85ea210f None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:29.518505 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2f630-02d6-4a39-836f-e92b85ea210f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:29.525190 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-519fbb3d-6767-4fae-a3dc-65b1f9cad303 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:29.526953 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-519fbb3d-6767-4fae-a3dc-65b1f9cad303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:29.567433 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-e2d2f630-02d6-4a39-836f-e92b85ea210f None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:29.567433 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-e2d2f630-02d6-4a39-836f-e92b85ea210f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:29.661336 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 807/1620] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:29.663906 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fbb3d-6767-4fae-a3dc-65b1f9cad303 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:29.672614 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 814/1621] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:29.673379 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2f630-02d6-4a39-836f-e92b85ea210f None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:29.690827 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2f630-02d6-4a39-836f-e92b85ea210f None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:29.696714 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271c2a2-ef98-4d6d-b808-5949048395a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:29.697417 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fbb3d-6767-4fae-a3dc-65b1f9cad303 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:29.697692 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271c2a2-ef98-4d6d-b808-5949048395a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:29.697979 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271c2a2-ef98-4d6d-b808-5949048395a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:29.698257 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271c2a2-ef98-4d6d-b808-5949048395a8 admin admin] PATH_INFO: `/v3/projects/a2e3a4b655af4a4b97d0a2a9c3601283/users/10c4108237464a5c8ebc86be2a86936e/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:29.709962 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19957c-6d9e-46c1-bc6d-802aff4d9f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:29.711363 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19957c-6d9e-46c1-bc6d-802aff4d9f2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:29.712239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19957c-6d9e-46c1-bc6d-802aff4d9f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:29.712886 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19957c-6d9e-46c1-bc6d-802aff4d9f2d admin admin] PATH_INFO: `/v3/projects/83b561fd8da94cdd9e7e14ec558c63de/users/672797952598404abf11364c19fbe549/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:29.714706 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271c2a2-ef98-4d6d-b808-5949048395a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e3a4b655af4a4b97d0a2a9c3601283, user_id=10c4108237464a5c8ebc86be2a86936e, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:29.717536 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271c2a2-ef98-4d6d-b808-5949048395a8 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:29.731100 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19957c-6d9e-46c1-bc6d-802aff4d9f2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b561fd8da94cdd9e7e14ec558c63de, user_id=672797952598404abf11364c19fbe549, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:29.732447 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 815/1622] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:29 2022] PUT /identity/v3/projects/a2e3a4b655af4a4b97d0a2a9c3601283/users/10c4108237464a5c8ebc86be2a86936e/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:29.733326 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271c2a2-ef98-4d6d-b808-5949048395a8 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:29.738280 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19957c-6d9e-46c1-bc6d-802aff4d9f2d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:29.759980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 808/1623] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:29 2022] PUT /identity/v3/projects/83b561fd8da94cdd9e7e14ec558c63de/users/672797952598404abf11364c19fbe549/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:29.761384 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96674f-0ac4-4f4f-a7b1-f6c476765f3d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:29.761675 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96674f-0ac4-4f4f-a7b1-f6c476765f3d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:29.761963 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96674f-0ac4-4f4f-a7b1-f6c476765f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:29.805611 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2a96674f-0ac4-4f4f-a7b1-f6c476765f3d None None] MFA Rules not processed for user `ec84e81618b94475aef2fe0464c33b22`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:29.808443 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2a96674f-0ac4-4f4f-a7b1-f6c476765f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:29.856793 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271c2a2-ef98-4d6d-b808-5949048395a8 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:29.883107 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 809/1624] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:29 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:29.883999 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96674f-0ac4-4f4f-a7b1-f6c476765f3d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:29.931319 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945ee53-53c5-4944-8282-6fcafe169b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:29.932974 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945ee53-53c5-4944-8282-6fcafe169b5e admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:29.933445 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945ee53-53c5-4944-8282-6fcafe169b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:29.933713 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945ee53-53c5-4944-8282-6fcafe169b5e admin admin] PATH_INFO: `/v3/projects/d3a15648d20643ce864338037c9ec67d/users/32e8605de1074074a00142f348f38814/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:29.947175 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96674f-0ac4-4f4f-a7b1-f6c476765f3d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:29.951582 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521e536-5540-4ce4-9a6a-aa716f713153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:29.952319 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945ee53-53c5-4944-8282-6fcafe169b5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a15648d20643ce864338037c9ec67d, user_id=32e8605de1074074a00142f348f38814, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:29.952464 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521e536-5540-4ce4-9a6a-aa716f713153 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:29.952739 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521e536-5540-4ce4-9a6a-aa716f713153 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:29.953079 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521e536-5540-4ce4-9a6a-aa716f713153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:29.956211 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945ee53-53c5-4944-8282-6fcafe169b5e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:29.964239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521e536-5540-4ce4-9a6a-aa716f713153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:29.965935 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521e536-5540-4ce4-9a6a-aa716f713153 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:29.971618 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 816/1625] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:29 2022] PUT /identity/v3/projects/d3a15648d20643ce864338037c9ec67d/users/32e8605de1074074a00142f348f38814/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:29.972601 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945ee53-53c5-4944-8282-6fcafe169b5e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:29.984617 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 810/1626] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:29.986588 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69af02a-b986-419b-9b3c-02866c75c788 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:29.987249 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69af02a-b986-419b-9b3c-02866c75c788 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:29.987792 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69af02a-b986-419b-9b3c-02866c75c788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:30.036961 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e69af02a-b986-419b-9b3c-02866c75c788 None None] MFA Rules not processed for user `10c4108237464a5c8ebc86be2a86936e`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:30.039299 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e69af02a-b986-419b-9b3c-02866c75c788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:30.072865 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945ee53-53c5-4944-8282-6fcafe169b5e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:30.077319 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6e9a7-2693-4366-affa-57f65c95ceaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:30.077973 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6e9a7-2693-4366-affa-57f65c95ceaf service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:30.078258 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6e9a7-2693-4366-affa-57f65c95ceaf service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:30.078536 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6e9a7-2693-4366-affa-57f65c95ceaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:30.143094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 811/1627] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:30.143094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae4328-7c7b-4eec-be76-e2443bd33816 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:30.143094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae4328-7c7b-4eec-be76-e2443bd33816 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:30.143094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae4328-7c7b-4eec-be76-e2443bd33816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:30.170721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6e9a7-2693-4366-affa-57f65c95ceaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:30.172638 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6e9a7-2693-4366-affa-57f65c95ceaf service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:30.187745 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 817/1628] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:30.188951 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6e9a7-2693-4366-affa-57f65c95ceaf service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:30.202344 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-27ae4328-7c7b-4eec-be76-e2443bd33816 None None] MFA Rules not processed for user `672797952598404abf11364c19fbe549`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:30.202713 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6e9a7-2693-4366-affa-57f65c95ceaf service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:30.205733 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-27ae4328-7c7b-4eec-be76-e2443bd33816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:30.209785 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5f9ca-e0c4-4260-a185-0d054d5f6991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:30.210764 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5f9ca-e0c4-4260-a185-0d054d5f6991 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:30.211993 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5f9ca-e0c4-4260-a185-0d054d5f6991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:30.212599 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5f9ca-e0c4-4260-a185-0d054d5f6991 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:30.214429 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5f9ca-e0c4-4260-a185-0d054d5f6991 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:30.217910 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5f9ca-e0c4-4260-a185-0d054d5f6991 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:30.272835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 818/1629] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:41:30 2022] POST /identity/v3/projects => generated 403 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:30.272835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8bc9c-f710-42cb-b171-2619c4e2a2d5 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:30.272835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8bc9c-f710-42cb-b171-2619c4e2a2d5 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:30.272835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8bc9c-f710-42cb-b171-2619c4e2a2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:30.321965 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 812/1630] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:30.321965 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a695bb-0891-4871-b919-cbdff8397cbb None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:30.321965 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a695bb-0891-4871-b919-cbdff8397cbb None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:30.321965 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a695bb-0891-4871-b919-cbdff8397cbb None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:30.323631 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-f0a8bc9c-f710-42cb-b171-2619c4e2a2d5 None None] MFA Rules not processed for user `32e8605de1074074a00142f348f38814`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:30.325443 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-f0a8bc9c-f710-42cb-b171-2619c4e2a2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:30.327911 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 813/1631] 10.222.0.35 () {54 vars in 961 bytes} [Tue Feb 8 16:41:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:41:30.329226 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a695bb-0891-4871-b919-cbdff8397cbb None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:30.431149 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a695bb-0891-4871-b919-cbdff8397cbb None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:30.437647 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e2ab1-0992-4cee-8ac8-dd757417786d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:30.438873 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e2ab1-0992-4cee-8ac8-dd757417786d admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:30.439909 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e2ab1-0992-4cee-8ac8-dd757417786d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:30.440430 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e2ab1-0992-4cee-8ac8-dd757417786d admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:30.442014 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e2ab1-0992-4cee-8ac8-dd757417786d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:30.447506 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e2ab1-0992-4cee-8ac8-dd757417786d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:30.476159 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 819/1632] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:30.477151 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8bc9c-f710-42cb-b171-2619c4e2a2d5 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:30.491661 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8bc9c-f710-42cb-b171-2619c4e2a2d5 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:30.497296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 814/1633] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:41:30 2022] POST /identity/v3/users => generated 308 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:30.501848 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4b618-999d-4f8d-bc80-b4294eaaf603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:30.503219 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4b618-999d-4f8d-bc80-b4294eaaf603 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:30.503522 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4b618-999d-4f8d-bc80-b4294eaaf603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:30.503935 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4b618-999d-4f8d-bc80-b4294eaaf603 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:30.504429 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb8ffc-1aa2-445a-831b-d17d0079a459 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:30.505089 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4b618-999d-4f8d-bc80-b4294eaaf603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:30.505622 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb8ffc-1aa2-445a-831b-d17d0079a459 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:30.507214 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb8ffc-1aa2-445a-831b-d17d0079a459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:30.508191 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4b618-999d-4f8d-bc80-b4294eaaf603 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:30.547940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 820/1634] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:41:30 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:30.547940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4b618-999d-4f8d-bc80-b4294eaaf603 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:30.564715 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-3bdb8ffc-1aa2-445a-831b-d17d0079a459 None None] MFA Rules not processed for user `ccb02e5d8ef14f8f85bbacfa5b1f5be3`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:30.566342 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3bdb8ffc-1aa2-445a-831b-d17d0079a459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:30.656937 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4b618-999d-4f8d-bc80-b4294eaaf603 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:30.665563 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f30e21-2b6d-44b1-a4bb-273fb88d5da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:30.666307 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f30e21-2b6d-44b1-a4bb-273fb88d5da8 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:30.666695 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f30e21-2b6d-44b1-a4bb-273fb88d5da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:30.666932 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f30e21-2b6d-44b1-a4bb-273fb88d5da8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:30.667828 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f30e21-2b6d-44b1-a4bb-273fb88d5da8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:30.670726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f30e21-2b6d-44b1-a4bb-273fb88d5da8 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:30.700994 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 815/1635] 10.222.0.35 () {58 vars in 1058 bytes} [Tue Feb 8 16:41:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:30.702421 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb8ffc-1aa2-445a-831b-d17d0079a459 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:30.715533 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb8ffc-1aa2-445a-831b-d17d0079a459 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:30.720588 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 821/1636] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:41:30 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:30.722977 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f30e21-2b6d-44b1-a4bb-273fb88d5da8 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:30.727158 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa73983-208e-4a18-bef0-ea7abf97626e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:30.729036 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa73983-208e-4a18-bef0-ea7abf97626e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:30.732997 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa73983-208e-4a18-bef0-ea7abf97626e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:30.733443 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa73983-208e-4a18-bef0-ea7abf97626e admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:30.734878 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa73983-208e-4a18-bef0-ea7abf97626e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:30.737552 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa73983-208e-4a18-bef0-ea7abf97626e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:30.755064 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 816/1637] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:30.755064 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa73983-208e-4a18-bef0-ea7abf97626e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:30.776520 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa73983-208e-4a18-bef0-ea7abf97626e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:30.832748 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f30e21-2b6d-44b1-a4bb-273fb88d5da8 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:30.838668 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7857e6-dca0-43d2-97b5-ed72ef54702f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:30.839431 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7857e6-dca0-43d2-97b5-ed72ef54702f admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:30.840120 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7857e6-dca0-43d2-97b5-ed72ef54702f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:30.840583 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7857e6-dca0-43d2-97b5-ed72ef54702f admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:30.841365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7857e6-dca0-43d2-97b5-ed72ef54702f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:30.843554 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7857e6-dca0-43d2-97b5-ed72ef54702f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:30.871822 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 822/1638] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:41:30 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:30.872846 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7857e6-dca0-43d2-97b5-ed72ef54702f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:30.883941 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b6efc-fd39-4da8-908a-563278e0a875 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:30.884727 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b6efc-fd39-4da8-908a-563278e0a875 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:30.885052 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7857e6-dca0-43d2-97b5-ed72ef54702f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:30.885172 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b6efc-fd39-4da8-908a-563278e0a875 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:30.886290 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b6efc-fd39-4da8-908a-563278e0a875 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:30.890206 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251e0ab-d205-4612-8fc9-7fa0efea88c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:30.891023 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251e0ab-d205-4612-8fc9-7fa0efea88c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:30.891951 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251e0ab-d205-4612-8fc9-7fa0efea88c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:30.892240 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251e0ab-d205-4612-8fc9-7fa0efea88c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:30.893474 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251e0ab-d205-4612-8fc9-7fa0efea88c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:30.895681 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251e0ab-d205-4612-8fc9-7fa0efea88c6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:30.924018 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 823/1639] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:41:30 2022] POST /identity/v3/users => generated 292 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:30.925116 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251e0ab-d205-4612-8fc9-7fa0efea88c6 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:30.942823 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251e0ab-d205-4612-8fc9-7fa0efea88c6 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:30.953174 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8288f-d134-41bf-be7b-26597670bce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:30.954721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8288f-d134-41bf-be7b-26597670bce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:30.955166 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8288f-d134-41bf-be7b-26597670bce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:30.955620 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8288f-d134-41bf-be7b-26597670bce0 admin admin] PATH_INFO: `/v3/projects/0373d726ed714c9784d009fbab396d88/users/ba874a85026947cea36183208857612f/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:30.969194 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b6efc-fd39-4da8-908a-563278e0a875 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:30.972031 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b6efc-fd39-4da8-908a-563278e0a875 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:30.983816 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8288f-d134-41bf-be7b-26597670bce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0373d726ed714c9784d009fbab396d88, user_id=ba874a85026947cea36183208857612f, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:30.984552 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8288f-d134-41bf-be7b-26597670bce0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:30.985740 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 817/1640] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:30.986800 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b6efc-fd39-4da8-908a-563278e0a875 service nova] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:31.007945 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b6efc-fd39-4da8-908a-563278e0a875 service nova] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:31.021091 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1a042-ea27-4457-8e3d-d54d7e4b09b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:31.022447 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1a042-ea27-4457-8e3d-d54d7e4b09b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:31.022796 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1a042-ea27-4457-8e3d-d54d7e4b09b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:31.023153 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1a042-ea27-4457-8e3d-d54d7e4b09b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:31.024392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1a042-ea27-4457-8e3d-d54d7e4b09b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:31.026840 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1a042-ea27-4457-8e3d-d54d7e4b09b3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:31.029725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 824/1641] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:30 2022] PUT /identity/v3/projects/0373d726ed714c9784d009fbab396d88/users/ba874a85026947cea36183208857612f/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:31.036653 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8288f-d134-41bf-be7b-26597670bce0 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:31.044659 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 818/1642] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:31.047336 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1a042-ea27-4457-8e3d-d54d7e4b09b3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:31.068756 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1a042-ea27-4457-8e3d-d54d7e4b09b3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:31.154372 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8288f-d134-41bf-be7b-26597670bce0 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:31.161359 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774401ba-ce2a-4437-9c17-fa9b75c1d120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:31.162047 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774401ba-ce2a-4437-9c17-fa9b75c1d120 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:31.162480 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774401ba-ce2a-4437-9c17-fa9b75c1d120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:31.162819 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774401ba-ce2a-4437-9c17-fa9b75c1d120 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:31.163643 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774401ba-ce2a-4437-9c17-fa9b75c1d120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:31.165865 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774401ba-ce2a-4437-9c17-fa9b75c1d120 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:31.182333 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 825/1643] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:31.183423 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774401ba-ce2a-4437-9c17-fa9b75c1d120 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:31.196687 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774401ba-ce2a-4437-9c17-fa9b75c1d120 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:31.202057 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f07922-40b5-4cc4-a2cc-2d0c8ce3b611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:31.202204 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e65888-d019-44fb-851c-4aca431c4ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:31.202820 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e65888-d019-44fb-851c-4aca431c4ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:31.202948 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f07922-40b5-4cc4-a2cc-2d0c8ce3b611 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:31.203121 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e65888-d019-44fb-851c-4aca431c4ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:31.203229 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f07922-40b5-4cc4-a2cc-2d0c8ce3b611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:31.203393 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e65888-d019-44fb-851c-4aca431c4ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:31.203498 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f07922-40b5-4cc4-a2cc-2d0c8ce3b611 admin admin] PATH_INFO: `/v3/projects/c2d6747d54bc48eb83c75e0e4a9803a4/users/589b569e26e8481195ee90538c2cc81d/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:31.206517 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e65888-d019-44fb-851c-4aca431c4ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:31.209026 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e65888-d019-44fb-851c-4aca431c4ee3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:31.220981 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f07922-40b5-4cc4-a2cc-2d0c8ce3b611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d6747d54bc48eb83c75e0e4a9803a4, user_id=589b569e26e8481195ee90538c2cc81d, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:31.224111 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f07922-40b5-4cc4-a2cc-2d0c8ce3b611 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:31.237023 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 819/1644] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:31.238062 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e65888-d019-44fb-851c-4aca431c4ee3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:31.252536 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 826/1645] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:31 2022] PUT /identity/v3/projects/c2d6747d54bc48eb83c75e0e4a9803a4/users/589b569e26e8481195ee90538c2cc81d/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:31.255449 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e65888-d019-44fb-851c-4aca431c4ee3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:31.255686 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f07922-40b5-4cc4-a2cc-2d0c8ce3b611 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:31.337584 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d0c8d-0393-4143-8ef7-6bcf02d56869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:31.338710 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d0c8d-0393-4143-8ef7-6bcf02d56869 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:31.339048 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d0c8d-0393-4143-8ef7-6bcf02d56869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:31.339332 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d0c8d-0393-4143-8ef7-6bcf02d56869 admin admin] PATH_INFO: `/v3/projects/1b2d519dbc004a46a1a2e5d91d06c9f5/users/c76a792d59984856ae801fc087558198/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:31.382033 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d0c8d-0393-4143-8ef7-6bcf02d56869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2d519dbc004a46a1a2e5d91d06c9f5, user_id=c76a792d59984856ae801fc087558198, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:31.384763 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d0c8d-0393-4143-8ef7-6bcf02d56869 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:31.408858 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 820/1646] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:31 2022] PUT /identity/v3/projects/1b2d519dbc004a46a1a2e5d91d06c9f5/users/c76a792d59984856ae801fc087558198/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:31.410748 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d0c8d-0393-4143-8ef7-6bcf02d56869 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:31.420051 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f07922-40b5-4cc4-a2cc-2d0c8ce3b611 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:31.509954 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d0c8d-0393-4143-8ef7-6bcf02d56869 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:31.517309 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aaa6b5-1a6a-45b0-83d0-1d86f9c538bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:31.518219 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aaa6b5-1a6a-45b0-83d0-1d86f9c538bb admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:31.518510 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aaa6b5-1a6a-45b0-83d0-1d86f9c538bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:31.518796 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aaa6b5-1a6a-45b0-83d0-1d86f9c538bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:31.519656 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aaa6b5-1a6a-45b0-83d0-1d86f9c538bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:31.520176 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1d054-c049-405b-948f-f83679a0011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:31.521072 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1d054-c049-405b-948f-f83679a0011b admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:31.521357 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1d054-c049-405b-948f-f83679a0011b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:31.522112 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aaa6b5-1a6a-45b0-83d0-1d86f9c538bb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:31.522220 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1d054-c049-405b-948f-f83679a0011b admin admin] PATH_INFO: `/v3/projects/0373d726ed714c9784d009fbab396d88/users/ba874a85026947cea36183208857612f/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:31.525167 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1d054-c049-405b-948f-f83679a0011b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0373d726ed714c9784d009fbab396d88, user_id=ba874a85026947cea36183208857612f, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:31.528024 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1d054-c049-405b-948f-f83679a0011b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:31.540232 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 821/1647] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:31.540232 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aaa6b5-1a6a-45b0-83d0-1d86f9c538bb admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:31.552589 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 827/1648] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:31 2022] PUT /identity/v3/projects/0373d726ed714c9784d009fbab396d88/users/ba874a85026947cea36183208857612f/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:31.553568 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aaa6b5-1a6a-45b0-83d0-1d86f9c538bb admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:31.555367 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b85065-4aef-4f3e-a287-d7e4f1e54dd1 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:31.556043 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b85065-4aef-4f3e-a287-d7e4f1e54dd1 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:31.556434 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b85065-4aef-4f3e-a287-d7e4f1e54dd1 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:31.566153 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 828/1649] 10.222.0.35 () {54 vars in 912 bytes} [Tue Feb 8 16:41:31 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:41:31.567333 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b85065-4aef-4f3e-a287-d7e4f1e54dd1 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:31.665348 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b85065-4aef-4f3e-a287-d7e4f1e54dd1 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:31.679343 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba276978-7ff2-40b4-827e-a61a7165e7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:31.680452 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba276978-7ff2-40b4-827e-a61a7165e7f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:31.680855 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba276978-7ff2-40b4-827e-a61a7165e7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:31.681232 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba276978-7ff2-40b4-827e-a61a7165e7f7 admin admin] PATH_INFO: `/v3/projects/c2d6747d54bc48eb83c75e0e4a9803a4/users/589b569e26e8481195ee90538c2cc81d/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:31.687292 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba276978-7ff2-40b4-827e-a61a7165e7f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d6747d54bc48eb83c75e0e4a9803a4, user_id=589b569e26e8481195ee90538c2cc81d, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:31.690613 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba276978-7ff2-40b4-827e-a61a7165e7f7 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:31.692744 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8985b09-569c-4671-8989-5c6a87ae7183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:31.694324 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8985b09-569c-4671-8989-5c6a87ae7183 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:31.694553 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8985b09-569c-4671-8989-5c6a87ae7183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:31.694832 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8985b09-569c-4671-8989-5c6a87ae7183 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:31.695919 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8985b09-569c-4671-8989-5c6a87ae7183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:31.698511 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8985b09-569c-4671-8989-5c6a87ae7183 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:31.712369 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 829/1650] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:31 2022] PUT /identity/v3/projects/c2d6747d54bc48eb83c75e0e4a9803a4/users/589b569e26e8481195ee90538c2cc81d/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:31.712369 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a676c1-9d8a-4aea-a352-e238c9da7a38 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:31.712369 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a676c1-9d8a-4aea-a352-e238c9da7a38 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:31.712369 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a676c1-9d8a-4aea-a352-e238c9da7a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:31.712796 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 822/1651] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:31.714153 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02efb7-5725-4607-892e-6d7277847d2b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:31.714548 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02efb7-5725-4607-892e-6d7277847d2b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:31.715029 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02efb7-5725-4607-892e-6d7277847d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:31.748702 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ea02efb7-5725-4607-892e-6d7277847d2b None None] MFA Rules not processed for user `ccb02e5d8ef14f8f85bbacfa5b1f5be3`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:31.749281 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ea02efb7-5725-4607-892e-6d7277847d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:31.758551 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-38a676c1-9d8a-4aea-a352-e238c9da7a38 None None] MFA Rules not processed for user `ba874a85026947cea36183208857612f`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:31.760353 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-38a676c1-9d8a-4aea-a352-e238c9da7a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:31.844936 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 823/1652] 10.222.0.35 () {58 vars in 1009 bytes} [Tue Feb 8 16:41:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:31.846257 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44f5cf-977e-48cb-bac4-29294abe0c26 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:31.846814 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44f5cf-977e-48cb-bac4-29294abe0c26 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:31.847100 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44f5cf-977e-48cb-bac4-29294abe0c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:31.891269 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ab44f5cf-977e-48cb-bac4-29294abe0c26 None None] MFA Rules not processed for user `589b569e26e8481195ee90538c2cc81d`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:31.891269 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ab44f5cf-977e-48cb-bac4-29294abe0c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:31.893030 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 830/1653] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:31 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:31.894928 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a676c1-9d8a-4aea-a352-e238c9da7a38 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:32.027210 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a676c1-9d8a-4aea-a352-e238c9da7a38 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:32.040717 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d157c-ad8b-460e-97c2-00ffd709ef02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:32.040717 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d157c-ad8b-460e-97c2-00ffd709ef02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:32.040717 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d157c-ad8b-460e-97c2-00ffd709ef02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:32.040717 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d157c-ad8b-460e-97c2-00ffd709ef02 admin admin] PATH_INFO: `/v3/projects/1b2d519dbc004a46a1a2e5d91d06c9f5/users/c76a792d59984856ae801fc087558198/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:32.043338 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d157c-ad8b-460e-97c2-00ffd709ef02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2d519dbc004a46a1a2e5d91d06c9f5, user_id=c76a792d59984856ae801fc087558198, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:32.048812 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d157c-ad8b-460e-97c2-00ffd709ef02 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:32.091723 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 831/1654] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:31 2022] PUT /identity/v3/projects/1b2d519dbc004a46a1a2e5d91d06c9f5/users/c76a792d59984856ae801fc087558198/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:32.094425 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d157c-ad8b-460e-97c2-00ffd709ef02 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:32.108942 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 824/1655] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:32.110380 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44f5cf-977e-48cb-bac4-29294abe0c26 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:32.230287 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d157c-ad8b-460e-97c2-00ffd709ef02 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:32.235594 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516dbcd-1d20-45b9-98f8-32fff1730748 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:32.236425 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516dbcd-1d20-45b9-98f8-32fff1730748 service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:32.236717 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516dbcd-1d20-45b9-98f8-32fff1730748 service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:32.236995 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516dbcd-1d20-45b9-98f8-32fff1730748 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:32.353226 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44f5cf-977e-48cb-bac4-29294abe0c26 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:32.370196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3429540-5465-4653-9de0-edf6baa84b34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:32.370860 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3429540-5465-4653-9de0-edf6baa84b34 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:32.371137 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3429540-5465-4653-9de0-edf6baa84b34 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:32.371409 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3429540-5465-4653-9de0-edf6baa84b34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:32.435185 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516dbcd-1d20-45b9-98f8-32fff1730748 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:32.436689 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516dbcd-1d20-45b9-98f8-32fff1730748 service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:32.467364 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 832/1656] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:32.468805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f2367-7525-482f-9c09-5a8b2617801b None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:32.469096 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f2367-7525-482f-9c09-5a8b2617801b None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:32.473387 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f2367-7525-482f-9c09-5a8b2617801b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:32.554185 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-d27f2367-7525-482f-9c09-5a8b2617801b None None] MFA Rules not processed for user `c76a792d59984856ae801fc087558198`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:32.555418 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d27f2367-7525-482f-9c09-5a8b2617801b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:32.580894 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3429540-5465-4653-9de0-edf6baa84b34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:32.582533 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3429540-5465-4653-9de0-edf6baa84b34 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:32.607376 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 825/1657] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:32 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:32.608809 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbdd8b-8cd3-4380-aadb-22d6e1631092 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:32.609102 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbdd8b-8cd3-4380-aadb-22d6e1631092 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:32.609378 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbdd8b-8cd3-4380-aadb-22d6e1631092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:32.675246 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2ffbdd8b-8cd3-4380-aadb-22d6e1631092 None None] MFA Rules not processed for user `b846098f335a42e0892f7f35007ef234`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:32.676630 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2ffbdd8b-8cd3-4380-aadb-22d6e1631092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:32.710133 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 833/1658] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:32 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:32.773880 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f2367-7525-482f-9c09-5a8b2617801b None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:32.785374 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f2367-7525-482f-9c09-5a8b2617801b None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:32.800371 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1f504-2c82-4a4e-a525-5386280a40e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:32.801053 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1f504-2c82-4a4e-a525-5386280a40e2 service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:32.801488 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1f504-2c82-4a4e-a525-5386280a40e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:32.801779 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1f504-2c82-4a4e-a525-5386280a40e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:32.848199 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 826/1659] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:32.859105 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005482f-6ef9-464d-9128-e970233fa9d9 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:32.860120 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005482f-6ef9-464d-9128-e970233fa9d9 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:32.860120 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005482f-6ef9-464d-9128-e970233fa9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:32.895993 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d005482f-6ef9-464d-9128-e970233fa9d9 None None] MFA Rules not processed for user `b846098f335a42e0892f7f35007ef234`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:32.900871 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d005482f-6ef9-464d-9128-e970233fa9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:32.925334 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 827/1660] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:32.935394 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1f504-2c82-4a4e-a525-5386280a40e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:32.937050 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1f504-2c82-4a4e-a525-5386280a40e2 service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:32.941973 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfc11f-a8e7-43b6-89e1-5d4ff945717a None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:32.942347 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfc11f-a8e7-43b6-89e1-5d4ff945717a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:32.942695 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfc11f-a8e7-43b6-89e1-5d4ff945717a None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:32.944798 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 828/1661] 10.222.0.35 () {54 vars in 961 bytes} [Tue Feb 8 16:41:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:41:32.951262 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e23a8f-dae9-4997-89bb-d17131edf699 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:32.951725 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e23a8f-dae9-4997-89bb-d17131edf699 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:32.952140 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e23a8f-dae9-4997-89bb-d17131edf699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:32.954297 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 834/1662] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:32.975548 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d7e23a8f-dae9-4997-89bb-d17131edf699 None None] MFA Rules not processed for user `ccb02e5d8ef14f8f85bbacfa5b1f5be3`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:32.977055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d7e23a8f-dae9-4997-89bb-d17131edf699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:32.999424 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1f504-2c82-4a4e-a525-5386280a40e2 service cinder] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:33.012850 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 829/1663] 10.222.0.35 () {58 vars in 1058 bytes} [Tue Feb 8 16:41:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:41:33.016275 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1f504-2c82-4a4e-a525-5386280a40e2 service cinder] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:33.023318 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558efeaf-e163-406a-b905-2689aee24b6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:33.024021 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558efeaf-e163-406a-b905-2689aee24b6b service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:33.024304 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558efeaf-e163-406a-b905-2689aee24b6b service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:33.024583 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558efeaf-e163-406a-b905-2689aee24b6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:33.034110 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558efeaf-e163-406a-b905-2689aee24b6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:33.035676 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558efeaf-e163-406a-b905-2689aee24b6b service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:33.057868 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 835/1664] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:33.097311 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e23a8f-dae9-4997-89bb-d17131edf699 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:33.108229 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e23a8f-dae9-4997-89bb-d17131edf699 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:33.118711 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4debc7-0e81-4f9a-81d7-60d10728eb23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:33.119474 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4debc7-0e81-4f9a-81d7-60d10728eb23 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:33.119778 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4debc7-0e81-4f9a-81d7-60d10728eb23 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:33.120075 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4debc7-0e81-4f9a-81d7-60d10728eb23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:33.146134 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4debc7-0e81-4f9a-81d7-60d10728eb23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:33.165732 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4debc7-0e81-4f9a-81d7-60d10728eb23 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:33.194856 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 830/1665] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:33 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:33.533713 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558efeaf-e163-406a-b905-2689aee24b6b service nova] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:33.543599 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558efeaf-e163-406a-b905-2689aee24b6b service nova] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:33.561528 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfafd4-e2ec-46db-82b5-ceed37af35f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:33.562206 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfafd4-e2ec-46db-82b5-ceed37af35f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:33.562686 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfafd4-e2ec-46db-82b5-ceed37af35f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:33.562973 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfafd4-e2ec-46db-82b5-ceed37af35f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:33.659353 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4debc7-0e81-4f9a-81d7-60d10728eb23 service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:33.670950 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4debc7-0e81-4f9a-81d7-60d10728eb23 service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:33.691104 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdaabee-1ac7-4775-8b37-b25ad2b1c385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:33.691787 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdaabee-1ac7-4775-8b37-b25ad2b1c385 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:33.694571 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdaabee-1ac7-4775-8b37-b25ad2b1c385 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:33.694946 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdaabee-1ac7-4775-8b37-b25ad2b1c385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:33.779828 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfafd4-e2ec-46db-82b5-ceed37af35f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:33.781456 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfafd4-e2ec-46db-82b5-ceed37af35f8 service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:33.797272 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 836/1666] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:33.798725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752caee-6212-4539-9c4a-7cdfd5cb5daa None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:33.799013 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752caee-6212-4539-9c4a-7cdfd5cb5daa None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:33.799295 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752caee-6212-4539-9c4a-7cdfd5cb5daa None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:33.806840 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 837/1667] 10.222.0.35 () {54 vars in 912 bytes} [Tue Feb 8 16:41:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:41:33.808226 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54238db-efb9-4c55-a188-b25a789dad60 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:33.808522 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54238db-efb9-4c55-a188-b25a789dad60 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:33.808803 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54238db-efb9-4c55-a188-b25a789dad60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:33.828538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-a54238db-efb9-4c55-a188-b25a789dad60 None None] MFA Rules not processed for user `ccb02e5d8ef14f8f85bbacfa5b1f5be3`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:33.829752 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a54238db-efb9-4c55-a188-b25a789dad60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:33.842490 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdaabee-1ac7-4775-8b37-b25ad2b1c385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:33.845987 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 838/1668] 10.222.0.35 () {58 vars in 1009 bytes} [Tue Feb 8 16:41:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:33.849552 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdaabee-1ac7-4775-8b37-b25ad2b1c385 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:33.855121 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54238db-efb9-4c55-a188-b25a789dad60 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:33.857514 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a54238db-efb9-4c55-a188-b25a789dad60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:33.882870 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 831/1669] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:34.017995 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54238db-efb9-4c55-a188-b25a789dad60 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:34.027538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e5e63-5102-4409-94d0-21a972f446f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10453496872a45a9867fc6a13a13de49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:34.029394 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e5e63-5102-4409-94d0-21a972f446f4 service glance] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:34.031079 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e5e63-5102-4409-94d0-21a972f446f4 service glance] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:34.032074 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e5e63-5102-4409-94d0-21a972f446f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:34.063268 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e5e63-5102-4409-94d0-21a972f446f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:34.071432 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e5e63-5102-4409-94d0-21a972f446f4 service glance] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:34.100693 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 839/1670] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:34.325566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdaabee-1ac7-4775-8b37-b25ad2b1c385 service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:34.516284 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdaabee-1ac7-4775-8b37-b25ad2b1c385 service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:34.525408 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85dad29-00b2-4cab-aec7-ad0d80ee622d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:34.526368 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dad29-00b2-4cab-aec7-ad0d80ee622d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:34.526654 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dad29-00b2-4cab-aec7-ad0d80ee622d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:34.526931 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dad29-00b2-4cab-aec7-ad0d80ee622d admin admin] PATH_INFO: `/v3/users/ec84e81618b94475aef2fe0464c33b22` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:34.529104 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85dad29-00b2-4cab-aec7-ad0d80ee622d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec84e81618b94475aef2fe0464c33b22)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:34.530138 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-a85dad29-00b2-4cab-aec7-ad0d80ee622d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:41:34.530138 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Feb 08 16:41:34.530138 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: Feb 08 16:41:34.531412 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85dad29-00b2-4cab-aec7-ad0d80ee622d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:34.629514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a85dad29-00b2-4cab-aec7-ad0d80ee622d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec84e81618b94475aef2fe0464c33b22'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:34.642743 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a85dad29-00b2-4cab-aec7-ad0d80ee622d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec84e81618b94475aef2fe0464c33b22'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:34.665807 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a85dad29-00b2-4cab-aec7-ad0d80ee622d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec84e81618b94475aef2fe0464c33b22'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:34.683658 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a85dad29-00b2-4cab-aec7-ad0d80ee622d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec84e81618b94475aef2fe0464c33b22'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:34.684689 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a85dad29-00b2-4cab-aec7-ad0d80ee622d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec84e81618b94475aef2fe0464c33b22'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:34.693206 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 832/1671] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:41:34 2022] DELETE /identity/v3/users/ec84e81618b94475aef2fe0464c33b22 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:34.698792 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c7172-8731-4a58-8861-e0f2f8084daa None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:34.699213 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c7172-8731-4a58-8861-e0f2f8084daa None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:34.699604 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c7172-8731-4a58-8861-e0f2f8084daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:34.719393 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-334c7172-8731-4a58-8861-e0f2f8084daa None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:34.720985 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-334c7172-8731-4a58-8861-e0f2f8084daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:34.846997 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 840/1672] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:34.921427 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85dad29-00b2-4cab-aec7-ad0d80ee622d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:34.924407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a85dad29-00b2-4cab-aec7-ad0d80ee622d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:35.096761 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85dad29-00b2-4cab-aec7-ad0d80ee622d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:35.109703 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50df0ba-ab27-492a-b4dc-acf7753a3ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:35.110525 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50df0ba-ab27-492a-b4dc-acf7753a3ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:35.110809 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50df0ba-ab27-492a-b4dc-acf7753a3ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:35.111189 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50df0ba-ab27-492a-b4dc-acf7753a3ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:35.132782 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50df0ba-ab27-492a-b4dc-acf7753a3ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:35.135553 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50df0ba-ab27-492a-b4dc-acf7753a3ad3 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:35.153528 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 833/1673] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:35.212778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d5517-578e-449a-8103-d297ef140703 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:35.213300 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d5517-578e-449a-8103-d297ef140703 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:35.216568 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d5517-578e-449a-8103-d297ef140703 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:35.218759 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 841/1674] 10.222.0.35 () {54 vars in 912 bytes} [Tue Feb 8 16:41:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:41:35.226104 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991656e-7d35-40a8-849c-b15666ed223b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:35.226506 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991656e-7d35-40a8-849c-b15666ed223b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:35.227052 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991656e-7d35-40a8-849c-b15666ed223b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:35.357371 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e991656e-7d35-40a8-849c-b15666ed223b None None] MFA Rules not processed for user `0b936dc9a67846f08e51648e64c3d6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:35.358838 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e991656e-7d35-40a8-849c-b15666ed223b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:35.382438 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 834/1675] 10.222.0.35 () {58 vars in 1009 bytes} [Tue Feb 8 16:41:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:41:35.587781 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d5517-578e-449a-8103-d297ef140703 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:35.602654 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d5517-578e-449a-8103-d297ef140703 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:35.634436 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c308b-65f4-46d8-8429-4dc1d9197e93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:35.635414 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c308b-65f4-46d8-8429-4dc1d9197e93 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:35.635895 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c308b-65f4-46d8-8429-4dc1d9197e93 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:35.636340 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c308b-65f4-46d8-8429-4dc1d9197e93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:35.658039 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c308b-65f4-46d8-8429-4dc1d9197e93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:35.660445 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c308b-65f4-46d8-8429-4dc1d9197e93 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:35.697229 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 842/1676] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:37.737631 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8e1e6-f30b-430b-a9a9-593086c7b429 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:37.738217 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8e1e6-f30b-430b-a9a9-593086c7b429 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:37.738535 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8e1e6-f30b-430b-a9a9-593086c7b429 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:37.741764 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 835/1677] 10.222.0.35 () {54 vars in 960 bytes} [Tue Feb 8 16:41:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:41:37.748718 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5565016-3026-42cb-904e-67c005c6ec00 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:37.752534 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5565016-3026-42cb-904e-67c005c6ec00 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:37.753082 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5565016-3026-42cb-904e-67c005c6ec00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:37.761143 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee6e70-cdfe-45d2-aa14-df2918e98c18 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:37.761267 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee6e70-cdfe-45d2-aa14-df2918e98c18 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:37.762164 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee6e70-cdfe-45d2-aa14-df2918e98c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:37.818176 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-a5565016-3026-42cb-904e-67c005c6ec00 None None] MFA Rules not processed for user `75c8f232fc83474b8731ee6c1eb321fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:37.819425 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a5565016-3026-42cb-904e-67c005c6ec00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:37.867421 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-23ee6e70-cdfe-45d2-aa14-df2918e98c18 None None] MFA Rules not processed for user `21e3f764b9f34256bc91f08bc220c7c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:37.869019 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-23ee6e70-cdfe-45d2-aa14-df2918e98c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:38.028109 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 843/1678] 10.222.0.35 () {58 vars in 1057 bytes} [Tue Feb 8 16:41:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:38.034127 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 836/1679] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:38.044919 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6df3fa-9e2d-4231-b902-334cc6657e3b None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:38.045574 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6df3fa-9e2d-4231-b902-334cc6657e3b None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:38.046803 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee6e70-cdfe-45d2-aa14-df2918e98c18 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:38.047538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6df3fa-9e2d-4231-b902-334cc6657e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:38.067272 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee6e70-cdfe-45d2-aa14-df2918e98c18 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:38.077489 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c27b28-a1b5-43bb-b6f8-e80554720189 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c8f232fc83474b8731ee6c1eb321fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:38.078155 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c27b28-a1b5-43bb-b6f8-e80554720189 service placement] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:38.078440 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c27b28-a1b5-43bb-b6f8-e80554720189 service placement] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:38.078716 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c27b28-a1b5-43bb-b6f8-e80554720189 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:38.081354 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-77c27b28-a1b5-43bb-b6f8-e80554720189 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:38.090857 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-3e6df3fa-9e2d-4231-b902-334cc6657e3b None None] MFA Rules not processed for user `21e3f764b9f34256bc91f08bc220c7c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:38.096136 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-3e6df3fa-9e2d-4231-b902-334cc6657e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:38.101374 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c27b28-a1b5-43bb-b6f8-e80554720189 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:38.104055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c27b28-a1b5-43bb-b6f8-e80554720189 service placement] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:38.118775 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 844/1680] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:38.127611 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 837/1681] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:38.132151 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6df3fa-9e2d-4231-b902-334cc6657e3b None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:38.133863 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-3e6df3fa-9e2d-4231-b902-334cc6657e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:38.362112 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c27b28-a1b5-43bb-b6f8-e80554720189 service placement] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:38.363506 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-77c27b28-a1b5-43bb-b6f8-e80554720189 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:38.405628 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c27b28-a1b5-43bb-b6f8-e80554720189 service placement] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:38.417540 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6df3fa-9e2d-4231-b902-334cc6657e3b None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:38.425291 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244afa6e-1030-46f9-9c34-112088954dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:38.426166 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244afa6e-1030-46f9-9c34-112088954dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:38.426451 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244afa6e-1030-46f9-9c34-112088954dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:38.426737 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244afa6e-1030-46f9-9c34-112088954dce admin admin] PATH_INFO: `/v3/projects/2085ae28d8ee44efab5818c68a793e14` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:38.428921 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244afa6e-1030-46f9-9c34-112088954dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=2085ae28d8ee44efab5818c68a793e14)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:38.431393 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244afa6e-1030-46f9-9c34-112088954dce admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:38.435805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae76b9-d731-4cde-a6cd-51b32e80b7da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:38.436462 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae76b9-d731-4cde-a6cd-51b32e80b7da service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:38.436748 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae76b9-d731-4cde-a6cd-51b32e80b7da service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:38.437020 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae76b9-d731-4cde-a6cd-51b32e80b7da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:38.455194 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae76b9-d731-4cde-a6cd-51b32e80b7da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:38.456852 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae76b9-d731-4cde-a6cd-51b32e80b7da service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:38.483670 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 845/1682] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:38.583016 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-244afa6e-1030-46f9-9c34-112088954dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2085ae28d8ee44efab5818c68a793e14', 'request_id': 'req-244afa6e-1030-46f9-9c34-112088954dce'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:38.621242 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-244afa6e-1030-46f9-9c34-112088954dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2085ae28d8ee44efab5818c68a793e14', 'request_id': 'req-244afa6e-1030-46f9-9c34-112088954dce'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:38.636697 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-244afa6e-1030-46f9-9c34-112088954dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2085ae28d8ee44efab5818c68a793e14', 'request_id': 'req-244afa6e-1030-46f9-9c34-112088954dce'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:38.659114 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-244afa6e-1030-46f9-9c34-112088954dce admin admin] The token cache is being invalidate because project 2085ae28d8ee44efab5818c68a793e14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:41:38.659413 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-244afa6e-1030-46f9-9c34-112088954dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:38.660128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-244afa6e-1030-46f9-9c34-112088954dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:38.661986 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 838/1683] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:41:38 2022] DELETE /identity/v3/projects/2085ae28d8ee44efab5818c68a793e14 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:41:38.666370 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae76b9-d731-4cde-a6cd-51b32e80b7da service nova] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:38.681844 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae76b9-d731-4cde-a6cd-51b32e80b7da service nova] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:38.811074 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f352e-b8da-4032-97a4-b8f91b112a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:38.813626 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f352e-b8da-4032-97a4-b8f91b112a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:38.814769 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f352e-b8da-4032-97a4-b8f91b112a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:38.815054 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f352e-b8da-4032-97a4-b8f91b112a5b admin admin] PATH_INFO: `/v3/users/ba874a85026947cea36183208857612f` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:38.818991 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f352e-b8da-4032-97a4-b8f91b112a5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba874a85026947cea36183208857612f)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:38.823905 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f352e-b8da-4032-97a4-b8f91b112a5b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:38.956940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-d46f352e-b8da-4032-97a4-b8f91b112a5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba874a85026947cea36183208857612f'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:39.010789 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-d46f352e-b8da-4032-97a4-b8f91b112a5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba874a85026947cea36183208857612f'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:39.031927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-d46f352e-b8da-4032-97a4-b8f91b112a5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba874a85026947cea36183208857612f'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:39.054871 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-d46f352e-b8da-4032-97a4-b8f91b112a5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba874a85026947cea36183208857612f'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:39.055925 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-d46f352e-b8da-4032-97a4-b8f91b112a5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba874a85026947cea36183208857612f'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:39.066998 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 846/1684] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:41:38 2022] DELETE /identity/v3/users/ba874a85026947cea36183208857612f => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:40.425284 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81a032-8616-499d-b3cc-8e46a7349980 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:40.426025 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81a032-8616-499d-b3cc-8e46a7349980 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:40.426531 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81a032-8616-499d-b3cc-8e46a7349980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:40.467242 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ec81a032-8616-499d-b3cc-8e46a7349980 None None] MFA Rules not processed for user `21e3f764b9f34256bc91f08bc220c7c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:40.468527 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ec81a032-8616-499d-b3cc-8e46a7349980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:40.559785 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f352e-b8da-4032-97a4-b8f91b112a5b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:40.561067 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d46f352e-b8da-4032-97a4-b8f91b112a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:40.670556 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 839/1685] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:40.768817 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f352e-b8da-4032-97a4-b8f91b112a5b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:40.793868 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e18f4f-1a73-4543-9dce-f91103168a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:40.794756 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e18f4f-1a73-4543-9dce-f91103168a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:40.795241 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e18f4f-1a73-4543-9dce-f91103168a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:40.797518 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e18f4f-1a73-4543-9dce-f91103168a73 admin admin] PATH_INFO: `/v3/projects/0373d726ed714c9784d009fbab396d88` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:40.806726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e18f4f-1a73-4543-9dce-f91103168a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0373d726ed714c9784d009fbab396d88)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:40.821026 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: WARNING py.warnings [None req-34e18f4f-1a73-4543-9dce-f91103168a73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:41:40.821026 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: warnings.warn(msg) Feb 08 16:41:40.821026 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: Feb 08 16:41:40.822744 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e18f4f-1a73-4543-9dce-f91103168a73 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:41.017453 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-34e18f4f-1a73-4543-9dce-f91103168a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0373d726ed714c9784d009fbab396d88', 'request_id': 'req-34e18f4f-1a73-4543-9dce-f91103168a73'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:41.067210 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-34e18f4f-1a73-4543-9dce-f91103168a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0373d726ed714c9784d009fbab396d88', 'request_id': 'req-34e18f4f-1a73-4543-9dce-f91103168a73'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:41.096169 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-34e18f4f-1a73-4543-9dce-f91103168a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0373d726ed714c9784d009fbab396d88', 'request_id': 'req-34e18f4f-1a73-4543-9dce-f91103168a73'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:41.130125 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-34e18f4f-1a73-4543-9dce-f91103168a73 admin admin] The token cache is being invalidate because project 0373d726ed714c9784d009fbab396d88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:41:41.130514 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-34e18f4f-1a73-4543-9dce-f91103168a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:41.134491 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-34e18f4f-1a73-4543-9dce-f91103168a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:41.143642 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 847/1686] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:41:40 2022] DELETE /identity/v3/projects/0373d726ed714c9784d009fbab396d88 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:41:41.144816 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1102e-7d21-48ad-b0c8-c30a8b9f9668 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:41.145269 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1102e-7d21-48ad-b0c8-c30a8b9f9668 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:41.145686 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1102e-7d21-48ad-b0c8-c30a8b9f9668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:41.200980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-97b1102e-7d21-48ad-b0c8-c30a8b9f9668 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:41.207847 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-97b1102e-7d21-48ad-b0c8-c30a8b9f9668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:41.395221 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc272f2-5575-4a48-bd55-76484adf9305 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:41.395864 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc272f2-5575-4a48-bd55-76484adf9305 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:41.397414 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc272f2-5575-4a48-bd55-76484adf9305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:41.408003 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 840/1687] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:41.428033 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-ccc272f2-5575-4a48-bd55-76484adf9305 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:41.429404 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-ccc272f2-5575-4a48-bd55-76484adf9305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:41.439388 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 848/1688] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:41.444776 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1102e-7d21-48ad-b0c8-c30a8b9f9668 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:41.479481 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1102e-7d21-48ad-b0c8-c30a8b9f9668 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:41.510059 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415bc4d-49b7-47e1-87b0-a1c7910cfa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:41.510767 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415bc4d-49b7-47e1-87b0-a1c7910cfa47 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:41.511053 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415bc4d-49b7-47e1-87b0-a1c7910cfa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:41.511334 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415bc4d-49b7-47e1-87b0-a1c7910cfa47 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:41.512423 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415bc4d-49b7-47e1-87b0-a1c7910cfa47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:41:41.512720 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415bc4d-49b7-47e1-87b0-a1c7910cfa47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:41.514443 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415bc4d-49b7-47e1-87b0-a1c7910cfa47 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:41.544524 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 841/1689] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:41:41.547991 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc272f2-5575-4a48-bd55-76484adf9305 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:41.558943 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc272f2-5575-4a48-bd55-76484adf9305 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:41.578172 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b5d74-9111-4d7f-9db3-d2c33c0921f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:41.581415 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b5d74-9111-4d7f-9db3-d2c33c0921f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:41.585619 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b5d74-9111-4d7f-9db3-d2c33c0921f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:41.586118 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b5d74-9111-4d7f-9db3-d2c33c0921f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:41.587039 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b5d74-9111-4d7f-9db3-d2c33c0921f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:41.589219 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b5d74-9111-4d7f-9db3-d2c33c0921f6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:41.700930 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 849/1690] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:41:41 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:41.705721 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415bc4d-49b7-47e1-87b0-a1c7910cfa47 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:41.721928 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415bc4d-49b7-47e1-87b0-a1c7910cfa47 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:41.767461 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f44c4-6867-47dc-a9fa-ef37a50ded9e None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:41.767799 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f44c4-6867-47dc-a9fa-ef37a50ded9e None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:41.768078 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f44c4-6867-47dc-a9fa-ef37a50ded9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:41.839938 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-417f44c4-6867-47dc-a9fa-ef37a50ded9e None None] MFA Rules not processed for user `c858d129681846aba9e366c37c2213a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:41.841242 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-417f44c4-6867-47dc-a9fa-ef37a50ded9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:41.875307 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227380e-c433-49b6-b49c-393aa6f640ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:41.883892 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227380e-c433-49b6-b49c-393aa6f640ba admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:41.885350 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227380e-c433-49b6-b49c-393aa6f640ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:41.885875 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227380e-c433-49b6-b49c-393aa6f640ba admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:41.887055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227380e-c433-49b6-b49c-393aa6f640ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:41.889479 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227380e-c433-49b6-b49c-393aa6f640ba admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:41.927915 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 842/1691] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:41:41 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:41:41.932353 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227380e-c433-49b6-b49c-393aa6f640ba admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:41.937725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 850/1692] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:41:41.950644 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f44c4-6867-47dc-a9fa-ef37a50ded9e None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:41.953973 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227380e-c433-49b6-b49c-393aa6f640ba admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:41.955339 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-417f44c4-6867-47dc-a9fa-ef37a50ded9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:41.967594 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e34d6-2d60-4987-acd7-814453c1e94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:41.971042 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e34d6-2d60-4987-acd7-814453c1e94e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:41.971336 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e34d6-2d60-4987-acd7-814453c1e94e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:41.971624 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e34d6-2d60-4987-acd7-814453c1e94e admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:41.972406 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e34d6-2d60-4987-acd7-814453c1e94e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:41.977168 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e34d6-2d60-4987-acd7-814453c1e94e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:41.994898 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 843/1693] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:41.996649 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547672b-5864-4e69-8fd4-a2b5f75f9247 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:41.997677 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547672b-5864-4e69-8fd4-a2b5f75f9247 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:41.998132 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547672b-5864-4e69-8fd4-a2b5f75f9247 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:42.003248 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 844/1694] 10.222.0.35 () {54 vars in 912 bytes} [Tue Feb 8 16:41:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:41:42.019240 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547672b-5864-4e69-8fd4-a2b5f75f9247 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:42.035817 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547672b-5864-4e69-8fd4-a2b5f75f9247 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:42.044701 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7650ea-5cd2-4a92-b003-a0536ff32921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:42.047306 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7650ea-5cd2-4a92-b003-a0536ff32921 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:42.047743 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7650ea-5cd2-4a92-b003-a0536ff32921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:42.048365 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7650ea-5cd2-4a92-b003-a0536ff32921 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:42.049616 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7650ea-5cd2-4a92-b003-a0536ff32921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:42.060185 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7650ea-5cd2-4a92-b003-a0536ff32921 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:42.066925 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 845/1695] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:42.068992 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280db37-def0-493c-b886-80b181793b18 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:42.069265 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280db37-def0-493c-b886-80b181793b18 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:42.069694 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280db37-def0-493c-b886-80b181793b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:42.089751 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f280db37-def0-493c-b886-80b181793b18 None None] MFA Rules not processed for user `0b936dc9a67846f08e51648e64c3d6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:42.091220 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f280db37-def0-493c-b886-80b181793b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:42.097081 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f44c4-6867-47dc-a9fa-ef37a50ded9e None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:42.103553 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b2513-45e5-4146-bfa3-7050bb420aaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:42.104237 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b2513-45e5-4146-bfa3-7050bb420aaa service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:42.104521 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b2513-45e5-4146-bfa3-7050bb420aaa service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:42.104800 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b2513-45e5-4146-bfa3-7050bb420aaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:42.119047 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b2513-45e5-4146-bfa3-7050bb420aaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:42.120536 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b2513-45e5-4146-bfa3-7050bb420aaa service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:42.132780 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 851/1696] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:42.134172 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a373053-e0e8-43b5-8a15-f9f7754b2524 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:42.134490 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a373053-e0e8-43b5-8a15-f9f7754b2524 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:42.134750 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a373053-e0e8-43b5-8a15-f9f7754b2524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:42.164455 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 846/1697] 10.222.0.35 () {58 vars in 1009 bytes} [Tue Feb 8 16:41:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:42.165450 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280db37-def0-493c-b886-80b181793b18 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:42.181633 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-5a373053-e0e8-43b5-8a15-f9f7754b2524 None None] MFA Rules not processed for user `c5f36415ea7148d79f9fdb9cfac129e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:42.182886 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5a373053-e0e8-43b5-8a15-f9f7754b2524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:42.187030 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280db37-def0-493c-b886-80b181793b18 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:42.194015 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce9a2d-f305-478b-8de4-87b3606b2436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:42.194946 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce9a2d-f305-478b-8de4-87b3606b2436 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:42.195236 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce9a2d-f305-478b-8de4-87b3606b2436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:42.195651 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce9a2d-f305-478b-8de4-87b3606b2436 admin admin] PATH_INFO: `/v3/projects/99ad8417598047e3ae06ac6964cd25bd/users/3e07f44109d94f09bdf9edbdb112aab7/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:42.219354 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce9a2d-f305-478b-8de4-87b3606b2436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ad8417598047e3ae06ac6964cd25bd, user_id=3e07f44109d94f09bdf9edbdb112aab7, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:42.222182 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce9a2d-f305-478b-8de4-87b3606b2436 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:42.258319 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 847/1698] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:42 2022] PUT /identity/v3/projects/99ad8417598047e3ae06ac6964cd25bd/users/3e07f44109d94f09bdf9edbdb112aab7/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:42.259346 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce9a2d-f305-478b-8de4-87b3606b2436 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:42.262520 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-78ce9a2d-f305-478b-8de4-87b3606b2436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:42.325422 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 852/1699] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:42.327061 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc3027-8be6-4cff-b41d-2d35d991c226 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:42.328176 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc3027-8be6-4cff-b41d-2d35d991c226 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:42.329056 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc3027-8be6-4cff-b41d-2d35d991c226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:42.367453 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-aacc3027-8be6-4cff-b41d-2d35d991c226 None None] MFA Rules not processed for user `3e07f44109d94f09bdf9edbdb112aab7`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:42.369618 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-aacc3027-8be6-4cff-b41d-2d35d991c226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:42.401531 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce9a2d-f305-478b-8de4-87b3606b2436 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:42.406296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a2e10-0aee-4178-b6a1-f01f2c1ccb2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:42.407232 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a2e10-0aee-4178-b6a1-f01f2c1ccb2e service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:42.407713 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a2e10-0aee-4178-b6a1-f01f2c1ccb2e service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:42.408226 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a2e10-0aee-4178-b6a1-f01f2c1ccb2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:42.428810 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a2e10-0aee-4178-b6a1-f01f2c1ccb2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:42.437494 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a2e10-0aee-4178-b6a1-f01f2c1ccb2e service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:42.459566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 848/1700] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:42.502664 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 853/1701] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:42.509143 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a2e10-0aee-4178-b6a1-f01f2c1ccb2e service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:42.732913 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a2e10-0aee-4178-b6a1-f01f2c1ccb2e service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:42.759107 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88474e15-8949-4143-872a-533be2219337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:42.762936 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88474e15-8949-4143-872a-533be2219337 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:42.763208 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88474e15-8949-4143-872a-533be2219337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:42.763685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88474e15-8949-4143-872a-533be2219337 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:42.764645 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88474e15-8949-4143-872a-533be2219337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:42.766828 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88474e15-8949-4143-872a-533be2219337 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:42.864205 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 849/1702] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:41:42 2022] POST /identity/v3/projects => generated 363 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:41:42.865817 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc3027-8be6-4cff-b41d-2d35d991c226 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:42.887257 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc3027-8be6-4cff-b41d-2d35d991c226 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:43.070330 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e59633-e4a2-4a98-86a9-01305aaa8d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:43.071499 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e59633-e4a2-4a98-86a9-01305aaa8d85 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:43.072064 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e59633-e4a2-4a98-86a9-01305aaa8d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:43.072548 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e59633-e4a2-4a98-86a9-01305aaa8d85 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:43.073499 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e59633-e4a2-4a98-86a9-01305aaa8d85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:43.076449 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e59633-e4a2-4a98-86a9-01305aaa8d85 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:43.104276 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88474e15-8949-4143-872a-533be2219337 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:43.148007 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 854/1703] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:41:42 2022] POST /identity/v3/users => generated 288 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:41:43.150272 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e59633-e4a2-4a98-86a9-01305aaa8d85 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:43.175929 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e59633-e4a2-4a98-86a9-01305aaa8d85 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:43.188283 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ce5a6-ef2f-4fff-9530-8c2acd1e3ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:43.189068 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ce5a6-ef2f-4fff-9530-8c2acd1e3ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:43.189426 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ce5a6-ef2f-4fff-9530-8c2acd1e3ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:43.189738 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ce5a6-ef2f-4fff-9530-8c2acd1e3ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:43.190601 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ce5a6-ef2f-4fff-9530-8c2acd1e3ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:43.193799 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ce5a6-ef2f-4fff-9530-8c2acd1e3ec6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:43.230926 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 855/1704] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:43.236418 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ce5a6-ef2f-4fff-9530-8c2acd1e3ec6 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:43.270185 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ce5a6-ef2f-4fff-9530-8c2acd1e3ec6 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:43.285188 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db22192-1868-4947-bfba-262285d3c10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:43.286129 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db22192-1868-4947-bfba-262285d3c10f admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:43.286658 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db22192-1868-4947-bfba-262285d3c10f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:43.287622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db22192-1868-4947-bfba-262285d3c10f admin admin] PATH_INFO: `/v3/projects/17206dd8f777459a980fef49e2c3e86e/users/0a49d67290eb4326a5eb0a1dfb459c32/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:43.291051 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88474e15-8949-4143-872a-533be2219337 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:43.301079 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f606d-e234-42a8-b5ab-c422290f8503 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:43.301882 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f606d-e234-42a8-b5ab-c422290f8503 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:43.302313 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f606d-e234-42a8-b5ab-c422290f8503 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:43.302664 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f606d-e234-42a8-b5ab-c422290f8503 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:43.323641 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db22192-1868-4947-bfba-262285d3c10f admin admin] RBAC: Authorizing `identity:create_grant(project_id=17206dd8f777459a980fef49e2c3e86e, user_id=0a49d67290eb4326a5eb0a1dfb459c32, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:43.326356 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db22192-1868-4947-bfba-262285d3c10f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:43.356310 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 856/1705] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:43 2022] PUT /identity/v3/projects/17206dd8f777459a980fef49e2c3e86e/users/0a49d67290eb4326a5eb0a1dfb459c32/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:41:43.360189 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db22192-1868-4947-bfba-262285d3c10f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:43.385011 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f606d-e234-42a8-b5ab-c422290f8503 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:43.386658 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f606d-e234-42a8-b5ab-c422290f8503 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:43.415209 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 850/1706] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:41:43.493492 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db22192-1868-4947-bfba-262285d3c10f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:43.502881 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f0113-279d-47fb-9d8a-41b602b16869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:43.503913 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f0113-279d-47fb-9d8a-41b602b16869 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:43.504366 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f0113-279d-47fb-9d8a-41b602b16869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:43.504855 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f0113-279d-47fb-9d8a-41b602b16869 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:43.507168 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f0113-279d-47fb-9d8a-41b602b16869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:43.511128 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f0113-279d-47fb-9d8a-41b602b16869 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:43.539732 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 857/1707] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:43.541577 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f606d-e234-42a8-b5ab-c422290f8503 service nova] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:43.556789 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f606d-e234-42a8-b5ab-c422290f8503 service nova] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:43.569235 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17891a0a-80da-4cda-8022-4d8db795299f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:43.571807 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17891a0a-80da-4cda-8022-4d8db795299f admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:43.574259 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17891a0a-80da-4cda-8022-4d8db795299f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:43.574575 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17891a0a-80da-4cda-8022-4d8db795299f admin admin] PATH_INFO: `/v3/projects/17206dd8f777459a980fef49e2c3e86e/users/0a49d67290eb4326a5eb0a1dfb459c32/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:43.579430 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17891a0a-80da-4cda-8022-4d8db795299f admin admin] RBAC: Authorizing `identity:create_grant(project_id=17206dd8f777459a980fef49e2c3e86e, user_id=0a49d67290eb4326a5eb0a1dfb459c32, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:43.582869 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17891a0a-80da-4cda-8022-4d8db795299f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:43.598875 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 851/1708] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:43 2022] PUT /identity/v3/projects/17206dd8f777459a980fef49e2c3e86e/users/0a49d67290eb4326a5eb0a1dfb459c32/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:41:43.612060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553dc80-7152-4287-849d-25ecc0490298 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:43.612357 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553dc80-7152-4287-849d-25ecc0490298 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:43.612771 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553dc80-7152-4287-849d-25ecc0490298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:43.688496 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-d553dc80-7152-4287-849d-25ecc0490298 None None] MFA Rules not processed for user `0a49d67290eb4326a5eb0a1dfb459c32`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:43.708338 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d553dc80-7152-4287-849d-25ecc0490298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:43.926323 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 858/1709] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:43 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:43.938695 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17891a0a-80da-4cda-8022-4d8db795299f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:43.940700 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-17891a0a-80da-4cda-8022-4d8db795299f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:44.100052 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17891a0a-80da-4cda-8022-4d8db795299f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:44.116694 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e77da5-c401-4b81-b16a-6ea21dfe4b83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:44.118889 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e77da5-c401-4b81-b16a-6ea21dfe4b83 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:44.119192 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e77da5-c401-4b81-b16a-6ea21dfe4b83 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:44.133163 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e77da5-c401-4b81-b16a-6ea21dfe4b83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:44.181947 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e77da5-c401-4b81-b16a-6ea21dfe4b83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:44.188243 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e77da5-c401-4b81-b16a-6ea21dfe4b83 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:44.213676 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 852/1710] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:43 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:44.623059 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553dc80-7152-4287-849d-25ecc0490298 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:44.874952 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553dc80-7152-4287-849d-25ecc0490298 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:44.886001 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecc7e5-cf6e-4594-b24d-92e7b8a20e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:44.887004 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecc7e5-cf6e-4594-b24d-92e7b8a20e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:44.887307 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecc7e5-cf6e-4594-b24d-92e7b8a20e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:44.887583 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecc7e5-cf6e-4594-b24d-92e7b8a20e4d admin admin] PATH_INFO: `/v3/users/3e07f44109d94f09bdf9edbdb112aab7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:44.894229 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ecc7e5-cf6e-4594-b24d-92e7b8a20e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e07f44109d94f09bdf9edbdb112aab7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:44.913627 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ecc7e5-cf6e-4594-b24d-92e7b8a20e4d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:45.057911 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-18ecc7e5-cf6e-4594-b24d-92e7b8a20e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e07f44109d94f09bdf9edbdb112aab7'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:45.101723 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-18ecc7e5-cf6e-4594-b24d-92e7b8a20e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e07f44109d94f09bdf9edbdb112aab7'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:45.123303 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-18ecc7e5-cf6e-4594-b24d-92e7b8a20e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e07f44109d94f09bdf9edbdb112aab7'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:45.141775 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-18ecc7e5-cf6e-4594-b24d-92e7b8a20e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e07f44109d94f09bdf9edbdb112aab7'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:45.142708 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-18ecc7e5-cf6e-4594-b24d-92e7b8a20e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e07f44109d94f09bdf9edbdb112aab7'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:45.158594 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 859/1711] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:41:44 2022] DELETE /identity/v3/users/3e07f44109d94f09bdf9edbdb112aab7 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:45.163147 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb5f68-142b-4797-81d8-98964194a21a None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:45.163708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb5f68-142b-4797-81d8-98964194a21a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:45.163708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb5f68-142b-4797-81d8-98964194a21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:45.213486 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-dddb5f68-142b-4797-81d8-98964194a21a None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:45.217111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-dddb5f68-142b-4797-81d8-98964194a21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:45.447624 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 853/1712] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:45.489454 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecc7e5-cf6e-4594-b24d-92e7b8a20e4d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:45.496782 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-18ecc7e5-cf6e-4594-b24d-92e7b8a20e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:45.653925 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecc7e5-cf6e-4594-b24d-92e7b8a20e4d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:45.664075 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474ad21-3703-4913-8084-538ef6c2cee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:45.665010 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474ad21-3703-4913-8084-538ef6c2cee5 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:45.667818 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474ad21-3703-4913-8084-538ef6c2cee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:45.670374 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474ad21-3703-4913-8084-538ef6c2cee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:45.692414 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474ad21-3703-4913-8084-538ef6c2cee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:45.694602 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474ad21-3703-4913-8084-538ef6c2cee5 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:45.709858 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 860/1713] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:46.052067 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92521ab1-c216-4c92-906f-6034a2a1dc06 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:46.052588 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92521ab1-c216-4c92-906f-6034a2a1dc06 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:46.053223 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92521ab1-c216-4c92-906f-6034a2a1dc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:46.086887 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-92521ab1-c216-4c92-906f-6034a2a1dc06 None None] MFA Rules not processed for user `c858d129681846aba9e366c37c2213a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:46.088790 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-92521ab1-c216-4c92-906f-6034a2a1dc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:46.210977 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 854/1714] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:47.029003 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f66c1-3b74-42c1-87e8-b7deb263ba39 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:47.029531 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f66c1-3b74-42c1-87e8-b7deb263ba39 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:47.029692 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f66c1-3b74-42c1-87e8-b7deb263ba39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:47.081909 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-980f66c1-3b74-42c1-87e8-b7deb263ba39 None None] MFA Rules not processed for user `9761863f36284bd4be1ce29c86b631cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:47.087156 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-980f66c1-3b74-42c1-87e8-b7deb263ba39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:47.229603 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 861/1715] 10.222.0.35 () {58 vars in 1009 bytes} [Tue Feb 8 16:41:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:47.463054 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92521ab1-c216-4c92-906f-6034a2a1dc06 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:47.464565 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-92521ab1-c216-4c92-906f-6034a2a1dc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:47.513457 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92521ab1-c216-4c92-906f-6034a2a1dc06 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:47.539811 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c482f-a9f6-42a0-9449-137737b1f6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:47.545169 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c482f-a9f6-42a0-9449-137737b1f6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:47.545605 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c482f-a9f6-42a0-9449-137737b1f6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:47.559935 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c482f-a9f6-42a0-9449-137737b1f6f9 admin admin] PATH_INFO: `/v3/projects/99ad8417598047e3ae06ac6964cd25bd` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:47.567297 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c482f-a9f6-42a0-9449-137737b1f6f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ad8417598047e3ae06ac6964cd25bd)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:47.576042 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c482f-a9f6-42a0-9449-137737b1f6f9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:47.691704 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f66c1-3b74-42c1-87e8-b7deb263ba39 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:47.694720 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-980f66c1-3b74-42c1-87e8-b7deb263ba39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:47.762124 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-fd3c482f-a9f6-42a0-9449-137737b1f6f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ad8417598047e3ae06ac6964cd25bd', 'request_id': 'req-fd3c482f-a9f6-42a0-9449-137737b1f6f9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:47.791604 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-fd3c482f-a9f6-42a0-9449-137737b1f6f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ad8417598047e3ae06ac6964cd25bd', 'request_id': 'req-fd3c482f-a9f6-42a0-9449-137737b1f6f9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:47.826031 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-fd3c482f-a9f6-42a0-9449-137737b1f6f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ad8417598047e3ae06ac6964cd25bd', 'request_id': 'req-fd3c482f-a9f6-42a0-9449-137737b1f6f9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:47.860540 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-fd3c482f-a9f6-42a0-9449-137737b1f6f9 admin admin] The token cache is being invalidate because project 99ad8417598047e3ae06ac6964cd25bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:41:47.860838 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-fd3c482f-a9f6-42a0-9449-137737b1f6f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:47.862094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-fd3c482f-a9f6-42a0-9449-137737b1f6f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:47.866565 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 855/1716] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:41:47 2022] DELETE /identity/v3/projects/99ad8417598047e3ae06ac6964cd25bd => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:47.874032 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c482f-a9f6-42a0-9449-137737b1f6f9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:47.883251 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-fd3c482f-a9f6-42a0-9449-137737b1f6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:47.936787 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f66c1-3b74-42c1-87e8-b7deb263ba39 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:48.100578 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c482f-a9f6-42a0-9449-137737b1f6f9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:48.112328 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6591e-bab4-4d2e-9517-1bb5504e0155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:48.113213 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6591e-bab4-4d2e-9517-1bb5504e0155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:48.113492 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6591e-bab4-4d2e-9517-1bb5504e0155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:48.113774 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6591e-bab4-4d2e-9517-1bb5504e0155 admin admin] PATH_INFO: `/v3/users/0a49d67290eb4326a5eb0a1dfb459c32` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:48.120476 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6591e-bab4-4d2e-9517-1bb5504e0155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a49d67290eb4326a5eb0a1dfb459c32)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:48.122447 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6591e-bab4-4d2e-9517-1bb5504e0155 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:48.130813 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd2f0e-4503-4783-9ff5-42aa804a3cf5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00fd3c05cd8e4167946a1f567df2cc6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:48.131729 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd2f0e-4503-4783-9ff5-42aa804a3cf5 service swift] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:48.132222 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd2f0e-4503-4783-9ff5-42aa804a3cf5 service swift] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:48.133897 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd2f0e-4503-4783-9ff5-42aa804a3cf5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:48.138512 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-31bd2f0e-4503-4783-9ff5-42aa804a3cf5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:48.235746 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-51b6591e-bab4-4d2e-9517-1bb5504e0155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a49d67290eb4326a5eb0a1dfb459c32'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:48.255679 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-51b6591e-bab4-4d2e-9517-1bb5504e0155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a49d67290eb4326a5eb0a1dfb459c32'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:48.294264 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-51b6591e-bab4-4d2e-9517-1bb5504e0155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a49d67290eb4326a5eb0a1dfb459c32'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:48.307532 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd2f0e-4503-4783-9ff5-42aa804a3cf5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:48.309346 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd2f0e-4503-4783-9ff5-42aa804a3cf5 service swift] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:48.319311 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-51b6591e-bab4-4d2e-9517-1bb5504e0155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a49d67290eb4326a5eb0a1dfb459c32'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:48.321014 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-51b6591e-bab4-4d2e-9517-1bb5504e0155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a49d67290eb4326a5eb0a1dfb459c32'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:48.330259 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 856/1717] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:41:47 2022] DELETE /identity/v3/users/0a49d67290eb4326a5eb0a1dfb459c32 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:48.330876 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 862/1718] 10.222.0.35 () {60 vars in 1384 bytes} [Tue Feb 8 16:41:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:41:49.148066 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1a23c-b021-4f8d-8c81-51fb2b94da7d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:49.148565 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1a23c-b021-4f8d-8c81-51fb2b94da7d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:49.148649 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1a23c-b021-4f8d-8c81-51fb2b94da7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:49.200766 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-89e1a23c-b021-4f8d-8c81-51fb2b94da7d None None] MFA Rules not processed for user `c5f36415ea7148d79f9fdb9cfac129e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:49.212356 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-89e1a23c-b021-4f8d-8c81-51fb2b94da7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:49.443491 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 857/1719] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:51.506918 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd2f0e-4503-4783-9ff5-42aa804a3cf5 service swift] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:51.553478 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd2f0e-4503-4783-9ff5-42aa804a3cf5 service swift] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:51.667165 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e910cc6-cf32-40e5-bc1f-46cbb3d0552e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:51.668362 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e910cc6-cf32-40e5-bc1f-46cbb3d0552e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:51.668580 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e910cc6-cf32-40e5-bc1f-46cbb3d0552e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:51.668921 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e910cc6-cf32-40e5-bc1f-46cbb3d0552e admin admin] PATH_INFO: `/v3/projects/17206dd8f777459a980fef49e2c3e86e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:51.670870 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e910cc6-cf32-40e5-bc1f-46cbb3d0552e admin admin] RBAC: Authorizing `identity:delete_project(project_id=17206dd8f777459a980fef49e2c3e86e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:51.673123 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e910cc6-cf32-40e5-bc1f-46cbb3d0552e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:51.742831 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5e910cc6-cf32-40e5-bc1f-46cbb3d0552e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17206dd8f777459a980fef49e2c3e86e', 'request_id': 'req-5e910cc6-cf32-40e5-bc1f-46cbb3d0552e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:51.751512 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5e910cc6-cf32-40e5-bc1f-46cbb3d0552e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17206dd8f777459a980fef49e2c3e86e', 'request_id': 'req-5e910cc6-cf32-40e5-bc1f-46cbb3d0552e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:51.761071 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5e910cc6-cf32-40e5-bc1f-46cbb3d0552e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17206dd8f777459a980fef49e2c3e86e', 'request_id': 'req-5e910cc6-cf32-40e5-bc1f-46cbb3d0552e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:51.784283 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5e910cc6-cf32-40e5-bc1f-46cbb3d0552e admin admin] The token cache is being invalidate because project 17206dd8f777459a980fef49e2c3e86e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:41:51.784577 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5e910cc6-cf32-40e5-bc1f-46cbb3d0552e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:51.785230 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5e910cc6-cf32-40e5-bc1f-46cbb3d0552e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:51.787066 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 863/1720] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:41:51 2022] DELETE /identity/v3/projects/17206dd8f777459a980fef49e2c3e86e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:51.793204 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448eca8-bdfd-4ed7-9022-c913b8ea2eaf None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:51.793649 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448eca8-bdfd-4ed7-9022-c913b8ea2eaf None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:51.793817 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448eca8-bdfd-4ed7-9022-c913b8ea2eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:51.845814 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-a448eca8-bdfd-4ed7-9022-c913b8ea2eaf None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:51.847065 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a448eca8-bdfd-4ed7-9022-c913b8ea2eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:52.056239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 858/1721] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:41:52.064266 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d270c-cb78-4833-b42c-3f1764318932 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:52.064840 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d270c-cb78-4833-b42c-3f1764318932 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:52.065270 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d270c-cb78-4833-b42c-3f1764318932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:52.092357 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-4d8d270c-cb78-4833-b42c-3f1764318932 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:52.093907 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-4d8d270c-cb78-4833-b42c-3f1764318932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:52.130206 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 864/1722] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:52.131224 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448eca8-bdfd-4ed7-9022-c913b8ea2eaf None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:52.143831 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448eca8-bdfd-4ed7-9022-c913b8ea2eaf None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:52.159013 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6f678-ebc3-4071-8a79-e704854ab6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:52.159690 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6f678-ebc3-4071-8a79-e704854ab6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:52.160021 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6f678-ebc3-4071-8a79-e704854ab6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:52.160351 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6f678-ebc3-4071-8a79-e704854ab6a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:52.161109 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6f678-ebc3-4071-8a79-e704854ab6a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:41:52.162063 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6f678-ebc3-4071-8a79-e704854ab6a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:52.163589 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6f678-ebc3-4071-8a79-e704854ab6a3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:52.209711 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 859/1723] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:41:52.211360 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d270c-cb78-4833-b42c-3f1764318932 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:52.234090 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d270c-cb78-4833-b42c-3f1764318932 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:52.252716 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e74a4-005d-4786-8ac7-0cc4e914b03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:52.253553 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e74a4-005d-4786-8ac7-0cc4e914b03b admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:52.253788 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e74a4-005d-4786-8ac7-0cc4e914b03b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:52.254067 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e74a4-005d-4786-8ac7-0cc4e914b03b admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:52.255446 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e74a4-005d-4786-8ac7-0cc4e914b03b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:52.265904 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e74a4-005d-4786-8ac7-0cc4e914b03b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:52.320814 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 865/1724] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:41:52 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:52.325754 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6f678-ebc3-4071-8a79-e704854ab6a3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:52.343665 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6f678-ebc3-4071-8a79-e704854ab6a3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:52.465137 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd31e74-2e87-4eb3-b4b3-811eb9970fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:52.466106 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd31e74-2e87-4eb3-b4b3-811eb9970fff admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:52.466771 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd31e74-2e87-4eb3-b4b3-811eb9970fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:52.467255 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd31e74-2e87-4eb3-b4b3-811eb9970fff admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:52.468233 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd31e74-2e87-4eb3-b4b3-811eb9970fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:52.470726 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd31e74-2e87-4eb3-b4b3-811eb9970fff admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:52.511489 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 860/1725] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:41:52 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:52.513970 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e74a4-005d-4786-8ac7-0cc4e914b03b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:52.534048 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e74a4-005d-4786-8ac7-0cc4e914b03b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:52.556146 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81086bc0-be98-46d2-bc17-90857bad0e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:52.570011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81086bc0-be98-46d2-bc17-90857bad0e32 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:52.570414 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81086bc0-be98-46d2-bc17-90857bad0e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:52.570603 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81086bc0-be98-46d2-bc17-90857bad0e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:52.571746 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81086bc0-be98-46d2-bc17-90857bad0e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:52.571746 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81086bc0-be98-46d2-bc17-90857bad0e32 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:52.597599 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 866/1726] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:41:52.602422 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd31e74-2e87-4eb3-b4b3-811eb9970fff admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:52.612673 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd31e74-2e87-4eb3-b4b3-811eb9970fff admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:52.617649 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14240009-22ed-46f3-83ed-57a4f36fe3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:52.618311 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14240009-22ed-46f3-83ed-57a4f36fe3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:52.618600 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14240009-22ed-46f3-83ed-57a4f36fe3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:52.618880 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14240009-22ed-46f3-83ed-57a4f36fe3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:52.619720 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14240009-22ed-46f3-83ed-57a4f36fe3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:52.621499 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14240009-22ed-46f3-83ed-57a4f36fe3d5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:52.636754 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 861/1727] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:52.638089 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81086bc0-be98-46d2-bc17-90857bad0e32 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:52.652911 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81086bc0-be98-46d2-bc17-90857bad0e32 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:52.659484 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300878e9-736b-41e0-adc3-2a201e3dc472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:52.660715 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300878e9-736b-41e0-adc3-2a201e3dc472 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:52.660992 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300878e9-736b-41e0-adc3-2a201e3dc472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:52.662289 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300878e9-736b-41e0-adc3-2a201e3dc472 admin admin] PATH_INFO: `/v3/projects/e38cd0d703c84bc8b812b0a41497a858/users/bc6151d08fa240bb881a000cd4537941/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:52.686856 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300878e9-736b-41e0-adc3-2a201e3dc472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e38cd0d703c84bc8b812b0a41497a858, user_id=bc6151d08fa240bb881a000cd4537941, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:52.689725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300878e9-736b-41e0-adc3-2a201e3dc472 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:52.703957 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 867/1728] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:52 2022] PUT /identity/v3/projects/e38cd0d703c84bc8b812b0a41497a858/users/bc6151d08fa240bb881a000cd4537941/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:52.716654 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31282b-a69e-435f-810e-39989df6457c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:52.717180 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31282b-a69e-435f-810e-39989df6457c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:52.717457 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31282b-a69e-435f-810e-39989df6457c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:52.747777 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-bb31282b-a69e-435f-810e-39989df6457c None None] MFA Rules not processed for user `bc6151d08fa240bb881a000cd4537941`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:52.749098 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-bb31282b-a69e-435f-810e-39989df6457c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:52.813918 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 862/1729] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:52.819731 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300878e9-736b-41e0-adc3-2a201e3dc472 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:52.886765 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300878e9-736b-41e0-adc3-2a201e3dc472 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:52.891603 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23433d-7241-425d-87a7-237f438c7b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:52.892310 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23433d-7241-425d-87a7-237f438c7b99 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:52.892593 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23433d-7241-425d-87a7-237f438c7b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:52.892871 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23433d-7241-425d-87a7-237f438c7b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:52.893578 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23433d-7241-425d-87a7-237f438c7b99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:52.895668 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23433d-7241-425d-87a7-237f438c7b99 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:52.922018 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 868/1730] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:41:52 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:52.926318 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31282b-a69e-435f-810e-39989df6457c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:52.937395 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31282b-a69e-435f-810e-39989df6457c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:53.006271 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae19e6-c3af-4d04-9216-b4ca461a2147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:53.007232 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae19e6-c3af-4d04-9216-b4ca461a2147 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:53.007510 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae19e6-c3af-4d04-9216-b4ca461a2147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:53.007837 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae19e6-c3af-4d04-9216-b4ca461a2147 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:53.008848 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae19e6-c3af-4d04-9216-b4ca461a2147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:53.011108 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae19e6-c3af-4d04-9216-b4ca461a2147 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:53.035333 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 863/1731] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:41:52 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:53.039309 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23433d-7241-425d-87a7-237f438c7b99 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:53.051283 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23433d-7241-425d-87a7-237f438c7b99 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:53.060865 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031ca22-6dd8-462f-a08f-d15ac68e5e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:53.061742 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031ca22-6dd8-462f-a08f-d15ac68e5e21 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:53.062156 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031ca22-6dd8-462f-a08f-d15ac68e5e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:53.062526 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031ca22-6dd8-462f-a08f-d15ac68e5e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:53.063457 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031ca22-6dd8-462f-a08f-d15ac68e5e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:53.065426 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031ca22-6dd8-462f-a08f-d15ac68e5e21 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:53.080337 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 869/1732] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:41:53.084373 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae19e6-c3af-4d04-9216-b4ca461a2147 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:53.096027 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae19e6-c3af-4d04-9216-b4ca461a2147 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:53.105105 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d33fc-aa22-475a-a8c4-cc8d3268d0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:53.110015 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d33fc-aa22-475a-a8c4-cc8d3268d0fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:53.110395 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d33fc-aa22-475a-a8c4-cc8d3268d0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:53.110686 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d33fc-aa22-475a-a8c4-cc8d3268d0fd admin admin] PATH_INFO: `/v3/projects/35a89622269d43479ee93e3c72f3091b/users/a93c69cd753c4f2b873c3660901092f6/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:53.133277 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d33fc-aa22-475a-a8c4-cc8d3268d0fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a89622269d43479ee93e3c72f3091b, user_id=a93c69cd753c4f2b873c3660901092f6, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:53.136182 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d33fc-aa22-475a-a8c4-cc8d3268d0fd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:53.156616 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 864/1733] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:53 2022] PUT /identity/v3/projects/35a89622269d43479ee93e3c72f3091b/users/a93c69cd753c4f2b873c3660901092f6/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:41:53.160236 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031ca22-6dd8-462f-a08f-d15ac68e5e21 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:53.171005 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031ca22-6dd8-462f-a08f-d15ac68e5e21 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:53.226983 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c4c26-522a-4e50-ac47-20e31798007d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:53.227652 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c4c26-522a-4e50-ac47-20e31798007d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:53.227961 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c4c26-522a-4e50-ac47-20e31798007d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:53.228237 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c4c26-522a-4e50-ac47-20e31798007d admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:53.228976 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c4c26-522a-4e50-ac47-20e31798007d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:53.230731 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c4c26-522a-4e50-ac47-20e31798007d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:53.241470 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 870/1734] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:53.245577 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d33fc-aa22-475a-a8c4-cc8d3268d0fd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:53.262892 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d33fc-aa22-475a-a8c4-cc8d3268d0fd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:53.271047 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ad378-820e-4a45-b476-b39563febaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:53.271983 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ad378-820e-4a45-b476-b39563febaa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:53.273639 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ad378-820e-4a45-b476-b39563febaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:53.273639 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ad378-820e-4a45-b476-b39563febaa3 admin admin] PATH_INFO: `/v3/projects/35a89622269d43479ee93e3c72f3091b/users/a93c69cd753c4f2b873c3660901092f6/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:53.274813 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ad378-820e-4a45-b476-b39563febaa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a89622269d43479ee93e3c72f3091b, user_id=a93c69cd753c4f2b873c3660901092f6, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:53.277662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ad378-820e-4a45-b476-b39563febaa3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:53.288443 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 865/1735] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:53 2022] PUT /identity/v3/projects/35a89622269d43479ee93e3c72f3091b/users/a93c69cd753c4f2b873c3660901092f6/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:53.299398 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbda5e-cf22-474c-9014-d31c75ead059 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:53.299679 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbda5e-cf22-474c-9014-d31c75ead059 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:53.299998 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbda5e-cf22-474c-9014-d31c75ead059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:53.333252 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-75dbda5e-cf22-474c-9014-d31c75ead059 None None] MFA Rules not processed for user `a93c69cd753c4f2b873c3660901092f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:53.334580 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-75dbda5e-cf22-474c-9014-d31c75ead059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:53.407334 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 871/1736] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:53.417069 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ad378-820e-4a45-b476-b39563febaa3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:53.418753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-043ad378-820e-4a45-b476-b39563febaa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:53.482342 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ad378-820e-4a45-b476-b39563febaa3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:53.485945 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c76e8-26ce-4513-9c7c-18c0a0343a71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:53.486578 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c76e8-26ce-4513-9c7c-18c0a0343a71 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:53.486856 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c76e8-26ce-4513-9c7c-18c0a0343a71 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:53.487125 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c76e8-26ce-4513-9c7c-18c0a0343a71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:53.540771 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c76e8-26ce-4513-9c7c-18c0a0343a71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:53.542211 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c76e8-26ce-4513-9c7c-18c0a0343a71 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:53.550886 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 866/1737] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:56.701644 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbda5e-cf22-474c-9014-d31c75ead059 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:56.703111 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-75dbda5e-cf22-474c-9014-d31c75ead059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:56.781369 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbda5e-cf22-474c-9014-d31c75ead059 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:56.785930 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb9445-8671-41ab-b554-3a13a266095e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:56.787454 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb9445-8671-41ab-b554-3a13a266095e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:56.787729 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb9445-8671-41ab-b554-3a13a266095e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:56.788029 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb9445-8671-41ab-b554-3a13a266095e admin admin] PATH_INFO: `/v3/users/10c4108237464a5c8ebc86be2a86936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:56.789244 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb9445-8671-41ab-b554-3a13a266095e admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c4108237464a5c8ebc86be2a86936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:56.791158 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb9445-8671-41ab-b554-3a13a266095e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:56.834633 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b3cb9445-8671-41ab-b554-3a13a266095e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c4108237464a5c8ebc86be2a86936e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:56.845498 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b3cb9445-8671-41ab-b554-3a13a266095e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c4108237464a5c8ebc86be2a86936e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:56.851925 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b3cb9445-8671-41ab-b554-3a13a266095e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c4108237464a5c8ebc86be2a86936e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:56.859234 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b3cb9445-8671-41ab-b554-3a13a266095e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c4108237464a5c8ebc86be2a86936e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:56.860018 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b3cb9445-8671-41ab-b554-3a13a266095e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c4108237464a5c8ebc86be2a86936e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:56.870127 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 872/1738] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:41:56 2022] DELETE /identity/v3/users/10c4108237464a5c8ebc86be2a86936e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:56.874381 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ae692-0835-4095-8a27-f5165c0c034c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:56.874864 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ae692-0835-4095-8a27-f5165c0c034c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:56.874956 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ae692-0835-4095-8a27-f5165c0c034c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:56.893676 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-483ae692-0835-4095-8a27-f5165c0c034c None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:56.894874 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-483ae692-0835-4095-8a27-f5165c0c034c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:56.953878 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 867/1739] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:56.963403 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb9445-8671-41ab-b554-3a13a266095e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:56.964868 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-b3cb9445-8671-41ab-b554-3a13a266095e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:57.022144 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb9445-8671-41ab-b554-3a13a266095e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:57.026534 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7a8aa-d177-4c08-b555-6da9f510243a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:57.027399 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7a8aa-d177-4c08-b555-6da9f510243a service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:57.027686 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7a8aa-d177-4c08-b555-6da9f510243a service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:57.028025 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7a8aa-d177-4c08-b555-6da9f510243a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:57.037843 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7a8aa-d177-4c08-b555-6da9f510243a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:57.039373 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7a8aa-d177-4c08-b555-6da9f510243a service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:57.049460 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 873/1740] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:57.613261 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ae692-0835-4095-8a27-f5165c0c034c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:57.616233 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-483ae692-0835-4095-8a27-f5165c0c034c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:57.635810 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ae692-0835-4095-8a27-f5165c0c034c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:57.656806 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7adf09-6d52-4f64-9c71-2b56ef9af1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:57.661194 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7adf09-6d52-4f64-9c71-2b56ef9af1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:57.661729 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7adf09-6d52-4f64-9c71-2b56ef9af1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:57.662230 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7adf09-6d52-4f64-9c71-2b56ef9af1e0 admin admin] PATH_INFO: `/v3/projects/a2e3a4b655af4a4b97d0a2a9c3601283` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:57.664819 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7adf09-6d52-4f64-9c71-2b56ef9af1e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e3a4b655af4a4b97d0a2a9c3601283)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:57.667734 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7adf09-6d52-4f64-9c71-2b56ef9af1e0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:57.732078 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9a7adf09-6d52-4f64-9c71-2b56ef9af1e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e3a4b655af4a4b97d0a2a9c3601283', 'request_id': 'req-9a7adf09-6d52-4f64-9c71-2b56ef9af1e0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:57.738505 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9a7adf09-6d52-4f64-9c71-2b56ef9af1e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e3a4b655af4a4b97d0a2a9c3601283', 'request_id': 'req-9a7adf09-6d52-4f64-9c71-2b56ef9af1e0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:57.749441 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9a7adf09-6d52-4f64-9c71-2b56ef9af1e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e3a4b655af4a4b97d0a2a9c3601283', 'request_id': 'req-9a7adf09-6d52-4f64-9c71-2b56ef9af1e0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:57.784953 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9a7adf09-6d52-4f64-9c71-2b56ef9af1e0 admin admin] The token cache is being invalidate because project a2e3a4b655af4a4b97d0a2a9c3601283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:41:57.785270 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9a7adf09-6d52-4f64-9c71-2b56ef9af1e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:57.786037 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9a7adf09-6d52-4f64-9c71-2b56ef9af1e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:41:57.791341 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 868/1741] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:41:57 2022] DELETE /identity/v3/projects/a2e3a4b655af4a4b97d0a2a9c3601283 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:57.796476 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd6124-f43c-417c-bc1e-67bc27dfe437 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:57.797349 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd6124-f43c-417c-bc1e-67bc27dfe437 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:57.797747 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd6124-f43c-417c-bc1e-67bc27dfe437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:57.843981 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-4fdd6124-f43c-417c-bc1e-67bc27dfe437 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:57.845646 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-4fdd6124-f43c-417c-bc1e-67bc27dfe437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:57.913418 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 874/1742] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:57.921863 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08372aa-59b0-4e3e-9d2d-25b8efcc2c8d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:57.922410 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08372aa-59b0-4e3e-9d2d-25b8efcc2c8d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:57.922706 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08372aa-59b0-4e3e-9d2d-25b8efcc2c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:57.948144 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f08372aa-59b0-4e3e-9d2d-25b8efcc2c8d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:57.949376 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f08372aa-59b0-4e3e-9d2d-25b8efcc2c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:57.957533 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 869/1743] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:57.961953 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd6124-f43c-417c-bc1e-67bc27dfe437 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:57.971676 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd6124-f43c-417c-bc1e-67bc27dfe437 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:57.977441 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314aff2-da09-4a12-b3ec-1576e82d9f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:57.978109 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314aff2-da09-4a12-b3ec-1576e82d9f91 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:57.978392 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314aff2-da09-4a12-b3ec-1576e82d9f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:57.978672 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314aff2-da09-4a12-b3ec-1576e82d9f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:57.979420 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314aff2-da09-4a12-b3ec-1576e82d9f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:41:57.979732 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314aff2-da09-4a12-b3ec-1576e82d9f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:57.981377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314aff2-da09-4a12-b3ec-1576e82d9f91 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:58.001764 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 875/1744] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:41:58.005853 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08372aa-59b0-4e3e-9d2d-25b8efcc2c8d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:58.016566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08372aa-59b0-4e3e-9d2d-25b8efcc2c8d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:58.021327 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c753b0-65cf-457f-aa9d-79bc9614484d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:58.022001 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c753b0-65cf-457f-aa9d-79bc9614484d admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:58.022281 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c753b0-65cf-457f-aa9d-79bc9614484d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:58.022553 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c753b0-65cf-457f-aa9d-79bc9614484d admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:58.023259 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c753b0-65cf-457f-aa9d-79bc9614484d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:58.025173 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c753b0-65cf-457f-aa9d-79bc9614484d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:58.054352 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 870/1745] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:41:58 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:58.055699 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314aff2-da09-4a12-b3ec-1576e82d9f91 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:58.065562 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314aff2-da09-4a12-b3ec-1576e82d9f91 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:58.122569 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1556e-82ed-4c13-b5ad-75f025f80d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:58.123245 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1556e-82ed-4c13-b5ad-75f025f80d75 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:58.123528 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1556e-82ed-4c13-b5ad-75f025f80d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:58.123824 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1556e-82ed-4c13-b5ad-75f025f80d75 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:58.124549 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1556e-82ed-4c13-b5ad-75f025f80d75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:58.126565 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1556e-82ed-4c13-b5ad-75f025f80d75 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:58.147705 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 876/1746] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:41:58 2022] POST /identity/v3/users => generated 278 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:58.151783 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c753b0-65cf-457f-aa9d-79bc9614484d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:58.162929 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c753b0-65cf-457f-aa9d-79bc9614484d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:58.168248 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a5eba-e44b-4134-b2a3-923e09d67573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:58.168535 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a5eba-e44b-4134-b2a3-923e09d67573 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:58.168821 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a5eba-e44b-4134-b2a3-923e09d67573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:58.169093 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a5eba-e44b-4134-b2a3-923e09d67573 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:58.170386 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a5eba-e44b-4134-b2a3-923e09d67573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:58.171410 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a5eba-e44b-4134-b2a3-923e09d67573 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:58.183742 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 871/1747] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:58.187782 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1556e-82ed-4c13-b5ad-75f025f80d75 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:58.201205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1556e-82ed-4c13-b5ad-75f025f80d75 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:58.206279 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678075e-f81b-4934-af8b-cd8ff123d730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:58.207035 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678075e-f81b-4934-af8b-cd8ff123d730 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:58.207352 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678075e-f81b-4934-af8b-cd8ff123d730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:58.207913 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678075e-f81b-4934-af8b-cd8ff123d730 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:58.208670 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678075e-f81b-4934-af8b-cd8ff123d730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:58.210568 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678075e-f81b-4934-af8b-cd8ff123d730 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:58.220691 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 877/1748] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:58.225513 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a5eba-e44b-4134-b2a3-923e09d67573 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:58.235228 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a5eba-e44b-4134-b2a3-923e09d67573 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:58.240617 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79486ad-a906-4764-a984-dbe6402e9884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:58.241486 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79486ad-a906-4764-a984-dbe6402e9884 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:58.241762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79486ad-a906-4764-a984-dbe6402e9884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:58.242032 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79486ad-a906-4764-a984-dbe6402e9884 admin admin] PATH_INFO: `/v3/projects/f4b165849ac04bc4954b88983e0cb01c/users/2c4e07b4114141db814d4ff617010042/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:58.256716 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79486ad-a906-4764-a984-dbe6402e9884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b165849ac04bc4954b88983e0cb01c, user_id=2c4e07b4114141db814d4ff617010042, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:58.259423 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79486ad-a906-4764-a984-dbe6402e9884 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:58.274968 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 872/1749] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:58 2022] PUT /identity/v3/projects/f4b165849ac04bc4954b88983e0cb01c/users/2c4e07b4114141db814d4ff617010042/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:41:58.285801 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01b3ac-7f1f-47d4-9ab2-d9b2e61002c0 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:58.286733 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01b3ac-7f1f-47d4-9ab2-d9b2e61002c0 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:58.287018 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01b3ac-7f1f-47d4-9ab2-d9b2e61002c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:58.312805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-ca01b3ac-7f1f-47d4-9ab2-d9b2e61002c0 None None] MFA Rules not processed for user `2c4e07b4114141db814d4ff617010042`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:58.314139 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-ca01b3ac-7f1f-47d4-9ab2-d9b2e61002c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:58.376065 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 878/1750] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:58 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:58.380640 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79486ad-a906-4764-a984-dbe6402e9884 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:58.441459 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79486ad-a906-4764-a984-dbe6402e9884 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:58.450918 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8761f3c-5be5-4c6e-bcca-1ec20455dede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:58.452419 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8761f3c-5be5-4c6e-bcca-1ec20455dede admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:58.452419 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8761f3c-5be5-4c6e-bcca-1ec20455dede admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:58.452599 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8761f3c-5be5-4c6e-bcca-1ec20455dede admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:58.453329 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8761f3c-5be5-4c6e-bcca-1ec20455dede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:58.455257 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8761f3c-5be5-4c6e-bcca-1ec20455dede admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:58.482422 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 873/1751] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:41:58 2022] POST /identity/v3/projects => generated 357 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:58.486393 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01b3ac-7f1f-47d4-9ab2-d9b2e61002c0 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:58.497159 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01b3ac-7f1f-47d4-9ab2-d9b2e61002c0 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:58.553382 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26346f9a-43a9-48ab-84c7-33710b0d1e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:58.554046 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26346f9a-43a9-48ab-84c7-33710b0d1e8f admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:58.554328 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26346f9a-43a9-48ab-84c7-33710b0d1e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:58.554604 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26346f9a-43a9-48ab-84c7-33710b0d1e8f admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:58.555316 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26346f9a-43a9-48ab-84c7-33710b0d1e8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:58.557295 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26346f9a-43a9-48ab-84c7-33710b0d1e8f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:58.580262 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 879/1752] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:41:58 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:41:58.581649 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8761f3c-5be5-4c6e-bcca-1ec20455dede admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:58.593455 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8761f3c-5be5-4c6e-bcca-1ec20455dede admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:58.598294 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133c1f0-7e00-4808-9c6c-a41f8ad7cbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:58.599592 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133c1f0-7e00-4808-9c6c-a41f8ad7cbdb admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:58.599940 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133c1f0-7e00-4808-9c6c-a41f8ad7cbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:58.600190 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133c1f0-7e00-4808-9c6c-a41f8ad7cbdb admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:58.600945 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133c1f0-7e00-4808-9c6c-a41f8ad7cbdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:58.602566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133c1f0-7e00-4808-9c6c-a41f8ad7cbdb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:58.614510 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 874/1753] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:41:58.619261 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26346f9a-43a9-48ab-84c7-33710b0d1e8f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:58.629296 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26346f9a-43a9-48ab-84c7-33710b0d1e8f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:58.634202 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c78803-9a88-4c46-be0e-ea0a17b8cbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:58.635067 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c78803-9a88-4c46-be0e-ea0a17b8cbcd admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:58.635348 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c78803-9a88-4c46-be0e-ea0a17b8cbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:58.635625 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c78803-9a88-4c46-be0e-ea0a17b8cbcd admin admin] PATH_INFO: `/v3/projects/8711314581d24d81b91ff7bbd6eebaba/users/59c490a5580f4cebb05c8d3ba1b483fc/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:58.650011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c78803-9a88-4c46-be0e-ea0a17b8cbcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8711314581d24d81b91ff7bbd6eebaba, user_id=59c490a5580f4cebb05c8d3ba1b483fc, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:58.652697 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c78803-9a88-4c46-be0e-ea0a17b8cbcd admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:58.666085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 880/1754] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:58 2022] PUT /identity/v3/projects/8711314581d24d81b91ff7bbd6eebaba/users/59c490a5580f4cebb05c8d3ba1b483fc/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:41:58.670007 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133c1f0-7e00-4808-9c6c-a41f8ad7cbdb admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:58.679991 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133c1f0-7e00-4808-9c6c-a41f8ad7cbdb admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:58.739534 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e352c27-5ff0-4eea-9ae8-fd9333ae7b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:58.740274 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e352c27-5ff0-4eea-9ae8-fd9333ae7b0c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:58.740561 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e352c27-5ff0-4eea-9ae8-fd9333ae7b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:58.740841 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e352c27-5ff0-4eea-9ae8-fd9333ae7b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:58.741583 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e352c27-5ff0-4eea-9ae8-fd9333ae7b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:58.743847 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e352c27-5ff0-4eea-9ae8-fd9333ae7b0c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:58.755288 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 875/1755] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:41:58.759995 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c78803-9a88-4c46-be0e-ea0a17b8cbcd admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:58.770174 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c78803-9a88-4c46-be0e-ea0a17b8cbcd admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:58.775661 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d75dd-e6d6-4e51-ad14-e55e478fafb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:58.776574 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d75dd-e6d6-4e51-ad14-e55e478fafb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:58.776858 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d75dd-e6d6-4e51-ad14-e55e478fafb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:58.777136 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d75dd-e6d6-4e51-ad14-e55e478fafb7 admin admin] PATH_INFO: `/v3/projects/8711314581d24d81b91ff7bbd6eebaba/users/59c490a5580f4cebb05c8d3ba1b483fc/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:58.779143 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d75dd-e6d6-4e51-ad14-e55e478fafb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8711314581d24d81b91ff7bbd6eebaba, user_id=59c490a5580f4cebb05c8d3ba1b483fc, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:58.781821 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d75dd-e6d6-4e51-ad14-e55e478fafb7 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:58.792715 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 881/1756] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:41:58 2022] PUT /identity/v3/projects/8711314581d24d81b91ff7bbd6eebaba/users/59c490a5580f4cebb05c8d3ba1b483fc/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:41:58.802928 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d2322-de6d-4242-a9ca-989c0fbc7cd7 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:58.803218 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d2322-de6d-4242-a9ca-989c0fbc7cd7 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:58.803501 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d2322-de6d-4242-a9ca-989c0fbc7cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:58.831372 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f07d2322-de6d-4242-a9ca-989c0fbc7cd7 None None] MFA Rules not processed for user `59c490a5580f4cebb05c8d3ba1b483fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:41:58.832540 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f07d2322-de6d-4242-a9ca-989c0fbc7cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:58.913517 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 876/1757] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:41:58 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:41:58.939739 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d75dd-e6d6-4e51-ad14-e55e478fafb7 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:58.941890 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-ba1d75dd-e6d6-4e51-ad14-e55e478fafb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:41:58.996137 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d75dd-e6d6-4e51-ad14-e55e478fafb7 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:58.999718 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48c515-00ee-4109-b46d-3f4b65d0fb7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:59.000381 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48c515-00ee-4109-b46d-3f4b65d0fb7d service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:59.000662 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48c515-00ee-4109-b46d-3f4b65d0fb7d service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:59.000934 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48c515-00ee-4109-b46d-3f4b65d0fb7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:59.009925 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48c515-00ee-4109-b46d-3f4b65d0fb7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:59.011346 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48c515-00ee-4109-b46d-3f4b65d0fb7d service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:59.021049 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 882/1758] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:58 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:41:59.098195 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d2322-de6d-4242-a9ca-989c0fbc7cd7 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:41:59.108410 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d2322-de6d-4242-a9ca-989c0fbc7cd7 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:41:59.112283 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7421b3-1078-4cd7-8dca-e06e4aa98992 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:41:59.113310 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7421b3-1078-4cd7-8dca-e06e4aa98992 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:41:59.113597 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7421b3-1078-4cd7-8dca-e06e4aa98992 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:41:59.113874 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7421b3-1078-4cd7-8dca-e06e4aa98992 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:41:59.182020 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7421b3-1078-4cd7-8dca-e06e4aa98992 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:41:59.183576 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7421b3-1078-4cd7-8dca-e06e4aa98992 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:41:59.192950 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 877/1759] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:41:59 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:42:02.622926 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e562d-b1d4-431d-9417-1cca92484d3d None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:02.623504 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e562d-b1d4-431d-9417-1cca92484d3d None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:02.623596 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e562d-b1d4-431d-9417-1cca92484d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:02.644900 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-d35e562d-b1d4-431d-9417-1cca92484d3d None None] MFA Rules not processed for user `0b936dc9a67846f08e51648e64c3d6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:02.646113 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d35e562d-b1d4-431d-9417-1cca92484d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:02.729856 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 883/1760] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Feb 8 16:42:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:02.751332 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7421b3-1078-4cd7-8dca-e06e4aa98992 service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:02.752765 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-eb7421b3-1078-4cd7-8dca-e06e4aa98992 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:02.758664 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e562d-b1d4-431d-9417-1cca92484d3d None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:02.760157 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d35e562d-b1d4-431d-9417-1cca92484d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:02.765787 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7421b3-1078-4cd7-8dca-e06e4aa98992 service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:02.769354 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2594b-9097-43b9-9fbd-3e038f053a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:02.769988 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2594b-9097-43b9-9fbd-3e038f053a1c service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:02.770265 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2594b-9097-43b9-9fbd-3e038f053a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:02.770537 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2594b-9097-43b9-9fbd-3e038f053a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:02.770871 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e562d-b1d4-431d-9417-1cca92484d3d None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:02.775591 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d2e5a-80d1-4d43-baba-d66b5fbe91dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:02.776368 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d2e5a-80d1-4d43-baba-d66b5fbe91dc service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:02.776726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d2e5a-80d1-4d43-baba-d66b5fbe91dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:02.777069 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d2e5a-80d1-4d43-baba-d66b5fbe91dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:02.780861 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2594b-9097-43b9-9fbd-3e038f053a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:02.782292 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2594b-9097-43b9-9fbd-3e038f053a1c service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:02.786872 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d2e5a-80d1-4d43-baba-d66b5fbe91dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:02.789646 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d2e5a-80d1-4d43-baba-d66b5fbe91dc service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:02.790617 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 878/1761] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:42:02.799575 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 884/1762] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:42:03.636825 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2594b-9097-43b9-9fbd-3e038f053a1c service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:03.644072 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-87c2594b-9097-43b9-9fbd-3e038f053a1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:03.665957 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2594b-9097-43b9-9fbd-3e038f053a1c service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:03.671810 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525c12f-7a3e-42b3-876e-71f8c5315945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:03.672845 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525c12f-7a3e-42b3-876e-71f8c5315945 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:03.673335 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525c12f-7a3e-42b3-876e-71f8c5315945 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:03.673840 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525c12f-7a3e-42b3-876e-71f8c5315945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:03.676175 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4525c12f-7a3e-42b3-876e-71f8c5315945 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:03.759298 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525c12f-7a3e-42b3-876e-71f8c5315945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:03.764116 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585a341-a3f4-4ac7-b656-5386283cb22c None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:03.764949 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585a341-a3f4-4ac7-b656-5386283cb22c None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:03.765444 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585a341-a3f4-4ac7-b656-5386283cb22c None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:03.767666 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525c12f-7a3e-42b3-876e-71f8c5315945 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:03.768165 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 885/1763] 10.222.0.35 () {54 vars in 921 bytes} [Tue Feb 8 16:42:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:42:03.780555 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 879/1764] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:03 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:42:03.837229 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e378d-c523-4b93-be7e-8b1046ce1ff7 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:03.837329 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e378d-c523-4b93-be7e-8b1046ce1ff7 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:03.837756 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e378d-c523-4b93-be7e-8b1046ce1ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:03.874937 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-ee8e378d-c523-4b93-be7e-8b1046ce1ff7 None None] MFA Rules not processed for user `ccb02e5d8ef14f8f85bbacfa5b1f5be3`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:03.884070 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-ee8e378d-c523-4b93-be7e-8b1046ce1ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:04.050289 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 886/1765] 10.222.0.35 () {58 vars in 1018 bytes} [Tue Feb 8 16:42:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:04.081694 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525c12f-7a3e-42b3-876e-71f8c5315945 service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:04.083918 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4525c12f-7a3e-42b3-876e-71f8c5315945 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:04.123451 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525c12f-7a3e-42b3-876e-71f8c5315945 service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:04.161245 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187737d8-fb4b-4199-b759-48c22db8fcf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:04.162230 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187737d8-fb4b-4199-b759-48c22db8fcf0 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:04.163166 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187737d8-fb4b-4199-b759-48c22db8fcf0 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:04.163525 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187737d8-fb4b-4199-b759-48c22db8fcf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:04.196975 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187737d8-fb4b-4199-b759-48c22db8fcf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:04.199602 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187737d8-fb4b-4199-b759-48c22db8fcf0 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:04.221669 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 880/1766] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:42:04.894517 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e378d-c523-4b93-be7e-8b1046ce1ff7 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:04.897075 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-ee8e378d-c523-4b93-be7e-8b1046ce1ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:04.922594 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2c94c-3cbe-47c1-a7dc-95f7547ec0d0 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:04.923134 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2c94c-3cbe-47c1-a7dc-95f7547ec0d0 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:04.926148 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2c94c-3cbe-47c1-a7dc-95f7547ec0d0 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:04.928705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 881/1767] 10.222.0.35 () {54 vars in 921 bytes} [Tue Feb 8 16:42:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 08 16:42:04.964740 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebdd3d-0139-4e48-995a-f72be6bfa68b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:04.965311 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebdd3d-0139-4e48-995a-f72be6bfa68b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:04.965783 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebdd3d-0139-4e48-995a-f72be6bfa68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:04.997354 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e378d-c523-4b93-be7e-8b1046ce1ff7 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:05.005650 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96327ad-bddb-4679-95a0-8bd66bf42047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:05.007043 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-3eebdd3d-0139-4e48-995a-f72be6bfa68b None None] MFA Rules not processed for user `ccb02e5d8ef14f8f85bbacfa5b1f5be3`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:05.007402 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96327ad-bddb-4679-95a0-8bd66bf42047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:05.008640 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96327ad-bddb-4679-95a0-8bd66bf42047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:05.009193 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3eebdd3d-0139-4e48-995a-f72be6bfa68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:05.009496 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96327ad-bddb-4679-95a0-8bd66bf42047 admin admin] PATH_INFO: `/v3/users/672797952598404abf11364c19fbe549` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:05.011084 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96327ad-bddb-4679-95a0-8bd66bf42047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=672797952598404abf11364c19fbe549)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:05.013573 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96327ad-bddb-4679-95a0-8bd66bf42047 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:05.035665 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 882/1768] 10.222.0.35 () {58 vars in 1018 bytes} [Tue Feb 8 16:42:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:05.100343 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b96327ad-bddb-4679-95a0-8bd66bf42047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '672797952598404abf11364c19fbe549'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:05.117676 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b96327ad-bddb-4679-95a0-8bd66bf42047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '672797952598404abf11364c19fbe549'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:05.154415 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b96327ad-bddb-4679-95a0-8bd66bf42047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '672797952598404abf11364c19fbe549'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:05.165894 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b96327ad-bddb-4679-95a0-8bd66bf42047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '672797952598404abf11364c19fbe549'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:05.166838 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b96327ad-bddb-4679-95a0-8bd66bf42047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '672797952598404abf11364c19fbe549'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:05.179584 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 887/1769] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:42:04 2022] DELETE /identity/v3/users/672797952598404abf11364c19fbe549 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:05.184198 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc9f30-e5bc-4ab8-a173-743c76b94603 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:05.184774 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc9f30-e5bc-4ab8-a173-743c76b94603 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:05.185247 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc9f30-e5bc-4ab8-a173-743c76b94603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:05.215283 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-b9cc9f30-e5bc-4ab8-a173-743c76b94603 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:05.217179 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b9cc9f30-e5bc-4ab8-a173-743c76b94603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:05.295296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 883/1770] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:42:05.313752 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96327ad-bddb-4679-95a0-8bd66bf42047 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:05.314661 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-b96327ad-bddb-4679-95a0-8bd66bf42047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:05.363712 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc9f30-e5bc-4ab8-a173-743c76b94603 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:05.365285 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b9cc9f30-e5bc-4ab8-a173-743c76b94603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:05.410725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96327ad-bddb-4679-95a0-8bd66bf42047 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:05.416641 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1c578-ea1a-4244-8fc6-edbb26f74057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:05.417729 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1c578-ea1a-4244-8fc6-edbb26f74057 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:05.418203 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1c578-ea1a-4244-8fc6-edbb26f74057 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:05.418667 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1c578-ea1a-4244-8fc6-edbb26f74057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:05.431555 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1c578-ea1a-4244-8fc6-edbb26f74057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:05.433849 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1c578-ea1a-4244-8fc6-edbb26f74057 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:05.446524 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 888/1771] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:42:05.453282 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc9f30-e5bc-4ab8-a173-743c76b94603 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:05.461254 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2a22b-18e0-424f-9904-50a1ddd4a945 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:05.461962 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2a22b-18e0-424f-9904-50a1ddd4a945 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:05.462254 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2a22b-18e0-424f-9904-50a1ddd4a945 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:05.462540 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2a22b-18e0-424f-9904-50a1ddd4a945 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:05.464437 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6ec2a22b-18e0-424f-9904-50a1ddd4a945 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:05.477597 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2a22b-18e0-424f-9904-50a1ddd4a945 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:05.479212 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2a22b-18e0-424f-9904-50a1ddd4a945 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:05.490151 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 884/1772] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:42:06.032716 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1c578-ea1a-4244-8fc6-edbb26f74057 service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:06.034820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-19b1c578-ea1a-4244-8fc6-edbb26f74057 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:06.057487 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1c578-ea1a-4244-8fc6-edbb26f74057 service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:06.064944 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11130b-1a09-4500-b45e-2fd321f16bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:06.065973 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11130b-1a09-4500-b45e-2fd321f16bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:06.066384 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11130b-1a09-4500-b45e-2fd321f16bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:06.066676 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11130b-1a09-4500-b45e-2fd321f16bdb admin admin] PATH_INFO: `/v3/projects/83b561fd8da94cdd9e7e14ec558c63de` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:06.068135 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11130b-1a09-4500-b45e-2fd321f16bdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b561fd8da94cdd9e7e14ec558c63de)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:06.070479 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11130b-1a09-4500-b45e-2fd321f16bdb admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:06.122744 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fb11130b-1a09-4500-b45e-2fd321f16bdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b561fd8da94cdd9e7e14ec558c63de', 'request_id': 'req-fb11130b-1a09-4500-b45e-2fd321f16bdb'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:06.128799 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fb11130b-1a09-4500-b45e-2fd321f16bdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b561fd8da94cdd9e7e14ec558c63de', 'request_id': 'req-fb11130b-1a09-4500-b45e-2fd321f16bdb'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:06.136155 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fb11130b-1a09-4500-b45e-2fd321f16bdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b561fd8da94cdd9e7e14ec558c63de', 'request_id': 'req-fb11130b-1a09-4500-b45e-2fd321f16bdb'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:06.150444 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fb11130b-1a09-4500-b45e-2fd321f16bdb admin admin] The token cache is being invalidate because project 83b561fd8da94cdd9e7e14ec558c63de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:06.150733 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fb11130b-1a09-4500-b45e-2fd321f16bdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:06.151370 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fb11130b-1a09-4500-b45e-2fd321f16bdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:06.152962 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 889/1773] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:06 2022] DELETE /identity/v3/projects/83b561fd8da94cdd9e7e14ec558c63de => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:06.156922 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2a22b-18e0-424f-9904-50a1ddd4a945 service nova] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:06.177215 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2a22b-18e0-424f-9904-50a1ddd4a945 service nova] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:06.267694 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4c8a2-f437-4b91-976e-1d1ee1c8c296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:06.271102 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4c8a2-f437-4b91-976e-1d1ee1c8c296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:06.271102 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4c8a2-f437-4b91-976e-1d1ee1c8c296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:06.271102 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4c8a2-f437-4b91-976e-1d1ee1c8c296 admin admin] PATH_INFO: `/v3/users/589b569e26e8481195ee90538c2cc81d` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:06.274346 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4c8a2-f437-4b91-976e-1d1ee1c8c296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=589b569e26e8481195ee90538c2cc81d)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:06.284798 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4c8a2-f437-4b91-976e-1d1ee1c8c296 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:06.390039 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1dc4c8a2-f437-4b91-976e-1d1ee1c8c296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '589b569e26e8481195ee90538c2cc81d'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:06.397935 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1dc4c8a2-f437-4b91-976e-1d1ee1c8c296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '589b569e26e8481195ee90538c2cc81d'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:06.409677 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1dc4c8a2-f437-4b91-976e-1d1ee1c8c296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '589b569e26e8481195ee90538c2cc81d'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:06.417963 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1dc4c8a2-f437-4b91-976e-1d1ee1c8c296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '589b569e26e8481195ee90538c2cc81d'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:06.418782 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1dc4c8a2-f437-4b91-976e-1d1ee1c8c296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '589b569e26e8481195ee90538c2cc81d'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:06.424934 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 885/1774] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:42:06 2022] DELETE /identity/v3/users/589b569e26e8481195ee90538c2cc81d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:06.713647 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11130b-1a09-4500-b45e-2fd321f16bdb admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:06.715102 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-fb11130b-1a09-4500-b45e-2fd321f16bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:06.729905 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11130b-1a09-4500-b45e-2fd321f16bdb admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:06.786347 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d8e68-199d-421a-9e38-2dbbbf77bb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:06.787140 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d8e68-199d-421a-9e38-2dbbbf77bb78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:06.788047 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d8e68-199d-421a-9e38-2dbbbf77bb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:06.788526 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d8e68-199d-421a-9e38-2dbbbf77bb78 admin admin] PATH_INFO: `/v3/projects/c2d6747d54bc48eb83c75e0e4a9803a4` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:06.789863 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d8e68-199d-421a-9e38-2dbbbf77bb78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d6747d54bc48eb83c75e0e4a9803a4)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:06.791880 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d8e68-199d-421a-9e38-2dbbbf77bb78 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:06.840377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e00d8e68-199d-421a-9e38-2dbbbf77bb78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d6747d54bc48eb83c75e0e4a9803a4', 'request_id': 'req-e00d8e68-199d-421a-9e38-2dbbbf77bb78'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:06.846582 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e00d8e68-199d-421a-9e38-2dbbbf77bb78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d6747d54bc48eb83c75e0e4a9803a4', 'request_id': 'req-e00d8e68-199d-421a-9e38-2dbbbf77bb78'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:06.852532 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e00d8e68-199d-421a-9e38-2dbbbf77bb78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d6747d54bc48eb83c75e0e4a9803a4', 'request_id': 'req-e00d8e68-199d-421a-9e38-2dbbbf77bb78'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:06.865282 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e00d8e68-199d-421a-9e38-2dbbbf77bb78 admin admin] The token cache is being invalidate because project c2d6747d54bc48eb83c75e0e4a9803a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:06.866025 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e00d8e68-199d-421a-9e38-2dbbbf77bb78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:06.866788 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e00d8e68-199d-421a-9e38-2dbbbf77bb78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:06.868397 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 890/1775] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:06 2022] DELETE /identity/v3/projects/c2d6747d54bc48eb83c75e0e4a9803a4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:06.873978 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244e234-a43d-4a9d-822e-f41e1c63d939 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:06.874444 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244e234-a43d-4a9d-822e-f41e1c63d939 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:06.874725 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244e234-a43d-4a9d-822e-f41e1c63d939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:06.893758 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-a244e234-a43d-4a9d-822e-f41e1c63d939 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:06.894948 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a244e234-a43d-4a9d-822e-f41e1c63d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:06.953729 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 886/1776] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:06.961896 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebecc92-1714-42f0-a32d-ad25c9ce20ab None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:06.962234 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebecc92-1714-42f0-a32d-ad25c9ce20ab None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:06.962509 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebecc92-1714-42f0-a32d-ad25c9ce20ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:06.980242 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-5ebecc92-1714-42f0-a32d-ad25c9ce20ab None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:06.981434 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5ebecc92-1714-42f0-a32d-ad25c9ce20ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:06.989204 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 891/1777] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:06.993349 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244e234-a43d-4a9d-822e-f41e1c63d939 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:07.002730 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244e234-a43d-4a9d-822e-f41e1c63d939 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:07.007776 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7c599-e4b4-4569-9849-8de00ed1e141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:07.008424 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7c599-e4b4-4569-9849-8de00ed1e141 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:07.008699 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7c599-e4b4-4569-9849-8de00ed1e141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:07.008970 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7c599-e4b4-4569-9849-8de00ed1e141 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:07.009718 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7c599-e4b4-4569-9849-8de00ed1e141 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:42:07.010020 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7c599-e4b4-4569-9849-8de00ed1e141 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:07.011617 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7c599-e4b4-4569-9849-8de00ed1e141 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:07.023302 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 887/1778] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:42:07.027393 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebecc92-1714-42f0-a32d-ad25c9ce20ab None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:07.036579 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebecc92-1714-42f0-a32d-ad25c9ce20ab None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:07.041366 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eba0e2-05f9-4bfe-ad11-b9b068cb47ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:07.042004 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eba0e2-05f9-4bfe-ad11-b9b068cb47ad admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:07.042282 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eba0e2-05f9-4bfe-ad11-b9b068cb47ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:07.042554 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eba0e2-05f9-4bfe-ad11-b9b068cb47ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:07.043253 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eba0e2-05f9-4bfe-ad11-b9b068cb47ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:07.045201 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eba0e2-05f9-4bfe-ad11-b9b068cb47ad admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:07.073228 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 892/1779] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:42:07 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:42:07.074944 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7c599-e4b4-4569-9849-8de00ed1e141 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:07.085132 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7c599-e4b4-4569-9849-8de00ed1e141 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:07.137719 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd74393-5da6-48ef-bb6c-9380ec508ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:07.138370 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd74393-5da6-48ef-bb6c-9380ec508ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:07.138682 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd74393-5da6-48ef-bb6c-9380ec508ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:07.138982 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd74393-5da6-48ef-bb6c-9380ec508ec2 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:07.139742 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd74393-5da6-48ef-bb6c-9380ec508ec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:07.141630 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd74393-5da6-48ef-bb6c-9380ec508ec2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:07.161130 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 888/1780] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:42:07 2022] POST /identity/v3/users => generated 283 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:42:07.165510 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eba0e2-05f9-4bfe-ad11-b9b068cb47ad admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:07.175622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eba0e2-05f9-4bfe-ad11-b9b068cb47ad admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:07.180460 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3338e9d-9d31-41e6-97c3-37f1310b8237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:07.181104 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3338e9d-9d31-41e6-97c3-37f1310b8237 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:07.181411 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3338e9d-9d31-41e6-97c3-37f1310b8237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:07.181686 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3338e9d-9d31-41e6-97c3-37f1310b8237 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:07.182415 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3338e9d-9d31-41e6-97c3-37f1310b8237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:07.184019 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3338e9d-9d31-41e6-97c3-37f1310b8237 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:07.194526 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 893/1781] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:42:07.198561 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd74393-5da6-48ef-bb6c-9380ec508ec2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:07.208068 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd74393-5da6-48ef-bb6c-9380ec508ec2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:07.213213 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920812db-27c5-421c-9940-cfd9bcfded24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:07.213848 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920812db-27c5-421c-9940-cfd9bcfded24 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:07.214129 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920812db-27c5-421c-9940-cfd9bcfded24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:07.214404 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920812db-27c5-421c-9940-cfd9bcfded24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:07.215223 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920812db-27c5-421c-9940-cfd9bcfded24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:07.216825 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920812db-27c5-421c-9940-cfd9bcfded24 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:07.226361 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 889/1782] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:07.230205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3338e9d-9d31-41e6-97c3-37f1310b8237 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:07.239863 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3338e9d-9d31-41e6-97c3-37f1310b8237 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:07.244906 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3108ad1-fcaf-4b09-92c6-b25768710e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:07.245755 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3108ad1-fcaf-4b09-92c6-b25768710e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:07.246035 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3108ad1-fcaf-4b09-92c6-b25768710e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:07.246307 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3108ad1-fcaf-4b09-92c6-b25768710e18 admin admin] PATH_INFO: `/v3/projects/6f60d6a8c55a4cb9bd34a76961775131/users/39e3aaa94d524c31af8ad4aedcce5ad5/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:07.261074 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3108ad1-fcaf-4b09-92c6-b25768710e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f60d6a8c55a4cb9bd34a76961775131, user_id=39e3aaa94d524c31af8ad4aedcce5ad5, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:07.263728 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3108ad1-fcaf-4b09-92c6-b25768710e18 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:07.277126 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 894/1783] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:07 2022] PUT /identity/v3/projects/6f60d6a8c55a4cb9bd34a76961775131/users/39e3aaa94d524c31af8ad4aedcce5ad5/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:07.287362 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff811b8-b4e8-401f-986f-7704df2c6b8a None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:07.287599 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff811b8-b4e8-401f-986f-7704df2c6b8a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:07.288026 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff811b8-b4e8-401f-986f-7704df2c6b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:07.313999 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-cff811b8-b4e8-401f-986f-7704df2c6b8a None None] MFA Rules not processed for user `39e3aaa94d524c31af8ad4aedcce5ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:07.315241 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cff811b8-b4e8-401f-986f-7704df2c6b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:07.377483 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 890/1784] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:07.383137 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3108ad1-fcaf-4b09-92c6-b25768710e18 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:07.443189 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3108ad1-fcaf-4b09-92c6-b25768710e18 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:07.448702 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb65627-31b7-40f1-a837-1a6a3163f053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:07.449354 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb65627-31b7-40f1-a837-1a6a3163f053 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:07.449640 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb65627-31b7-40f1-a837-1a6a3163f053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:07.449915 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb65627-31b7-40f1-a837-1a6a3163f053 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:07.450634 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb65627-31b7-40f1-a837-1a6a3163f053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:07.452567 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb65627-31b7-40f1-a837-1a6a3163f053 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:07.481485 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 895/1785] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:42:07 2022] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:42:07.483922 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff811b8-b4e8-401f-986f-7704df2c6b8a None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:07.495680 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff811b8-b4e8-401f-986f-7704df2c6b8a None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:07.563212 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7b3a8-f7b9-46c4-affb-0b954a6d0ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:07.563933 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7b3a8-f7b9-46c4-affb-0b954a6d0ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:07.564221 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7b3a8-f7b9-46c4-affb-0b954a6d0ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:07.564497 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7b3a8-f7b9-46c4-affb-0b954a6d0ba7 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:07.565216 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7b3a8-f7b9-46c4-affb-0b954a6d0ba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:07.567129 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7b3a8-f7b9-46c4-affb-0b954a6d0ba7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:07.598646 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 891/1786] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:42:07 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:42:07.605857 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb65627-31b7-40f1-a837-1a6a3163f053 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:07.618939 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb65627-31b7-40f1-a837-1a6a3163f053 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:07.623829 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7585f-72dc-43ef-aaf2-a0c24dd034bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:07.624612 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7585f-72dc-43ef-aaf2-a0c24dd034bf admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:07.624894 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7585f-72dc-43ef-aaf2-a0c24dd034bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:07.625181 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7585f-72dc-43ef-aaf2-a0c24dd034bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:07.625923 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7585f-72dc-43ef-aaf2-a0c24dd034bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:07.627529 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7585f-72dc-43ef-aaf2-a0c24dd034bf admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:07.641745 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 896/1787] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:07.645940 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7b3a8-f7b9-46c4-affb-0b954a6d0ba7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:07.656162 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7b3a8-f7b9-46c4-affb-0b954a6d0ba7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:07.660773 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c15db0-ac9b-47f3-bd67-e6312ee43c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:07.661644 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c15db0-ac9b-47f3-bd67-e6312ee43c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:07.661921 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c15db0-ac9b-47f3-bd67-e6312ee43c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:07.662193 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c15db0-ac9b-47f3-bd67-e6312ee43c71 admin admin] PATH_INFO: `/v3/projects/9ea6a7b9d10e492c95a1eb529d04fa17/users/19f1ccad1823443596f65891e5eeb866/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:07.678021 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c15db0-ac9b-47f3-bd67-e6312ee43c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea6a7b9d10e492c95a1eb529d04fa17, user_id=19f1ccad1823443596f65891e5eeb866, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:07.681636 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c15db0-ac9b-47f3-bd67-e6312ee43c71 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:07.695461 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 892/1788] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:07 2022] PUT /identity/v3/projects/9ea6a7b9d10e492c95a1eb529d04fa17/users/19f1ccad1823443596f65891e5eeb866/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:07.699387 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7585f-72dc-43ef-aaf2-a0c24dd034bf admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:07.709731 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7585f-72dc-43ef-aaf2-a0c24dd034bf admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:07.774599 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afb81a-f591-47cd-8bfe-a811e8fa98fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:07.775269 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afb81a-f591-47cd-8bfe-a811e8fa98fa admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:07.775553 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afb81a-f591-47cd-8bfe-a811e8fa98fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:07.775865 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afb81a-f591-47cd-8bfe-a811e8fa98fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:07.776640 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afb81a-f591-47cd-8bfe-a811e8fa98fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:07.778265 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afb81a-f591-47cd-8bfe-a811e8fa98fa admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:07.789185 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 897/1789] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:07.793251 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c15db0-ac9b-47f3-bd67-e6312ee43c71 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:07.804051 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c15db0-ac9b-47f3-bd67-e6312ee43c71 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:07.808580 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d705557-d5a7-4fd5-8dab-ec01a5e4ba55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:07.809481 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d705557-d5a7-4fd5-8dab-ec01a5e4ba55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:07.809761 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d705557-d5a7-4fd5-8dab-ec01a5e4ba55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:07.810034 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d705557-d5a7-4fd5-8dab-ec01a5e4ba55 admin admin] PATH_INFO: `/v3/projects/9ea6a7b9d10e492c95a1eb529d04fa17/users/19f1ccad1823443596f65891e5eeb866/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:07.812519 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d705557-d5a7-4fd5-8dab-ec01a5e4ba55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea6a7b9d10e492c95a1eb529d04fa17, user_id=19f1ccad1823443596f65891e5eeb866, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:07.815135 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d705557-d5a7-4fd5-8dab-ec01a5e4ba55 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:07.826124 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 893/1790] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:07 2022] PUT /identity/v3/projects/9ea6a7b9d10e492c95a1eb529d04fa17/users/19f1ccad1823443596f65891e5eeb866/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:07.841268 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714078b-2ce7-420a-a788-b02888a26454 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:07.841545 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714078b-2ce7-420a-a788-b02888a26454 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:07.841870 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714078b-2ce7-420a-a788-b02888a26454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:07.869162 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-e714078b-2ce7-420a-a788-b02888a26454 None None] MFA Rules not processed for user `19f1ccad1823443596f65891e5eeb866`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:07.870352 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-e714078b-2ce7-420a-a788-b02888a26454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:07.936022 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 898/1791] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:07 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:07.946963 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d705557-d5a7-4fd5-8dab-ec01a5e4ba55 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:07.948671 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7d705557-d5a7-4fd5-8dab-ec01a5e4ba55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:08.004360 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d705557-d5a7-4fd5-8dab-ec01a5e4ba55 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:08.008570 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b4e18-a1eb-4511-a67b-2a3182747bc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:08.009210 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b4e18-a1eb-4511-a67b-2a3182747bc5 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:08.009493 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b4e18-a1eb-4511-a67b-2a3182747bc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:08.009775 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b4e18-a1eb-4511-a67b-2a3182747bc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:08.018953 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b4e18-a1eb-4511-a67b-2a3182747bc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:08.020417 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b4e18-a1eb-4511-a67b-2a3182747bc5 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:08.030497 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 894/1792] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:07 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:42:08.104550 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714078b-2ce7-420a-a788-b02888a26454 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:08.114005 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714078b-2ce7-420a-a788-b02888a26454 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:08.117979 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91dada-5175-4886-8848-6c76ec46e71b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:08.118617 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91dada-5175-4886-8848-6c76ec46e71b service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:08.118900 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91dada-5175-4886-8848-6c76ec46e71b service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:08.119176 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91dada-5175-4886-8848-6c76ec46e71b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:08.175348 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91dada-5175-4886-8848-6c76ec46e71b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:08.176881 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91dada-5175-4886-8848-6c76ec46e71b service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:08.185979 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 899/1793] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:42:11.123466 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b4e18-a1eb-4511-a67b-2a3182747bc5 service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:11.249854 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b4e18-a1eb-4511-a67b-2a3182747bc5 service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:11.267342 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103aa18-2256-4269-ad06-e56f1ec48c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:11.269793 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103aa18-2256-4269-ad06-e56f1ec48c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:11.271324 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103aa18-2256-4269-ad06-e56f1ec48c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:11.272468 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103aa18-2256-4269-ad06-e56f1ec48c74 admin admin] PATH_INFO: `/v3/users/39e3aaa94d524c31af8ad4aedcce5ad5` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:11.275630 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103aa18-2256-4269-ad06-e56f1ec48c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39e3aaa94d524c31af8ad4aedcce5ad5)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:11.281833 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103aa18-2256-4269-ad06-e56f1ec48c74 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:11.354561 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6103aa18-2256-4269-ad06-e56f1ec48c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39e3aaa94d524c31af8ad4aedcce5ad5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:11.362538 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6103aa18-2256-4269-ad06-e56f1ec48c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39e3aaa94d524c31af8ad4aedcce5ad5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:11.379069 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6103aa18-2256-4269-ad06-e56f1ec48c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39e3aaa94d524c31af8ad4aedcce5ad5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:11.392484 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6103aa18-2256-4269-ad06-e56f1ec48c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39e3aaa94d524c31af8ad4aedcce5ad5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:11.394333 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6103aa18-2256-4269-ad06-e56f1ec48c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39e3aaa94d524c31af8ad4aedcce5ad5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:11.405695 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 895/1794] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:42:11 2022] DELETE /identity/v3/users/39e3aaa94d524c31af8ad4aedcce5ad5 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:11.411496 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024a1b1-27f2-418e-b5b3-31641188cbb8 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:11.412462 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024a1b1-27f2-418e-b5b3-31641188cbb8 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:11.413742 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024a1b1-27f2-418e-b5b3-31641188cbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:11.451884 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-d024a1b1-27f2-418e-b5b3-31641188cbb8 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:11.453327 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d024a1b1-27f2-418e-b5b3-31641188cbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:11.529955 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 900/1795] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:42:11.546289 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103aa18-2256-4269-ad06-e56f1ec48c74 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:11.548107 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6103aa18-2256-4269-ad06-e56f1ec48c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:11.676743 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103aa18-2256-4269-ad06-e56f1ec48c74 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:11.684990 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d291bcd-9ffb-4ee5-aad0-737dabfc003f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:11.686386 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d291bcd-9ffb-4ee5-aad0-737dabfc003f service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:11.688192 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d291bcd-9ffb-4ee5-aad0-737dabfc003f service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:11.688707 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d291bcd-9ffb-4ee5-aad0-737dabfc003f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:11.710996 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d291bcd-9ffb-4ee5-aad0-737dabfc003f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:11.712664 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d291bcd-9ffb-4ee5-aad0-737dabfc003f service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:11.728970 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 896/1796] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:42:12.672459 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024a1b1-27f2-418e-b5b3-31641188cbb8 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:12.673893 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d024a1b1-27f2-418e-b5b3-31641188cbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:12.697094 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024a1b1-27f2-418e-b5b3-31641188cbb8 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:12.713542 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1108034-cdc4-439a-bd74-3cb907164337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:12.716312 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1108034-cdc4-439a-bd74-3cb907164337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:12.716680 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1108034-cdc4-439a-bd74-3cb907164337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:12.721969 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1108034-cdc4-439a-bd74-3cb907164337 admin admin] PATH_INFO: `/v3/projects/6f60d6a8c55a4cb9bd34a76961775131` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:12.721969 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1108034-cdc4-439a-bd74-3cb907164337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f60d6a8c55a4cb9bd34a76961775131)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:12.721969 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1108034-cdc4-439a-bd74-3cb907164337 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:12.784979 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e1108034-cdc4-439a-bd74-3cb907164337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f60d6a8c55a4cb9bd34a76961775131', 'request_id': 'req-e1108034-cdc4-439a-bd74-3cb907164337'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:12.792217 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e1108034-cdc4-439a-bd74-3cb907164337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f60d6a8c55a4cb9bd34a76961775131', 'request_id': 'req-e1108034-cdc4-439a-bd74-3cb907164337'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:12.798457 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e1108034-cdc4-439a-bd74-3cb907164337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f60d6a8c55a4cb9bd34a76961775131', 'request_id': 'req-e1108034-cdc4-439a-bd74-3cb907164337'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:12.814476 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e1108034-cdc4-439a-bd74-3cb907164337 admin admin] The token cache is being invalidate because project 6f60d6a8c55a4cb9bd34a76961775131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:12.814798 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e1108034-cdc4-439a-bd74-3cb907164337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:12.815666 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e1108034-cdc4-439a-bd74-3cb907164337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:12.818085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 901/1797] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:12 2022] DELETE /identity/v3/projects/6f60d6a8c55a4cb9bd34a76961775131 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:12.822130 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d291bcd-9ffb-4ee5-aad0-737dabfc003f service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:12.835317 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d291bcd-9ffb-4ee5-aad0-737dabfc003f service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:12.911127 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220a31e-b8ad-4c3b-ad50-7aefb0ad8890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:12.912579 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220a31e-b8ad-4c3b-ad50-7aefb0ad8890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:12.912894 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220a31e-b8ad-4c3b-ad50-7aefb0ad8890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:12.913151 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220a31e-b8ad-4c3b-ad50-7aefb0ad8890 admin admin] PATH_INFO: `/v3/users/19f1ccad1823443596f65891e5eeb866` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:12.915303 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220a31e-b8ad-4c3b-ad50-7aefb0ad8890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19f1ccad1823443596f65891e5eeb866)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:12.917164 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220a31e-b8ad-4c3b-ad50-7aefb0ad8890 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:12.983456 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a220a31e-b8ad-4c3b-ad50-7aefb0ad8890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19f1ccad1823443596f65891e5eeb866'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:12.991197 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a220a31e-b8ad-4c3b-ad50-7aefb0ad8890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19f1ccad1823443596f65891e5eeb866'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:13.002538 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a220a31e-b8ad-4c3b-ad50-7aefb0ad8890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19f1ccad1823443596f65891e5eeb866'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:13.011585 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a220a31e-b8ad-4c3b-ad50-7aefb0ad8890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19f1ccad1823443596f65891e5eeb866'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:13.012296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a220a31e-b8ad-4c3b-ad50-7aefb0ad8890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19f1ccad1823443596f65891e5eeb866'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:13.018360 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 897/1798] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:42:12 2022] DELETE /identity/v3/users/19f1ccad1823443596f65891e5eeb866 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:13.278064 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1108034-cdc4-439a-bd74-3cb907164337 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:13.279582 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-e1108034-cdc4-439a-bd74-3cb907164337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:13.295336 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1108034-cdc4-439a-bd74-3cb907164337 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:13.352401 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695031d-9fdd-4673-9401-61237a5cbfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:13.353250 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695031d-9fdd-4673-9401-61237a5cbfbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:13.353534 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695031d-9fdd-4673-9401-61237a5cbfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:13.353810 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695031d-9fdd-4673-9401-61237a5cbfbb admin admin] PATH_INFO: `/v3/projects/9ea6a7b9d10e492c95a1eb529d04fa17` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:13.354996 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695031d-9fdd-4673-9401-61237a5cbfbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ea6a7b9d10e492c95a1eb529d04fa17)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:13.356937 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695031d-9fdd-4673-9401-61237a5cbfbb admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:13.401810 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-6695031d-9fdd-4673-9401-61237a5cbfbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ea6a7b9d10e492c95a1eb529d04fa17', 'request_id': 'req-6695031d-9fdd-4673-9401-61237a5cbfbb'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:13.407503 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-6695031d-9fdd-4673-9401-61237a5cbfbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ea6a7b9d10e492c95a1eb529d04fa17', 'request_id': 'req-6695031d-9fdd-4673-9401-61237a5cbfbb'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:13.413562 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-6695031d-9fdd-4673-9401-61237a5cbfbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ea6a7b9d10e492c95a1eb529d04fa17', 'request_id': 'req-6695031d-9fdd-4673-9401-61237a5cbfbb'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:13.425375 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-6695031d-9fdd-4673-9401-61237a5cbfbb admin admin] The token cache is being invalidate because project 9ea6a7b9d10e492c95a1eb529d04fa17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:13.425663 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-6695031d-9fdd-4673-9401-61237a5cbfbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:13.426287 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-6695031d-9fdd-4673-9401-61237a5cbfbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:13.427977 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 902/1799] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:13 2022] DELETE /identity/v3/projects/9ea6a7b9d10e492c95a1eb529d04fa17 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:13.433603 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d32b82-4e3e-4433-843e-83cdf61ae4cb None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:13.433896 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d32b82-4e3e-4433-843e-83cdf61ae4cb None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:13.434177 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d32b82-4e3e-4433-843e-83cdf61ae4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:13.453703 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-72d32b82-4e3e-4433-843e-83cdf61ae4cb None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:13.454913 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-72d32b82-4e3e-4433-843e-83cdf61ae4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:13.531569 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 898/1800] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:13.540046 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e74dad-2508-4bd8-986b-3f6999a30676 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:13.540337 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e74dad-2508-4bd8-986b-3f6999a30676 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:13.540618 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e74dad-2508-4bd8-986b-3f6999a30676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:13.561187 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-77e74dad-2508-4bd8-986b-3f6999a30676 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:13.562405 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-77e74dad-2508-4bd8-986b-3f6999a30676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:13.570730 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 903/1801] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:13.574982 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d32b82-4e3e-4433-843e-83cdf61ae4cb None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:13.585347 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d32b82-4e3e-4433-843e-83cdf61ae4cb None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:13.601973 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdf5a7-11bd-4b21-a0fd-182c0e435290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:13.602690 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdf5a7-11bd-4b21-a0fd-182c0e435290 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:13.602977 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdf5a7-11bd-4b21-a0fd-182c0e435290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:13.603259 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdf5a7-11bd-4b21-a0fd-182c0e435290 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:13.604362 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdf5a7-11bd-4b21-a0fd-182c0e435290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:42:13.604762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdf5a7-11bd-4b21-a0fd-182c0e435290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:13.606621 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdf5a7-11bd-4b21-a0fd-182c0e435290 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:13.621306 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 899/1802] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:42:13.625591 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e74dad-2508-4bd8-986b-3f6999a30676 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:13.637643 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e74dad-2508-4bd8-986b-3f6999a30676 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:13.642851 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178d14f-65e9-498f-b07a-860d3165a7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:13.643539 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178d14f-65e9-498f-b07a-860d3165a7a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:13.643855 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178d14f-65e9-498f-b07a-860d3165a7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:13.644263 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178d14f-65e9-498f-b07a-860d3165a7a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:13.644845 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178d14f-65e9-498f-b07a-860d3165a7a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:13.647537 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178d14f-65e9-498f-b07a-860d3165a7a0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:13.674198 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 904/1803] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:42:13 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:42:13.678304 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdf5a7-11bd-4b21-a0fd-182c0e435290 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:13.688790 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdf5a7-11bd-4b21-a0fd-182c0e435290 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:13.749024 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb69da-7fef-40f6-8c46-c4af0370cefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:13.749876 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb69da-7fef-40f6-8c46-c4af0370cefe admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:13.750172 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb69da-7fef-40f6-8c46-c4af0370cefe admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:13.750745 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb69da-7fef-40f6-8c46-c4af0370cefe admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:13.751286 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb69da-7fef-40f6-8c46-c4af0370cefe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:13.753227 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb69da-7fef-40f6-8c46-c4af0370cefe admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:13.779535 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 900/1804] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:42:13 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:42:13.780369 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178d14f-65e9-498f-b07a-860d3165a7a0 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:13.791495 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178d14f-65e9-498f-b07a-860d3165a7a0 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:13.796480 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19db42e-7608-45be-b881-7fd1adff9fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:13.797903 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19db42e-7608-45be-b881-7fd1adff9fca admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:13.798371 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19db42e-7608-45be-b881-7fd1adff9fca admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:13.798798 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19db42e-7608-45be-b881-7fd1adff9fca admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:13.799931 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19db42e-7608-45be-b881-7fd1adff9fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:13.801788 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19db42e-7608-45be-b881-7fd1adff9fca admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:13.814531 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 905/1805] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:42:13.818718 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb69da-7fef-40f6-8c46-c4af0370cefe admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:13.829615 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb69da-7fef-40f6-8c46-c4af0370cefe admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:13.834721 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646d493-1164-4014-898e-92f9bf547445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:13.835710 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646d493-1164-4014-898e-92f9bf547445 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:13.836084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646d493-1164-4014-898e-92f9bf547445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:13.836421 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646d493-1164-4014-898e-92f9bf547445 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:13.837215 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646d493-1164-4014-898e-92f9bf547445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:13.838863 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646d493-1164-4014-898e-92f9bf547445 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:13.850064 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 901/1806] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:13.854688 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19db42e-7608-45be-b881-7fd1adff9fca admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:13.864827 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19db42e-7608-45be-b881-7fd1adff9fca admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:13.870134 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f1f1a-ca59-4ebd-b752-6913f3c00d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:13.871039 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f1f1a-ca59-4ebd-b752-6913f3c00d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:13.871355 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f1f1a-ca59-4ebd-b752-6913f3c00d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:13.871638 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f1f1a-ca59-4ebd-b752-6913f3c00d62 admin admin] PATH_INFO: `/v3/projects/244baa94494c49859e4871f1b3fc30d0/users/e11fd16d5c3b43499fe0be9e5782c3d0/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:13.886344 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f1f1a-ca59-4ebd-b752-6913f3c00d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244baa94494c49859e4871f1b3fc30d0, user_id=e11fd16d5c3b43499fe0be9e5782c3d0, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:13.889062 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f1f1a-ca59-4ebd-b752-6913f3c00d62 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:13.911291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 906/1807] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:13 2022] PUT /identity/v3/projects/244baa94494c49859e4871f1b3fc30d0/users/e11fd16d5c3b43499fe0be9e5782c3d0/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:13.922541 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99a471-5c18-4120-8dd6-34dfcf0ff2c0 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:13.923277 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99a471-5c18-4120-8dd6-34dfcf0ff2c0 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:13.923725 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99a471-5c18-4120-8dd6-34dfcf0ff2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:13.960733 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2e99a471-5c18-4120-8dd6-34dfcf0ff2c0 None None] MFA Rules not processed for user `e11fd16d5c3b43499fe0be9e5782c3d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:13.962054 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2e99a471-5c18-4120-8dd6-34dfcf0ff2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:14.051537 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 902/1808] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:42:14.051705 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f1f1a-ca59-4ebd-b752-6913f3c00d62 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:14.133898 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f1f1a-ca59-4ebd-b752-6913f3c00d62 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:14.141275 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bce70a-5055-43ec-8aac-87be1d0113e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:14.144128 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bce70a-5055-43ec-8aac-87be1d0113e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:14.144425 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bce70a-5055-43ec-8aac-87be1d0113e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:14.144705 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bce70a-5055-43ec-8aac-87be1d0113e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:14.145443 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bce70a-5055-43ec-8aac-87be1d0113e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:14.148562 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bce70a-5055-43ec-8aac-87be1d0113e7 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:14.184669 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 907/1809] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:42:14 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:42:14.188712 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99a471-5c18-4120-8dd6-34dfcf0ff2c0 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:14.199473 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99a471-5c18-4120-8dd6-34dfcf0ff2c0 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:14.269811 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b532402-ac17-421c-a261-0d5d6e546b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:14.271062 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b532402-ac17-421c-a261-0d5d6e546b7e admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:14.271347 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b532402-ac17-421c-a261-0d5d6e546b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:14.272476 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b532402-ac17-421c-a261-0d5d6e546b7e admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:14.273414 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b532402-ac17-421c-a261-0d5d6e546b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:14.275394 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b532402-ac17-421c-a261-0d5d6e546b7e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:14.296507 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 903/1810] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:42:14 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:42:14.300540 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bce70a-5055-43ec-8aac-87be1d0113e7 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:14.316457 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bce70a-5055-43ec-8aac-87be1d0113e7 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:14.321586 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09346a-7cb8-41ab-b28c-00d6b3bdfc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:14.322249 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09346a-7cb8-41ab-b28c-00d6b3bdfc1c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:14.322522 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09346a-7cb8-41ab-b28c-00d6b3bdfc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:14.322799 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09346a-7cb8-41ab-b28c-00d6b3bdfc1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:14.323538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09346a-7cb8-41ab-b28c-00d6b3bdfc1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:14.325155 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09346a-7cb8-41ab-b28c-00d6b3bdfc1c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:14.336811 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 908/1811] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:42:14.340927 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b532402-ac17-421c-a261-0d5d6e546b7e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:14.351725 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b532402-ac17-421c-a261-0d5d6e546b7e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:14.356250 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5776095-7d31-47a1-aee3-f918838ab2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:14.357119 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5776095-7d31-47a1-aee3-f918838ab2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:14.357398 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5776095-7d31-47a1-aee3-f918838ab2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:14.357670 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5776095-7d31-47a1-aee3-f918838ab2b4 admin admin] PATH_INFO: `/v3/projects/eb975882e08c4c31a2ea499ae678064a/users/4152775e6ba245fb8297a9fc62f7a6c4/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:14.371867 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5776095-7d31-47a1-aee3-f918838ab2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb975882e08c4c31a2ea499ae678064a, user_id=4152775e6ba245fb8297a9fc62f7a6c4, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:14.374505 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5776095-7d31-47a1-aee3-f918838ab2b4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:14.387830 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 904/1812] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:14 2022] PUT /identity/v3/projects/eb975882e08c4c31a2ea499ae678064a/users/4152775e6ba245fb8297a9fc62f7a6c4/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:14.391591 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09346a-7cb8-41ab-b28c-00d6b3bdfc1c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:14.402095 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09346a-7cb8-41ab-b28c-00d6b3bdfc1c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:14.455501 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff24cdf-6e93-4730-96bb-0177bbc61051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:14.456218 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff24cdf-6e93-4730-96bb-0177bbc61051 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:14.456520 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff24cdf-6e93-4730-96bb-0177bbc61051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:14.456814 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff24cdf-6e93-4730-96bb-0177bbc61051 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:14.457590 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff24cdf-6e93-4730-96bb-0177bbc61051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:14.459891 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff24cdf-6e93-4730-96bb-0177bbc61051 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:14.469408 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 909/1813] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:14.473480 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5776095-7d31-47a1-aee3-f918838ab2b4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:14.483823 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5776095-7d31-47a1-aee3-f918838ab2b4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:14.488355 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae54fe8-5448-4022-9c2d-d501fd310135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:14.489219 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae54fe8-5448-4022-9c2d-d501fd310135 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:14.489503 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae54fe8-5448-4022-9c2d-d501fd310135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:14.489781 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae54fe8-5448-4022-9c2d-d501fd310135 admin admin] PATH_INFO: `/v3/projects/eb975882e08c4c31a2ea499ae678064a/users/4152775e6ba245fb8297a9fc62f7a6c4/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:14.491874 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae54fe8-5448-4022-9c2d-d501fd310135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb975882e08c4c31a2ea499ae678064a, user_id=4152775e6ba245fb8297a9fc62f7a6c4, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:14.494501 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae54fe8-5448-4022-9c2d-d501fd310135 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:14.504456 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 905/1814] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:14 2022] PUT /identity/v3/projects/eb975882e08c4c31a2ea499ae678064a/users/4152775e6ba245fb8297a9fc62f7a6c4/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:14.516116 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9935153-aa05-45dd-9b0f-95d0b4219163 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:14.516409 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9935153-aa05-45dd-9b0f-95d0b4219163 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:14.516687 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9935153-aa05-45dd-9b0f-95d0b4219163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:14.543744 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-a9935153-aa05-45dd-9b0f-95d0b4219163 None None] MFA Rules not processed for user `4152775e6ba245fb8297a9fc62f7a6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:14.544985 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a9935153-aa05-45dd-9b0f-95d0b4219163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:14.612958 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 910/1815] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:14.623942 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae54fe8-5448-4022-9c2d-d501fd310135 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:14.625680 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-8ae54fe8-5448-4022-9c2d-d501fd310135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:14.684796 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae54fe8-5448-4022-9c2d-d501fd310135 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:14.688450 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f6939-8bd2-4ab5-872c-39b5778d8ede service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:14.689085 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f6939-8bd2-4ab5-872c-39b5778d8ede service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:14.689367 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f6939-8bd2-4ab5-872c-39b5778d8ede service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:14.689639 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f6939-8bd2-4ab5-872c-39b5778d8ede service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:14.699394 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f6939-8bd2-4ab5-872c-39b5778d8ede service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:14.700880 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f6939-8bd2-4ab5-872c-39b5778d8ede service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:14.711108 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 906/1816] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:42:14.775837 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9935153-aa05-45dd-9b0f-95d0b4219163 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:14.837386 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9935153-aa05-45dd-9b0f-95d0b4219163 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:14.842120 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f362d-b714-4988-9610-0012015395da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:14.842983 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f362d-b714-4988-9610-0012015395da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:14.843264 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f362d-b714-4988-9610-0012015395da admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:14.843540 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f362d-b714-4988-9610-0012015395da admin admin] PATH_INFO: `/v3/users/e11fd16d5c3b43499fe0be9e5782c3d0` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:14.844796 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f362d-b714-4988-9610-0012015395da admin admin] RBAC: Authorizing `identity:delete_user(user_id=e11fd16d5c3b43499fe0be9e5782c3d0)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:14.846726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f362d-b714-4988-9610-0012015395da admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:14.894959 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-602f362d-b714-4988-9610-0012015395da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e11fd16d5c3b43499fe0be9e5782c3d0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:14.906184 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-602f362d-b714-4988-9610-0012015395da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e11fd16d5c3b43499fe0be9e5782c3d0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:14.912602 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-602f362d-b714-4988-9610-0012015395da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e11fd16d5c3b43499fe0be9e5782c3d0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:14.919714 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-602f362d-b714-4988-9610-0012015395da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e11fd16d5c3b43499fe0be9e5782c3d0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:14.920430 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-602f362d-b714-4988-9610-0012015395da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e11fd16d5c3b43499fe0be9e5782c3d0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:14.926139 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 911/1817] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:42:14 2022] DELETE /identity/v3/users/e11fd16d5c3b43499fe0be9e5782c3d0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:14.931169 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ba90a-7606-4f6e-83ae-8aac596d5997 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:14.931652 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ba90a-7606-4f6e-83ae-8aac596d5997 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:14.931738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ba90a-7606-4f6e-83ae-8aac596d5997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:14.951026 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-737ba90a-7606-4f6e-83ae-8aac596d5997 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:14.952273 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-737ba90a-7606-4f6e-83ae-8aac596d5997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:15.014706 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 907/1818] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:15.026546 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f362d-b714-4988-9610-0012015395da admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:15.027998 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-602f362d-b714-4988-9610-0012015395da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:15.085575 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f362d-b714-4988-9610-0012015395da admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:15.089406 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098f52c-8a4d-4714-96fe-235979dd5c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:15.090076 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098f52c-8a4d-4714-96fe-235979dd5c7a service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:15.090350 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098f52c-8a4d-4714-96fe-235979dd5c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:15.090621 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098f52c-8a4d-4714-96fe-235979dd5c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:15.101971 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098f52c-8a4d-4714-96fe-235979dd5c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:15.103317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098f52c-8a4d-4714-96fe-235979dd5c7a service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:15.114086 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 912/1819] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:42:15.475016 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ba90a-7606-4f6e-83ae-8aac596d5997 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:15.476760 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-737ba90a-7606-4f6e-83ae-8aac596d5997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:15.500488 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ba90a-7606-4f6e-83ae-8aac596d5997 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:15.506381 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb749b5-15d4-4a88-97db-b9d1ae22030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:15.507318 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb749b5-15d4-4a88-97db-b9d1ae22030f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:15.507593 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb749b5-15d4-4a88-97db-b9d1ae22030f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:15.507898 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb749b5-15d4-4a88-97db-b9d1ae22030f admin admin] PATH_INFO: `/v3/projects/244baa94494c49859e4871f1b3fc30d0` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:15.509094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb749b5-15d4-4a88-97db-b9d1ae22030f admin admin] RBAC: Authorizing `identity:delete_project(project_id=244baa94494c49859e4871f1b3fc30d0)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:15.510984 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb749b5-15d4-4a88-97db-b9d1ae22030f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:15.564554 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bdb749b5-15d4-4a88-97db-b9d1ae22030f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '244baa94494c49859e4871f1b3fc30d0', 'request_id': 'req-bdb749b5-15d4-4a88-97db-b9d1ae22030f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:15.570540 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bdb749b5-15d4-4a88-97db-b9d1ae22030f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '244baa94494c49859e4871f1b3fc30d0', 'request_id': 'req-bdb749b5-15d4-4a88-97db-b9d1ae22030f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:15.576137 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bdb749b5-15d4-4a88-97db-b9d1ae22030f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '244baa94494c49859e4871f1b3fc30d0', 'request_id': 'req-bdb749b5-15d4-4a88-97db-b9d1ae22030f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:15.588318 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bdb749b5-15d4-4a88-97db-b9d1ae22030f admin admin] The token cache is being invalidate because project 244baa94494c49859e4871f1b3fc30d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:15.588600 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bdb749b5-15d4-4a88-97db-b9d1ae22030f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:15.589205 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bdb749b5-15d4-4a88-97db-b9d1ae22030f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:15.590709 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 908/1820] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:15 2022] DELETE /identity/v3/projects/244baa94494c49859e4871f1b3fc30d0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:15.594681 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098f52c-8a4d-4714-96fe-235979dd5c7a service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:15.604751 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098f52c-8a4d-4714-96fe-235979dd5c7a service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:15.671485 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3b8e6-786f-4837-bb8a-1b6b1efa234c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:15.672283 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3b8e6-786f-4837-bb8a-1b6b1efa234c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:15.672677 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3b8e6-786f-4837-bb8a-1b6b1efa234c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:15.672992 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3b8e6-786f-4837-bb8a-1b6b1efa234c admin admin] PATH_INFO: `/v3/users/4152775e6ba245fb8297a9fc62f7a6c4` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:15.674276 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3b8e6-786f-4837-bb8a-1b6b1efa234c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4152775e6ba245fb8297a9fc62f7a6c4)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:15.676224 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3b8e6-786f-4837-bb8a-1b6b1efa234c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:15.720604 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-dcd3b8e6-786f-4837-bb8a-1b6b1efa234c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4152775e6ba245fb8297a9fc62f7a6c4'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:15.732059 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-dcd3b8e6-786f-4837-bb8a-1b6b1efa234c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4152775e6ba245fb8297a9fc62f7a6c4'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:15.738414 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-dcd3b8e6-786f-4837-bb8a-1b6b1efa234c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4152775e6ba245fb8297a9fc62f7a6c4'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:15.745943 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-dcd3b8e6-786f-4837-bb8a-1b6b1efa234c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4152775e6ba245fb8297a9fc62f7a6c4'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:15.746569 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-dcd3b8e6-786f-4837-bb8a-1b6b1efa234c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4152775e6ba245fb8297a9fc62f7a6c4'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:15.752385 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 913/1821] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:42:15 2022] DELETE /identity/v3/users/4152775e6ba245fb8297a9fc62f7a6c4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:16.071823 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb749b5-15d4-4a88-97db-b9d1ae22030f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:16.073590 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-bdb749b5-15d4-4a88-97db-b9d1ae22030f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:16.091332 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb749b5-15d4-4a88-97db-b9d1ae22030f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:16.148984 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cef36-37d2-433b-b4e0-b69c61531333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:16.149842 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cef36-37d2-433b-b4e0-b69c61531333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:16.150153 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cef36-37d2-433b-b4e0-b69c61531333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:16.150606 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cef36-37d2-433b-b4e0-b69c61531333 admin admin] PATH_INFO: `/v3/projects/eb975882e08c4c31a2ea499ae678064a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:16.151960 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cef36-37d2-433b-b4e0-b69c61531333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb975882e08c4c31a2ea499ae678064a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:16.153912 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cef36-37d2-433b-b4e0-b69c61531333 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:16.199843 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-357cef36-37d2-433b-b4e0-b69c61531333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb975882e08c4c31a2ea499ae678064a', 'request_id': 'req-357cef36-37d2-433b-b4e0-b69c61531333'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:16.205592 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-357cef36-37d2-433b-b4e0-b69c61531333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb975882e08c4c31a2ea499ae678064a', 'request_id': 'req-357cef36-37d2-433b-b4e0-b69c61531333'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:16.210837 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-357cef36-37d2-433b-b4e0-b69c61531333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb975882e08c4c31a2ea499ae678064a', 'request_id': 'req-357cef36-37d2-433b-b4e0-b69c61531333'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:16.222787 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-357cef36-37d2-433b-b4e0-b69c61531333 admin admin] The token cache is being invalidate because project eb975882e08c4c31a2ea499ae678064a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:16.223076 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-357cef36-37d2-433b-b4e0-b69c61531333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:16.223702 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-357cef36-37d2-433b-b4e0-b69c61531333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:16.225339 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 909/1822] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:16 2022] DELETE /identity/v3/projects/eb975882e08c4c31a2ea499ae678064a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:16.232518 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e5280-edbc-4772-97da-a466eb726f0c None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:16.232980 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e5280-edbc-4772-97da-a466eb726f0c None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:16.233063 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e5280-edbc-4772-97da-a466eb726f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:16.250816 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-fb3e5280-edbc-4772-97da-a466eb726f0c None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:16.252039 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-fb3e5280-edbc-4772-97da-a466eb726f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:16.310387 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 914/1823] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:16.317995 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8dba3-8e26-4af7-b2ed-53f271af4de9 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:16.318281 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8dba3-8e26-4af7-b2ed-53f271af4de9 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:16.318560 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8dba3-8e26-4af7-b2ed-53f271af4de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:16.336907 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-b6e8dba3-8e26-4af7-b2ed-53f271af4de9 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:16.338100 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b6e8dba3-8e26-4af7-b2ed-53f271af4de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:16.345796 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 910/1824] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:16.349854 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e5280-edbc-4772-97da-a466eb726f0c None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:16.359863 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e5280-edbc-4772-97da-a466eb726f0c None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:16.364333 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74e197-2ea3-4944-8e1a-1db8e7769ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:16.364963 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74e197-2ea3-4944-8e1a-1db8e7769ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:16.365238 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74e197-2ea3-4944-8e1a-1db8e7769ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:16.365507 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74e197-2ea3-4944-8e1a-1db8e7769ab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:16.366229 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74e197-2ea3-4944-8e1a-1db8e7769ab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:42:16.366613 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74e197-2ea3-4944-8e1a-1db8e7769ab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:16.368271 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74e197-2ea3-4944-8e1a-1db8e7769ab7 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:16.379172 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 915/1825] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:42:16.384033 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8dba3-8e26-4af7-b2ed-53f271af4de9 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:16.393040 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8dba3-8e26-4af7-b2ed-53f271af4de9 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:16.398762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165160d-dbc5-47dc-97b4-ecbd12b566d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:16.399438 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165160d-dbc5-47dc-97b4-ecbd12b566d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:16.399733 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165160d-dbc5-47dc-97b4-ecbd12b566d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:16.400035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165160d-dbc5-47dc-97b4-ecbd12b566d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:16.400747 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165160d-dbc5-47dc-97b4-ecbd12b566d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:16.402647 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165160d-dbc5-47dc-97b4-ecbd12b566d4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:16.432896 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 911/1826] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:42:16 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:42:16.434143 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74e197-2ea3-4944-8e1a-1db8e7769ab7 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:16.444819 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74e197-2ea3-4944-8e1a-1db8e7769ab7 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:16.512235 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394e12f-6f3e-4ccc-b354-b79198efa4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:16.512998 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394e12f-6f3e-4ccc-b354-b79198efa4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:16.513352 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394e12f-6f3e-4ccc-b354-b79198efa4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:16.513697 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394e12f-6f3e-4ccc-b354-b79198efa4b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:16.514501 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394e12f-6f3e-4ccc-b354-b79198efa4b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:16.516726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394e12f-6f3e-4ccc-b354-b79198efa4b4 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:16.539497 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 916/1827] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:42:16 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:42:16.544276 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165160d-dbc5-47dc-97b4-ecbd12b566d4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:16.555966 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165160d-dbc5-47dc-97b4-ecbd12b566d4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:16.568968 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb497a-3095-4cd9-ae74-3b68d685a7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:16.571091 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb497a-3095-4cd9-ae74-3b68d685a7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:16.571385 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb497a-3095-4cd9-ae74-3b68d685a7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:16.572274 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb497a-3095-4cd9-ae74-3b68d685a7c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:16.573031 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb497a-3095-4cd9-ae74-3b68d685a7c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:16.574673 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb497a-3095-4cd9-ae74-3b68d685a7c2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:16.596559 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 912/1828] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:16.600656 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394e12f-6f3e-4ccc-b354-b79198efa4b4 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:16.612541 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394e12f-6f3e-4ccc-b354-b79198efa4b4 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:16.617590 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62884838-fc4d-49ad-b635-6cfb9a4b310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:16.618451 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62884838-fc4d-49ad-b635-6cfb9a4b310b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:16.618829 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62884838-fc4d-49ad-b635-6cfb9a4b310b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:16.619205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62884838-fc4d-49ad-b635-6cfb9a4b310b admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:16.620049 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62884838-fc4d-49ad-b635-6cfb9a4b310b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:16.621883 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62884838-fc4d-49ad-b635-6cfb9a4b310b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:16.641927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 917/1829] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:16.645440 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb497a-3095-4cd9-ae74-3b68d685a7c2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:16.655884 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb497a-3095-4cd9-ae74-3b68d685a7c2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:16.660444 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de998d7-5ffa-4a0d-835e-66a19d460672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:16.661322 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de998d7-5ffa-4a0d-835e-66a19d460672 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:16.661603 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de998d7-5ffa-4a0d-835e-66a19d460672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:16.661875 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de998d7-5ffa-4a0d-835e-66a19d460672 admin admin] PATH_INFO: `/v3/projects/d46b7555f24443eab95778746af1837b/users/890c9d52a4cb43f78748f202c85eef0c/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:16.676406 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de998d7-5ffa-4a0d-835e-66a19d460672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46b7555f24443eab95778746af1837b, user_id=890c9d52a4cb43f78748f202c85eef0c, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:16.679089 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de998d7-5ffa-4a0d-835e-66a19d460672 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:16.692963 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 913/1830] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:16 2022] PUT /identity/v3/projects/d46b7555f24443eab95778746af1837b/users/890c9d52a4cb43f78748f202c85eef0c/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:16.704853 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e1f3b-dff3-4e50-a169-8e061322bce6 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:16.705141 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e1f3b-dff3-4e50-a169-8e061322bce6 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:16.705415 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e1f3b-dff3-4e50-a169-8e061322bce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:16.732499 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-9d0e1f3b-dff3-4e50-a169-8e061322bce6 None None] MFA Rules not processed for user `890c9d52a4cb43f78748f202c85eef0c`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:16.733685 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-9d0e1f3b-dff3-4e50-a169-8e061322bce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:16.794514 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 918/1831] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:16.798884 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de998d7-5ffa-4a0d-835e-66a19d460672 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:16.858929 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de998d7-5ffa-4a0d-835e-66a19d460672 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:16.863728 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca7fd4-0c45-43c0-aeed-76c33c36e5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:16.864437 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca7fd4-0c45-43c0-aeed-76c33c36e5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:16.864736 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca7fd4-0c45-43c0-aeed-76c33c36e5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:16.865026 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca7fd4-0c45-43c0-aeed-76c33c36e5a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:16.865777 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca7fd4-0c45-43c0-aeed-76c33c36e5a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:16.867883 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca7fd4-0c45-43c0-aeed-76c33c36e5a8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:16.893311 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 914/1832] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:42:16 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:42:16.897275 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e1f3b-dff3-4e50-a169-8e061322bce6 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:16.908549 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e1f3b-dff3-4e50-a169-8e061322bce6 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:16.960950 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb3a4e-ec52-4923-8c51-dd3f45ece37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:16.961595 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb3a4e-ec52-4923-8c51-dd3f45ece37d admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:16.961873 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb3a4e-ec52-4923-8c51-dd3f45ece37d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:16.962148 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb3a4e-ec52-4923-8c51-dd3f45ece37d admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:16.962837 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb3a4e-ec52-4923-8c51-dd3f45ece37d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:16.964763 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb3a4e-ec52-4923-8c51-dd3f45ece37d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:16.984858 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 919/1833] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:42:16 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:42:16.988725 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca7fd4-0c45-43c0-aeed-76c33c36e5a8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:16.999606 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca7fd4-0c45-43c0-aeed-76c33c36e5a8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:17.004256 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d648bcb-8843-4c26-b94c-a86d01284127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:17.004906 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d648bcb-8843-4c26-b94c-a86d01284127 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:17.005508 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d648bcb-8843-4c26-b94c-a86d01284127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:17.005508 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d648bcb-8843-4c26-b94c-a86d01284127 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:17.006428 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d648bcb-8843-4c26-b94c-a86d01284127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:17.008617 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d648bcb-8843-4c26-b94c-a86d01284127 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:17.019240 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 915/1834] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:17.023210 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb3a4e-ec52-4923-8c51-dd3f45ece37d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:17.042977 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb3a4e-ec52-4923-8c51-dd3f45ece37d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:17.049640 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486262cc-6923-4744-b183-26e3a04b6cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:17.050645 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486262cc-6923-4744-b183-26e3a04b6cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:17.050927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486262cc-6923-4744-b183-26e3a04b6cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:17.051580 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486262cc-6923-4744-b183-26e3a04b6cbf admin admin] PATH_INFO: `/v3/projects/74ad6163e38b4406ab8f59c47b940bc5/users/c0d3c93d17f5417da132d964a2498d7d/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:17.068863 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486262cc-6923-4744-b183-26e3a04b6cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ad6163e38b4406ab8f59c47b940bc5, user_id=c0d3c93d17f5417da132d964a2498d7d, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:17.072318 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486262cc-6923-4744-b183-26e3a04b6cbf admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:17.087147 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 920/1835] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:17 2022] PUT /identity/v3/projects/74ad6163e38b4406ab8f59c47b940bc5/users/c0d3c93d17f5417da132d964a2498d7d/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:17.091317 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d648bcb-8843-4c26-b94c-a86d01284127 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:17.105139 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d648bcb-8843-4c26-b94c-a86d01284127 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:17.171069 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29d472-4027-45af-bc1c-0de13842cd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:17.171741 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29d472-4027-45af-bc1c-0de13842cd3b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:17.172156 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29d472-4027-45af-bc1c-0de13842cd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:17.172434 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29d472-4027-45af-bc1c-0de13842cd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:17.173172 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29d472-4027-45af-bc1c-0de13842cd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:17.174939 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29d472-4027-45af-bc1c-0de13842cd3b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:17.186022 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 916/1836] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:17.190000 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486262cc-6923-4744-b183-26e3a04b6cbf admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:17.202048 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486262cc-6923-4744-b183-26e3a04b6cbf admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:17.207024 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a02c44-058c-4de1-83a6-db76a55a95a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:17.207961 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a02c44-058c-4de1-83a6-db76a55a95a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:17.208232 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a02c44-058c-4de1-83a6-db76a55a95a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:17.208668 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a02c44-058c-4de1-83a6-db76a55a95a4 admin admin] PATH_INFO: `/v3/projects/74ad6163e38b4406ab8f59c47b940bc5/users/c0d3c93d17f5417da132d964a2498d7d/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:17.210872 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a02c44-058c-4de1-83a6-db76a55a95a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ad6163e38b4406ab8f59c47b940bc5, user_id=c0d3c93d17f5417da132d964a2498d7d, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:17.213631 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a02c44-058c-4de1-83a6-db76a55a95a4 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:17.225301 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 921/1837] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:17 2022] PUT /identity/v3/projects/74ad6163e38b4406ab8f59c47b940bc5/users/c0d3c93d17f5417da132d964a2498d7d/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:17.236098 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4fd8d-929d-473f-941b-ddda026a47d7 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:17.236385 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4fd8d-929d-473f-941b-ddda026a47d7 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:17.236682 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4fd8d-929d-473f-941b-ddda026a47d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:17.270566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-48f4fd8d-929d-473f-941b-ddda026a47d7 None None] MFA Rules not processed for user `c0d3c93d17f5417da132d964a2498d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:17.271962 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-48f4fd8d-929d-473f-941b-ddda026a47d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:17.344298 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 917/1838] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:17 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:17.357845 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a02c44-058c-4de1-83a6-db76a55a95a4 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:17.359872 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d6a02c44-058c-4de1-83a6-db76a55a95a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:17.421321 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a02c44-058c-4de1-83a6-db76a55a95a4 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:17.425046 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c12e9-6f98-44cd-ad1e-76caaaf51171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:17.425689 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c12e9-6f98-44cd-ad1e-76caaaf51171 service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:17.425973 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c12e9-6f98-44cd-ad1e-76caaaf51171 service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:17.426253 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c12e9-6f98-44cd-ad1e-76caaaf51171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:17.436049 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c12e9-6f98-44cd-ad1e-76caaaf51171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:17.437499 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c12e9-6f98-44cd-ad1e-76caaaf51171 service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:17.447268 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 922/1839] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:17 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:42:17.533255 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4fd8d-929d-473f-941b-ddda026a47d7 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:17.543665 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4fd8d-929d-473f-941b-ddda026a47d7 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:17.551288 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70ae8b-1c15-482d-b355-bfc15b0a9d3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:17.552181 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70ae8b-1c15-482d-b355-bfc15b0a9d3b service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:17.552544 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70ae8b-1c15-482d-b355-bfc15b0a9d3b service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:17.552890 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70ae8b-1c15-482d-b355-bfc15b0a9d3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:17.613798 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70ae8b-1c15-482d-b355-bfc15b0a9d3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:17.615281 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70ae8b-1c15-482d-b355-bfc15b0a9d3b service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:17.627445 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 918/1840] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:42:21.852021 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e8a56-a210-405c-bdf5-50747c90f384 None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:21.852545 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e8a56-a210-405c-bdf5-50747c90f384 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:21.852975 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e8a56-a210-405c-bdf5-50747c90f384 None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:21.854988 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 923/1841] 10.222.0.35 () {54 vars in 921 bytes} [Tue Feb 8 16:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:42:21.889724 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc87c21-ed38-496b-b4bf-62e1dffff280 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:21.890307 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc87c21-ed38-496b-b4bf-62e1dffff280 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:21.890858 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc87c21-ed38-496b-b4bf-62e1dffff280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:21.910136 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2bc87c21-ed38-496b-b4bf-62e1dffff280 None None] MFA Rules not processed for user `ccb02e5d8ef14f8f85bbacfa5b1f5be3`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:21.911442 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2bc87c21-ed38-496b-b4bf-62e1dffff280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:22.001015 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 919/1842] 10.222.0.35 () {58 vars in 1018 bytes} [Tue Feb 8 16:42:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:22.040579 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e8a56-a210-405c-bdf5-50747c90f384 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:22.042781 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-979e8a56-a210-405c-bdf5-50747c90f384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:22.065715 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e8a56-a210-405c-bdf5-50747c90f384 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:22.081861 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e031b0-8d2a-4eea-a268-bde46899f7b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:22.082948 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e031b0-8d2a-4eea-a268-bde46899f7b4 service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:22.082948 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e031b0-8d2a-4eea-a268-bde46899f7b4 service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:22.083194 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e031b0-8d2a-4eea-a268-bde46899f7b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:22.097965 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e031b0-8d2a-4eea-a268-bde46899f7b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:22.101880 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e031b0-8d2a-4eea-a268-bde46899f7b4 service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:22.117704 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 924/1843] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:42:27.823896 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc87c21-ed38-496b-b4bf-62e1dffff280 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:27.911286 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e031b0-8d2a-4eea-a268-bde46899f7b4 service nova] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:27.912732 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-66e031b0-8d2a-4eea-a268-bde46899f7b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:27.920135 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc87c21-ed38-496b-b4bf-62e1dffff280 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:27.925242 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4df27c-e705-4ed2-a9a9-6a08509c020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:27.926678 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4df27c-e705-4ed2-a9a9-6a08509c020b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:27.927299 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4df27c-e705-4ed2-a9a9-6a08509c020b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:27.927791 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4df27c-e705-4ed2-a9a9-6a08509c020b admin admin] PATH_INFO: `/v3/users/890c9d52a4cb43f78748f202c85eef0c` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:27.928193 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e031b0-8d2a-4eea-a268-bde46899f7b4 service nova] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:27.930092 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4df27c-e705-4ed2-a9a9-6a08509c020b admin admin] RBAC: Authorizing `identity:delete_user(user_id=890c9d52a4cb43f78748f202c85eef0c)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:27.932440 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4df27c-e705-4ed2-a9a9-6a08509c020b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:27.934103 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca2ad1-25a6-45f2-8db6-6a4d90df7b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:27.935108 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca2ad1-25a6-45f2-8db6-6a4d90df7b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:27.935371 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca2ad1-25a6-45f2-8db6-6a4d90df7b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:27.935747 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca2ad1-25a6-45f2-8db6-6a4d90df7b43 admin admin] PATH_INFO: `/v3/users/2c4e07b4114141db814d4ff617010042` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:27.937518 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca2ad1-25a6-45f2-8db6-6a4d90df7b43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4e07b4114141db814d4ff617010042)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:27.940188 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca2ad1-25a6-45f2-8db6-6a4d90df7b43 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:28.006360 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9f4df27c-e705-4ed2-a9a9-6a08509c020b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '890c9d52a4cb43f78748f202c85eef0c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:28.011582 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-2aca2ad1-25a6-45f2-8db6-6a4d90df7b43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4e07b4114141db814d4ff617010042'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:28.017322 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9f4df27c-e705-4ed2-a9a9-6a08509c020b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '890c9d52a4cb43f78748f202c85eef0c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:28.029753 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-2aca2ad1-25a6-45f2-8db6-6a4d90df7b43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4e07b4114141db814d4ff617010042'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:28.031162 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9f4df27c-e705-4ed2-a9a9-6a08509c020b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '890c9d52a4cb43f78748f202c85eef0c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:28.037744 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-2aca2ad1-25a6-45f2-8db6-6a4d90df7b43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4e07b4114141db814d4ff617010042'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:28.039681 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9f4df27c-e705-4ed2-a9a9-6a08509c020b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '890c9d52a4cb43f78748f202c85eef0c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:28.040407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9f4df27c-e705-4ed2-a9a9-6a08509c020b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '890c9d52a4cb43f78748f202c85eef0c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:28.044936 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-2aca2ad1-25a6-45f2-8db6-6a4d90df7b43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4e07b4114141db814d4ff617010042'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:28.045592 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-2aca2ad1-25a6-45f2-8db6-6a4d90df7b43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4e07b4114141db814d4ff617010042'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:28.047040 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 920/1844] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:42:27 2022] DELETE /identity/v3/users/890c9d52a4cb43f78748f202c85eef0c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:28.051521 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1ba8d-1cb3-42e2-a5e8-620ff7289efc None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:28.051651 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 925/1845] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:42:27 2022] DELETE /identity/v3/users/2c4e07b4114141db814d4ff617010042 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:28.051856 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1ba8d-1cb3-42e2-a5e8-620ff7289efc None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:28.052235 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1ba8d-1cb3-42e2-a5e8-620ff7289efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:28.056086 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7391cba-7c63-4e34-97da-5303c5e54b42 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:28.056380 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7391cba-7c63-4e34-97da-5303c5e54b42 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:28.056700 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7391cba-7c63-4e34-97da-5303c5e54b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:28.070164 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-0ee1ba8d-1cb3-42e2-a5e8-620ff7289efc None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:28.071413 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0ee1ba8d-1cb3-42e2-a5e8-620ff7289efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:28.076356 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-d7391cba-7c63-4e34-97da-5303c5e54b42 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:28.077520 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d7391cba-7c63-4e34-97da-5303c5e54b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:28.128493 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 921/1846] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:42:28.136788 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 926/1847] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:42:28.141699 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1ba8d-1cb3-42e2-a5e8-620ff7289efc None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:28.143000 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0ee1ba8d-1cb3-42e2-a5e8-620ff7289efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:28.146158 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7391cba-7c63-4e34-97da-5303c5e54b42 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:28.148428 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d7391cba-7c63-4e34-97da-5303c5e54b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:28.197189 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1ba8d-1cb3-42e2-a5e8-620ff7289efc None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:28.200836 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a53024-538a-4d19-88e2-56fefb0bb387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:28.201543 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a53024-538a-4d19-88e2-56fefb0bb387 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:28.201747 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a53024-538a-4d19-88e2-56fefb0bb387 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:28.202019 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a53024-538a-4d19-88e2-56fefb0bb387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:28.208017 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7391cba-7c63-4e34-97da-5303c5e54b42 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:28.212309 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d277a9-c3de-4ab1-8386-0a30f5e1f4c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:28.212943 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d277a9-c3de-4ab1-8386-0a30f5e1f4c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:28.213062 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a53024-538a-4d19-88e2-56fefb0bb387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:28.213223 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d277a9-c3de-4ab1-8386-0a30f5e1f4c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:28.213495 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d277a9-c3de-4ab1-8386-0a30f5e1f4c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:28.214453 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a53024-538a-4d19-88e2-56fefb0bb387 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:28.222652 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d277a9-c3de-4ab1-8386-0a30f5e1f4c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:28.224090 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d277a9-c3de-4ab1-8386-0a30f5e1f4c0 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:28.224282 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 922/1848] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:42:28.234883 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 927/1849] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:42:28.703597 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a53024-538a-4d19-88e2-56fefb0bb387 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:28.704565 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-27a53024-538a-4d19-88e2-56fefb0bb387 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:28.712937 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d277a9-c3de-4ab1-8386-0a30f5e1f4c0 service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:28.719432 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a8d277a9-c3de-4ab1-8386-0a30f5e1f4c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:28.748058 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d277a9-c3de-4ab1-8386-0a30f5e1f4c0 service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:28.750023 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a53024-538a-4d19-88e2-56fefb0bb387 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:28.756814 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1ad38-be3b-431c-a939-72fe736dac60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:28.757919 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1ad38-be3b-431c-a939-72fe736dac60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:28.758580 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1ad38-be3b-431c-a939-72fe736dac60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:28.758876 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1ad38-be3b-431c-a939-72fe736dac60 admin admin] PATH_INFO: `/v3/projects/f4b165849ac04bc4954b88983e0cb01c` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:28.762002 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1ad38-be3b-431c-a939-72fe736dac60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b165849ac04bc4954b88983e0cb01c)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:28.764784 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71378eb-bafa-4e13-89c1-cba7dfcc6dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:28.765522 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1ad38-be3b-431c-a939-72fe736dac60 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:28.768402 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71378eb-bafa-4e13-89c1-cba7dfcc6dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:28.769196 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71378eb-bafa-4e13-89c1-cba7dfcc6dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:28.769815 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71378eb-bafa-4e13-89c1-cba7dfcc6dc5 admin admin] PATH_INFO: `/v3/projects/d46b7555f24443eab95778746af1837b` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:28.772537 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71378eb-bafa-4e13-89c1-cba7dfcc6dc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46b7555f24443eab95778746af1837b)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:28.774822 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71378eb-bafa-4e13-89c1-cba7dfcc6dc5 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:28.830512 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a71378eb-bafa-4e13-89c1-cba7dfcc6dc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46b7555f24443eab95778746af1837b', 'request_id': 'req-a71378eb-bafa-4e13-89c1-cba7dfcc6dc5'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:28.837720 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a71378eb-bafa-4e13-89c1-cba7dfcc6dc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46b7555f24443eab95778746af1837b', 'request_id': 'req-a71378eb-bafa-4e13-89c1-cba7dfcc6dc5'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:28.838692 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-cde1ad38-be3b-431c-a939-72fe736dac60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b165849ac04bc4954b88983e0cb01c', 'request_id': 'req-cde1ad38-be3b-431c-a939-72fe736dac60'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:28.843073 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a71378eb-bafa-4e13-89c1-cba7dfcc6dc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46b7555f24443eab95778746af1837b', 'request_id': 'req-a71378eb-bafa-4e13-89c1-cba7dfcc6dc5'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:28.845666 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-cde1ad38-be3b-431c-a939-72fe736dac60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b165849ac04bc4954b88983e0cb01c', 'request_id': 'req-cde1ad38-be3b-431c-a939-72fe736dac60'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:28.853545 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-cde1ad38-be3b-431c-a939-72fe736dac60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b165849ac04bc4954b88983e0cb01c', 'request_id': 'req-cde1ad38-be3b-431c-a939-72fe736dac60'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:28.859414 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a71378eb-bafa-4e13-89c1-cba7dfcc6dc5 admin admin] The token cache is being invalidate because project d46b7555f24443eab95778746af1837b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:28.859787 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a71378eb-bafa-4e13-89c1-cba7dfcc6dc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:28.860372 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a71378eb-bafa-4e13-89c1-cba7dfcc6dc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:28.862053 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 928/1850] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:28 2022] DELETE /identity/v3/projects/d46b7555f24443eab95778746af1837b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:28.865872 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71378eb-bafa-4e13-89c1-cba7dfcc6dc5 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:28.868434 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a71378eb-bafa-4e13-89c1-cba7dfcc6dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:28.869794 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-cde1ad38-be3b-431c-a939-72fe736dac60 admin admin] The token cache is being invalidate because project f4b165849ac04bc4954b88983e0cb01c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:28.870196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-cde1ad38-be3b-431c-a939-72fe736dac60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:28.870940 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-cde1ad38-be3b-431c-a939-72fe736dac60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:28.873222 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 923/1851] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:28 2022] DELETE /identity/v3/projects/f4b165849ac04bc4954b88983e0cb01c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:28.877017 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1ad38-be3b-431c-a939-72fe736dac60 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:28.878474 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cde1ad38-be3b-431c-a939-72fe736dac60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:28.935986 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71378eb-bafa-4e13-89c1-cba7dfcc6dc5 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:28.940740 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11759f64-be87-4962-b327-a6af92a79e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:28.941592 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11759f64-be87-4962-b327-a6af92a79e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:28.941873 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11759f64-be87-4962-b327-a6af92a79e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:28.942154 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11759f64-be87-4962-b327-a6af92a79e1c admin admin] PATH_INFO: `/v3/users/c0d3c93d17f5417da132d964a2498d7d` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:28.942731 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1ad38-be3b-431c-a939-72fe736dac60 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:28.943377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11759f64-be87-4962-b327-a6af92a79e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0d3c93d17f5417da132d964a2498d7d)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:28.945521 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11759f64-be87-4962-b327-a6af92a79e1c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:28.948056 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60143188-2fb0-4ee6-8546-8113aea85cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:28.948914 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60143188-2fb0-4ee6-8546-8113aea85cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:28.949191 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60143188-2fb0-4ee6-8546-8113aea85cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:28.949465 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60143188-2fb0-4ee6-8546-8113aea85cad admin admin] PATH_INFO: `/v3/users/59c490a5580f4cebb05c8d3ba1b483fc` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:28.950673 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60143188-2fb0-4ee6-8546-8113aea85cad admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c490a5580f4cebb05c8d3ba1b483fc)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:28.952626 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60143188-2fb0-4ee6-8546-8113aea85cad admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:28.992308 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-11759f64-be87-4962-b327-a6af92a79e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0d3c93d17f5417da132d964a2498d7d'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:28.999916 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-60143188-2fb0-4ee6-8546-8113aea85cad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c490a5580f4cebb05c8d3ba1b483fc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:29.003639 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-11759f64-be87-4962-b327-a6af92a79e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0d3c93d17f5417da132d964a2498d7d'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:29.006749 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-60143188-2fb0-4ee6-8546-8113aea85cad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c490a5580f4cebb05c8d3ba1b483fc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:29.018999 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-11759f64-be87-4962-b327-a6af92a79e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0d3c93d17f5417da132d964a2498d7d'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:29.020348 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-60143188-2fb0-4ee6-8546-8113aea85cad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c490a5580f4cebb05c8d3ba1b483fc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:29.032830 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-11759f64-be87-4962-b327-a6af92a79e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0d3c93d17f5417da132d964a2498d7d'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:29.034742 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-11759f64-be87-4962-b327-a6af92a79e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0d3c93d17f5417da132d964a2498d7d'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:29.036619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-60143188-2fb0-4ee6-8546-8113aea85cad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c490a5580f4cebb05c8d3ba1b483fc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:29.037756 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-60143188-2fb0-4ee6-8546-8113aea85cad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c490a5580f4cebb05c8d3ba1b483fc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:29.044307 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 929/1852] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:42:28 2022] DELETE /identity/v3/users/c0d3c93d17f5417da132d964a2498d7d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:29.051219 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 924/1853] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:42:28 2022] DELETE /identity/v3/users/59c490a5580f4cebb05c8d3ba1b483fc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:29.377691 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11759f64-be87-4962-b327-a6af92a79e1c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:29.379188 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-11759f64-be87-4962-b327-a6af92a79e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:29.456533 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60143188-2fb0-4ee6-8546-8113aea85cad admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:29.458090 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-60143188-2fb0-4ee6-8546-8113aea85cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:29.459922 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11759f64-be87-4962-b327-a6af92a79e1c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:29.525329 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a7ac8-ef2f-4fd4-b28a-4c990cbf918f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:29.526176 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a7ac8-ef2f-4fd4-b28a-4c990cbf918f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:29.526455 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a7ac8-ef2f-4fd4-b28a-4c990cbf918f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:29.526727 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a7ac8-ef2f-4fd4-b28a-4c990cbf918f admin admin] PATH_INFO: `/v3/projects/74ad6163e38b4406ab8f59c47b940bc5` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:29.527953 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a7ac8-ef2f-4fd4-b28a-4c990cbf918f admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ad6163e38b4406ab8f59c47b940bc5)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:29.529167 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60143188-2fb0-4ee6-8546-8113aea85cad admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:29.529856 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a7ac8-ef2f-4fd4-b28a-4c990cbf918f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:29.535224 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025034ab-1a75-4989-a8a4-74f3bfcd99df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:29.536118 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025034ab-1a75-4989-a8a4-74f3bfcd99df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:29.536402 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025034ab-1a75-4989-a8a4-74f3bfcd99df admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:29.536678 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025034ab-1a75-4989-a8a4-74f3bfcd99df admin admin] PATH_INFO: `/v3/projects/8711314581d24d81b91ff7bbd6eebaba` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:29.537891 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025034ab-1a75-4989-a8a4-74f3bfcd99df admin admin] RBAC: Authorizing `identity:delete_project(project_id=8711314581d24d81b91ff7bbd6eebaba)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:29.540220 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025034ab-1a75-4989-a8a4-74f3bfcd99df admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:29.582240 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e56a7ac8-ef2f-4fd4-b28a-4c990cbf918f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ad6163e38b4406ab8f59c47b940bc5', 'request_id': 'req-e56a7ac8-ef2f-4fd4-b28a-4c990cbf918f'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:29.589608 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e56a7ac8-ef2f-4fd4-b28a-4c990cbf918f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ad6163e38b4406ab8f59c47b940bc5', 'request_id': 'req-e56a7ac8-ef2f-4fd4-b28a-4c990cbf918f'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:29.595106 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e56a7ac8-ef2f-4fd4-b28a-4c990cbf918f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ad6163e38b4406ab8f59c47b940bc5', 'request_id': 'req-e56a7ac8-ef2f-4fd4-b28a-4c990cbf918f'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:29.599394 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-025034ab-1a75-4989-a8a4-74f3bfcd99df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8711314581d24d81b91ff7bbd6eebaba', 'request_id': 'req-025034ab-1a75-4989-a8a4-74f3bfcd99df'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:29.606833 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-025034ab-1a75-4989-a8a4-74f3bfcd99df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8711314581d24d81b91ff7bbd6eebaba', 'request_id': 'req-025034ab-1a75-4989-a8a4-74f3bfcd99df'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:29.608729 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e56a7ac8-ef2f-4fd4-b28a-4c990cbf918f admin admin] The token cache is being invalidate because project 74ad6163e38b4406ab8f59c47b940bc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:29.609029 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e56a7ac8-ef2f-4fd4-b28a-4c990cbf918f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:29.609705 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e56a7ac8-ef2f-4fd4-b28a-4c990cbf918f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:29.611416 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 930/1854] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:29 2022] DELETE /identity/v3/projects/74ad6163e38b4406ab8f59c47b940bc5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:29.613295 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-025034ab-1a75-4989-a8a4-74f3bfcd99df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8711314581d24d81b91ff7bbd6eebaba', 'request_id': 'req-025034ab-1a75-4989-a8a4-74f3bfcd99df'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:29.617649 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34216aef-7b71-41c9-b9ad-245cf7d61072 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:29.617943 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34216aef-7b71-41c9-b9ad-245cf7d61072 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:29.618218 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34216aef-7b71-41c9-b9ad-245cf7d61072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:29.633826 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-025034ab-1a75-4989-a8a4-74f3bfcd99df admin admin] The token cache is being invalidate because project 8711314581d24d81b91ff7bbd6eebaba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:29.634590 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-025034ab-1a75-4989-a8a4-74f3bfcd99df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:29.635595 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-025034ab-1a75-4989-a8a4-74f3bfcd99df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:29.638504 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 925/1855] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:29 2022] DELETE /identity/v3/projects/8711314581d24d81b91ff7bbd6eebaba => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:29.644909 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374700c5-179c-4f27-bdf4-5f5ee10035b3 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:29.645709 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374700c5-179c-4f27-bdf4-5f5ee10035b3 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:29.646242 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374700c5-179c-4f27-bdf4-5f5ee10035b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:29.646520 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-34216aef-7b71-41c9-b9ad-245cf7d61072 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:29.649107 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-34216aef-7b71-41c9-b9ad-245cf7d61072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:29.673167 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-374700c5-179c-4f27-bdf4-5f5ee10035b3 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:29.674384 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-374700c5-179c-4f27-bdf4-5f5ee10035b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:29.733295 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 931/1856] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:42:29.742711 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af775f06-5c54-41c7-8afc-89635c13457a None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:29.743000 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af775f06-5c54-41c7-8afc-89635c13457a None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:29.743421 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af775f06-5c54-41c7-8afc-89635c13457a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:29.764241 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-af775f06-5c54-41c7-8afc-89635c13457a None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:29.766594 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-af775f06-5c54-41c7-8afc-89635c13457a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:29.774257 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 926/1857] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:29.780360 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 932/1858] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:29.782667 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374700c5-179c-4f27-bdf4-5f5ee10035b3 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:29.789324 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feb1d2-8f31-47fd-a5ad-a75aef94830a None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:29.789847 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feb1d2-8f31-47fd-a5ad-a75aef94830a None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:29.790358 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feb1d2-8f31-47fd-a5ad-a75aef94830a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:29.793648 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374700c5-179c-4f27-bdf4-5f5ee10035b3 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:29.798640 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993d58b-746a-4bae-8019-448f9b97d5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:29.799297 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993d58b-746a-4bae-8019-448f9b97d5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:29.799585 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993d58b-746a-4bae-8019-448f9b97d5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:29.799899 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993d58b-746a-4bae-8019-448f9b97d5a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:29.800633 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993d58b-746a-4bae-8019-448f9b97d5a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:42:29.800940 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993d58b-746a-4bae-8019-448f9b97d5a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:29.802932 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993d58b-746a-4bae-8019-448f9b97d5a1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:29.825965 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-34feb1d2-8f31-47fd-a5ad-a75aef94830a None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:29.827299 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-34feb1d2-8f31-47fd-a5ad-a75aef94830a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:29.831545 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 927/1859] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:42:29.836610 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993d58b-746a-4bae-8019-448f9b97d5a1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:29.837887 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 933/1860] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:42:29.841700 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34feb1d2-8f31-47fd-a5ad-a75aef94830a None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:29.847196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993d58b-746a-4bae-8019-448f9b97d5a1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:29.851067 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34feb1d2-8f31-47fd-a5ad-a75aef94830a None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:29.852527 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cbb65-04b3-4493-99f7-6ca2fabcc073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:29.853220 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cbb65-04b3-4493-99f7-6ca2fabcc073 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:29.853455 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cbb65-04b3-4493-99f7-6ca2fabcc073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:29.853724 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cbb65-04b3-4493-99f7-6ca2fabcc073 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:29.854585 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0cbb65-04b3-4493-99f7-6ca2fabcc073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:29.856193 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0aad7a-6db3-498f-bccf-da6508ea817b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:29.856684 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0cbb65-04b3-4493-99f7-6ca2fabcc073 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:29.856847 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0aad7a-6db3-498f-bccf-da6508ea817b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:29.857116 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0aad7a-6db3-498f-bccf-da6508ea817b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:29.857390 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0aad7a-6db3-498f-bccf-da6508ea817b admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:29.858126 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0aad7a-6db3-498f-bccf-da6508ea817b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:42:29.858439 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0aad7a-6db3-498f-bccf-da6508ea817b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:29.860074 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0aad7a-6db3-498f-bccf-da6508ea817b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:29.876281 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 934/1861] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:42:29.877365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0aad7a-6db3-498f-bccf-da6508ea817b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:29.889308 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0aad7a-6db3-498f-bccf-da6508ea817b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:29.889507 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 928/1862] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:42:29 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:42:29.893568 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cbb65-04b3-4493-99f7-6ca2fabcc073 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:29.952986 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18534f51-93c9-4911-9c16-b55c365ec5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:29.953736 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18534f51-93c9-4911-9c16-b55c365ec5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:29.954025 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18534f51-93c9-4911-9c16-b55c365ec5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:29.954305 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18534f51-93c9-4911-9c16-b55c365ec5a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:29.955011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18534f51-93c9-4911-9c16-b55c365ec5a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:29.956964 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18534f51-93c9-4911-9c16-b55c365ec5a4 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:29.970674 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cbb65-04b3-4493-99f7-6ca2fabcc073 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:29.975707 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb1168-8a24-4ada-884a-f4cc519ceb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:29.976535 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb1168-8a24-4ada-884a-f4cc519ceb1e admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:29.976821 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb1168-8a24-4ada-884a-f4cc519ceb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:29.977105 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb1168-8a24-4ada-884a-f4cc519ceb1e admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:29.977848 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb1168-8a24-4ada-884a-f4cc519ceb1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:29.979813 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb1168-8a24-4ada-884a-f4cc519ceb1e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:29.985559 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 935/1863] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:42:29 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:42:29.989598 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18534f51-93c9-4911-9c16-b55c365ec5a4 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:30.003071 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 929/1864] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:42:29 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:42:30.007333 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb1168-8a24-4ada-884a-f4cc519ceb1e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:30.017828 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb1168-8a24-4ada-884a-f4cc519ceb1e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:30.062669 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18534f51-93c9-4911-9c16-b55c365ec5a4 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:30.070827 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88009e-757f-4c08-856f-303e32f35a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:30.071481 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88009e-757f-4c08-856f-303e32f35a58 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:30.071686 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88009e-757f-4c08-856f-303e32f35a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:30.072056 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88009e-757f-4c08-856f-303e32f35a58 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:30.072710 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88009e-757f-4c08-856f-303e32f35a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:30.074602 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88009e-757f-4c08-856f-303e32f35a58 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:30.088175 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c38d7d-4019-46aa-a0bf-00baf0510193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:30.088857 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c38d7d-4019-46aa-a0bf-00baf0510193 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:30.089231 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c38d7d-4019-46aa-a0bf-00baf0510193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:30.089417 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c38d7d-4019-46aa-a0bf-00baf0510193 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:30.090165 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c38d7d-4019-46aa-a0bf-00baf0510193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:30.091769 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c38d7d-4019-46aa-a0bf-00baf0510193 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:30.099791 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 936/1865] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:42:29 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:42:30.102291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88009e-757f-4c08-856f-303e32f35a58 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:30.102411 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 930/1866] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:30.105949 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c38d7d-4019-46aa-a0bf-00baf0510193 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:30.111965 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88009e-757f-4c08-856f-303e32f35a58 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:30.115267 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c38d7d-4019-46aa-a0bf-00baf0510193 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:30.117385 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411b580-fca2-4eb2-b716-a90dfd7ea82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:30.118064 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411b580-fca2-4eb2-b716-a90dfd7ea82f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:30.118346 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411b580-fca2-4eb2-b716-a90dfd7ea82f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:30.118622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411b580-fca2-4eb2-b716-a90dfd7ea82f admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:30.119354 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411b580-fca2-4eb2-b716-a90dfd7ea82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:30.120967 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411b580-fca2-4eb2-b716-a90dfd7ea82f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:30.121077 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b781e6e-3bb3-423c-b9c1-7771db1c7463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:30.121694 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b781e6e-3bb3-423c-b9c1-7771db1c7463 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:30.121971 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b781e6e-3bb3-423c-b9c1-7771db1c7463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:30.122241 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b781e6e-3bb3-423c-b9c1-7771db1c7463 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:30.122958 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b781e6e-3bb3-423c-b9c1-7771db1c7463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:30.124555 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b781e6e-3bb3-423c-b9c1-7771db1c7463 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:30.130559 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 937/1867] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:42:30.134808 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 931/1868] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:42:30.135215 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411b580-fca2-4eb2-b716-a90dfd7ea82f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:30.138621 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b781e6e-3bb3-423c-b9c1-7771db1c7463 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:30.145103 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411b580-fca2-4eb2-b716-a90dfd7ea82f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:30.148456 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b781e6e-3bb3-423c-b9c1-7771db1c7463 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:30.149802 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cd4c1-5924-4fea-b6d4-279bbb78117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:30.150430 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cd4c1-5924-4fea-b6d4-279bbb78117f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:30.150715 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cd4c1-5924-4fea-b6d4-279bbb78117f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:30.150991 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cd4c1-5924-4fea-b6d4-279bbb78117f admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:30.151713 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cd4c1-5924-4fea-b6d4-279bbb78117f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:30.153157 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505ffbc-73c5-4a86-942f-b61dd52a55af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:30.153360 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cd4c1-5924-4fea-b6d4-279bbb78117f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:30.154010 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505ffbc-73c5-4a86-942f-b61dd52a55af admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:30.154293 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505ffbc-73c5-4a86-942f-b61dd52a55af admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:30.154748 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505ffbc-73c5-4a86-942f-b61dd52a55af admin admin] PATH_INFO: `/v3/projects/cbc4338cbbb243d284245804faa793df/users/3b659dbcbb0c48c09d2d362f1385a45e/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:30.163743 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 938/1869] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:30.167977 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cd4c1-5924-4fea-b6d4-279bbb78117f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:30.169617 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505ffbc-73c5-4a86-942f-b61dd52a55af admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc4338cbbb243d284245804faa793df, user_id=3b659dbcbb0c48c09d2d362f1385a45e, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:30.172389 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505ffbc-73c5-4a86-942f-b61dd52a55af admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:30.177510 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cd4c1-5924-4fea-b6d4-279bbb78117f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:30.183604 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f50cfa-9cc9-48b7-bf9e-6734729e2325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:30.184522 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f50cfa-9cc9-48b7-bf9e-6734729e2325 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:30.184777 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f50cfa-9cc9-48b7-bf9e-6734729e2325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:30.185044 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f50cfa-9cc9-48b7-bf9e-6734729e2325 admin admin] PATH_INFO: `/v3/projects/e4c0835a458547238de635e9b7a114d0/users/aecdf049f5de43ec861cd17910298cb2/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:30.186806 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 932/1870] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:30 2022] PUT /identity/v3/projects/cbc4338cbbb243d284245804faa793df/users/3b659dbcbb0c48c09d2d362f1385a45e/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:30.197839 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8943b-4667-4811-aebd-37c9c5c6e1f2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:30.198127 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8943b-4667-4811-aebd-37c9c5c6e1f2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:30.198407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8943b-4667-4811-aebd-37c9c5c6e1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:30.200445 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f50cfa-9cc9-48b7-bf9e-6734729e2325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4c0835a458547238de635e9b7a114d0, user_id=aecdf049f5de43ec861cd17910298cb2, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:30.203250 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f50cfa-9cc9-48b7-bf9e-6734729e2325 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:30.216534 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 939/1871] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:30 2022] PUT /identity/v3/projects/e4c0835a458547238de635e9b7a114d0/users/aecdf049f5de43ec861cd17910298cb2/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:30.224746 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-1ab8943b-4667-4811-aebd-37c9c5c6e1f2 None None] MFA Rules not processed for user `3b659dbcbb0c48c09d2d362f1385a45e`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:30.226769 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1ab8943b-4667-4811-aebd-37c9c5c6e1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:30.227235 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2d96a-24e4-4842-b3d6-cb1105e5be5d None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:30.227563 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2d96a-24e4-4842-b3d6-cb1105e5be5d None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:30.227881 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2d96a-24e4-4842-b3d6-cb1105e5be5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:30.253201 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-0fa2d96a-24e4-4842-b3d6-cb1105e5be5d None None] MFA Rules not processed for user `aecdf049f5de43ec861cd17910298cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:30.254413 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-0fa2d96a-24e4-4842-b3d6-cb1105e5be5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:30.294084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 933/1872] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:42:30.305664 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8943b-4667-4811-aebd-37c9c5c6e1f2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:30.307160 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1ab8943b-4667-4811-aebd-37c9c5c6e1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:30.335810 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 940/1873] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:42:30.340251 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2d96a-24e4-4842-b3d6-cb1105e5be5d None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:30.375351 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8943b-4667-4811-aebd-37c9c5c6e1f2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:30.382545 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8de777-efc8-41df-91d7-2f6209f2eb01 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10453496872a45a9867fc6a13a13de49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:30.383196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8de777-efc8-41df-91d7-2f6209f2eb01 service glance] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:30.383399 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8de777-efc8-41df-91d7-2f6209f2eb01 service glance] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:30.383683 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8de777-efc8-41df-91d7-2f6209f2eb01 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:30.395650 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8de777-efc8-41df-91d7-2f6209f2eb01 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:30.397928 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8de777-efc8-41df-91d7-2f6209f2eb01 service glance] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:30.407998 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2d96a-24e4-4842-b3d6-cb1105e5be5d None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:30.413112 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec4fbb-bb52-4704-a08a-56aefcf5aa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:30.413871 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec4fbb-bb52-4704-a08a-56aefcf5aa30 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:30.414296 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec4fbb-bb52-4704-a08a-56aefcf5aa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:30.414592 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec4fbb-bb52-4704-a08a-56aefcf5aa30 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:30.415309 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec4fbb-bb52-4704-a08a-56aefcf5aa30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:30.416636 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 934/1874] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:30 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:42:30.417503 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec4fbb-bb52-4704-a08a-56aefcf5aa30 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:30.455578 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 941/1875] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:42:30 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:42:30.456605 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8de777-efc8-41df-91d7-2f6209f2eb01 service glance] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:30.467845 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8de777-efc8-41df-91d7-2f6209f2eb01 service glance] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:30.525602 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1c698-f27f-402c-bd09-3abf3ed3492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:30.526375 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1c698-f27f-402c-bd09-3abf3ed3492b admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:30.526663 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1c698-f27f-402c-bd09-3abf3ed3492b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:30.526939 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1c698-f27f-402c-bd09-3abf3ed3492b admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:30.527826 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1c698-f27f-402c-bd09-3abf3ed3492b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:30.529840 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1c698-f27f-402c-bd09-3abf3ed3492b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:30.553974 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 935/1876] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:42:30 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:42:30.555182 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec4fbb-bb52-4704-a08a-56aefcf5aa30 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:30.565163 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec4fbb-bb52-4704-a08a-56aefcf5aa30 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:30.570635 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213896b9-48e0-4a17-aa37-83f9c36fe68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:30.571289 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213896b9-48e0-4a17-aa37-83f9c36fe68c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:30.571572 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213896b9-48e0-4a17-aa37-83f9c36fe68c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:30.571890 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213896b9-48e0-4a17-aa37-83f9c36fe68c admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:30.572633 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213896b9-48e0-4a17-aa37-83f9c36fe68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:30.574216 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213896b9-48e0-4a17-aa37-83f9c36fe68c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:30.584644 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 942/1877] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:30.589002 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1c698-f27f-402c-bd09-3abf3ed3492b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:30.598804 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1c698-f27f-402c-bd09-3abf3ed3492b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:30.603720 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd8d97-7de0-4761-b612-e53108c0f4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:30.604628 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd8d97-7de0-4761-b612-e53108c0f4ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:30.604899 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd8d97-7de0-4761-b612-e53108c0f4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:30.605195 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd8d97-7de0-4761-b612-e53108c0f4ed admin admin] PATH_INFO: `/v3/projects/9ea8667aabf142aeaf83ee10a1f00b7e/users/f3f5c81e03f74f8f981cad30d581871c/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:30.621144 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd8d97-7de0-4761-b612-e53108c0f4ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea8667aabf142aeaf83ee10a1f00b7e, user_id=f3f5c81e03f74f8f981cad30d581871c, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:30.623841 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd8d97-7de0-4761-b612-e53108c0f4ed admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:30.639038 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 936/1878] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:30 2022] PUT /identity/v3/projects/9ea8667aabf142aeaf83ee10a1f00b7e/users/f3f5c81e03f74f8f981cad30d581871c/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:30.642931 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213896b9-48e0-4a17-aa37-83f9c36fe68c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:30.653360 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213896b9-48e0-4a17-aa37-83f9c36fe68c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:30.709118 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac9601-7517-421d-842b-14231c9a8c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:30.710466 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac9601-7517-421d-842b-14231c9a8c93 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:30.710791 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac9601-7517-421d-842b-14231c9a8c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:30.711067 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac9601-7517-421d-842b-14231c9a8c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:30.712033 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac9601-7517-421d-842b-14231c9a8c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:30.713831 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac9601-7517-421d-842b-14231c9a8c93 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:30.724692 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 943/1879] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:30.729794 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd8d97-7de0-4761-b612-e53108c0f4ed admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:30.741258 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd8d97-7de0-4761-b612-e53108c0f4ed admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:30.746219 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979048d3-0daa-43b6-9e97-9d8de2d9e3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:30.747177 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979048d3-0daa-43b6-9e97-9d8de2d9e3ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:30.747457 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979048d3-0daa-43b6-9e97-9d8de2d9e3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:30.747913 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979048d3-0daa-43b6-9e97-9d8de2d9e3ab admin admin] PATH_INFO: `/v3/projects/9ea8667aabf142aeaf83ee10a1f00b7e/users/f3f5c81e03f74f8f981cad30d581871c/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:30.749774 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979048d3-0daa-43b6-9e97-9d8de2d9e3ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea8667aabf142aeaf83ee10a1f00b7e, user_id=f3f5c81e03f74f8f981cad30d581871c, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:30.752697 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979048d3-0daa-43b6-9e97-9d8de2d9e3ab admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:30.765692 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 937/1880] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:30 2022] PUT /identity/v3/projects/9ea8667aabf142aeaf83ee10a1f00b7e/users/f3f5c81e03f74f8f981cad30d581871c/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:30.777882 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d614085-ba0c-43ee-92ba-9d53c1555147 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:30.778172 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d614085-ba0c-43ee-92ba-9d53c1555147 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:30.778453 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d614085-ba0c-43ee-92ba-9d53c1555147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:30.809532 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-0d614085-ba0c-43ee-92ba-9d53c1555147 None None] MFA Rules not processed for user `f3f5c81e03f74f8f981cad30d581871c`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:30.810795 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-0d614085-ba0c-43ee-92ba-9d53c1555147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:30.895019 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 944/1881] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:30.911869 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979048d3-0daa-43b6-9e97-9d8de2d9e3ab admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:30.914808 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-979048d3-0daa-43b6-9e97-9d8de2d9e3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:30.979495 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979048d3-0daa-43b6-9e97-9d8de2d9e3ab admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:30.983260 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ac32e-65f7-4d7b-a127-c0d921fde320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:30.983944 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ac32e-65f7-4d7b-a127-c0d921fde320 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:30.984403 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ac32e-65f7-4d7b-a127-c0d921fde320 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:30.984678 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ac32e-65f7-4d7b-a127-c0d921fde320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:30.994990 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ac32e-65f7-4d7b-a127-c0d921fde320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:30.996532 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ac32e-65f7-4d7b-a127-c0d921fde320 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:31.007114 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 938/1882] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:42:31.034384 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d614085-ba0c-43ee-92ba-9d53c1555147 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:31.115737 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d614085-ba0c-43ee-92ba-9d53c1555147 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:31.120867 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a9eaf-7860-4d48-b251-613530dcb40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:31.121723 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a9eaf-7860-4d48-b251-613530dcb40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:31.122078 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a9eaf-7860-4d48-b251-613530dcb40d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:31.122426 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a9eaf-7860-4d48-b251-613530dcb40d admin admin] PATH_INFO: `/v3/users/aecdf049f5de43ec861cd17910298cb2` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:31.124939 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a9eaf-7860-4d48-b251-613530dcb40d admin admin] RBAC: Authorizing `identity:delete_user(user_id=aecdf049f5de43ec861cd17910298cb2)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:31.126866 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a9eaf-7860-4d48-b251-613530dcb40d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:31.174305 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e86a9eaf-7860-4d48-b251-613530dcb40d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aecdf049f5de43ec861cd17910298cb2'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:31.186391 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e86a9eaf-7860-4d48-b251-613530dcb40d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aecdf049f5de43ec861cd17910298cb2'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:31.193277 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e86a9eaf-7860-4d48-b251-613530dcb40d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aecdf049f5de43ec861cd17910298cb2'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:31.201200 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e86a9eaf-7860-4d48-b251-613530dcb40d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aecdf049f5de43ec861cd17910298cb2'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:31.201923 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e86a9eaf-7860-4d48-b251-613530dcb40d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aecdf049f5de43ec861cd17910298cb2'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:31.207763 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 945/1883] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:42:31 2022] DELETE /identity/v3/users/aecdf049f5de43ec861cd17910298cb2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:31.212251 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036861f9-76fc-4e86-baca-1c22adaf4488 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:31.212536 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036861f9-76fc-4e86-baca-1c22adaf4488 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:31.212812 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036861f9-76fc-4e86-baca-1c22adaf4488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:31.230111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-036861f9-76fc-4e86-baca-1c22adaf4488 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:31.231684 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-036861f9-76fc-4e86-baca-1c22adaf4488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:31.288566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 939/1884] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:42:31.298048 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a9eaf-7860-4d48-b251-613530dcb40d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:31.299428 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-e86a9eaf-7860-4d48-b251-613530dcb40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:31.355124 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a9eaf-7860-4d48-b251-613530dcb40d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:31.359001 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a72f1-bb78-4624-a41d-0eae1768d092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:31.359664 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a72f1-bb78-4624-a41d-0eae1768d092 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:31.359978 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a72f1-bb78-4624-a41d-0eae1768d092 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:31.360256 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a72f1-bb78-4624-a41d-0eae1768d092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:31.369802 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a72f1-bb78-4624-a41d-0eae1768d092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:31.371250 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a72f1-bb78-4624-a41d-0eae1768d092 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:31.380485 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 946/1885] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:42:31.718677 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036861f9-76fc-4e86-baca-1c22adaf4488 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:31.720139 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-036861f9-76fc-4e86-baca-1c22adaf4488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:31.732629 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036861f9-76fc-4e86-baca-1c22adaf4488 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:31.737217 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af265e-23cc-4ea0-866a-b460326bc363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:31.738077 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af265e-23cc-4ea0-866a-b460326bc363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:31.738359 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af265e-23cc-4ea0-866a-b460326bc363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:31.738631 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af265e-23cc-4ea0-866a-b460326bc363 admin admin] PATH_INFO: `/v3/projects/e4c0835a458547238de635e9b7a114d0` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:31.739868 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af265e-23cc-4ea0-866a-b460326bc363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4c0835a458547238de635e9b7a114d0)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:31.743262 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af265e-23cc-4ea0-866a-b460326bc363 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:31.788751 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-39af265e-23cc-4ea0-866a-b460326bc363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4c0835a458547238de635e9b7a114d0', 'request_id': 'req-39af265e-23cc-4ea0-866a-b460326bc363'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:31.794701 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-39af265e-23cc-4ea0-866a-b460326bc363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4c0835a458547238de635e9b7a114d0', 'request_id': 'req-39af265e-23cc-4ea0-866a-b460326bc363'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:31.799961 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-39af265e-23cc-4ea0-866a-b460326bc363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4c0835a458547238de635e9b7a114d0', 'request_id': 'req-39af265e-23cc-4ea0-866a-b460326bc363'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:31.812338 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-39af265e-23cc-4ea0-866a-b460326bc363 admin admin] The token cache is being invalidate because project e4c0835a458547238de635e9b7a114d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:31.812629 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-39af265e-23cc-4ea0-866a-b460326bc363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:31.813245 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-39af265e-23cc-4ea0-866a-b460326bc363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:31.815095 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 940/1886] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:31 2022] DELETE /identity/v3/projects/e4c0835a458547238de635e9b7a114d0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:31.820304 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a72f1-bb78-4624-a41d-0eae1768d092 service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:31.829797 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a72f1-bb78-4624-a41d-0eae1768d092 service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:31.884511 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a164574-81d5-40e4-a627-ab376fcd3295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:31.885178 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a164574-81d5-40e4-a627-ab376fcd3295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:31.885457 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a164574-81d5-40e4-a627-ab376fcd3295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:31.885743 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a164574-81d5-40e4-a627-ab376fcd3295 admin admin] PATH_INFO: `/v3/users/f3f5c81e03f74f8f981cad30d581871c` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:31.887058 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a164574-81d5-40e4-a627-ab376fcd3295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3f5c81e03f74f8f981cad30d581871c)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:31.889213 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a164574-81d5-40e4-a627-ab376fcd3295 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:31.936787 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-4a164574-81d5-40e4-a627-ab376fcd3295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3f5c81e03f74f8f981cad30d581871c'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:31.948784 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-4a164574-81d5-40e4-a627-ab376fcd3295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3f5c81e03f74f8f981cad30d581871c'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:31.955559 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-4a164574-81d5-40e4-a627-ab376fcd3295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3f5c81e03f74f8f981cad30d581871c'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:31.963538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-4a164574-81d5-40e4-a627-ab376fcd3295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3f5c81e03f74f8f981cad30d581871c'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:31.964230 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-4a164574-81d5-40e4-a627-ab376fcd3295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3f5c81e03f74f8f981cad30d581871c'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:31.970543 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 947/1887] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:42:31 2022] DELETE /identity/v3/users/f3f5c81e03f74f8f981cad30d581871c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:32.357061 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af265e-23cc-4ea0-866a-b460326bc363 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:32.358860 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-39af265e-23cc-4ea0-866a-b460326bc363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:32.372567 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af265e-23cc-4ea0-866a-b460326bc363 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:32.431428 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261ec46-6467-4153-8706-b401bad829d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:32.432323 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261ec46-6467-4153-8706-b401bad829d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:32.432601 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261ec46-6467-4153-8706-b401bad829d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:32.432873 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261ec46-6467-4153-8706-b401bad829d6 admin admin] PATH_INFO: `/v3/projects/9ea8667aabf142aeaf83ee10a1f00b7e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:32.434077 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261ec46-6467-4153-8706-b401bad829d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ea8667aabf142aeaf83ee10a1f00b7e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:32.436024 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261ec46-6467-4153-8706-b401bad829d6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:32.482373 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e261ec46-6467-4153-8706-b401bad829d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ea8667aabf142aeaf83ee10a1f00b7e', 'request_id': 'req-e261ec46-6467-4153-8706-b401bad829d6'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:32.488299 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e261ec46-6467-4153-8706-b401bad829d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ea8667aabf142aeaf83ee10a1f00b7e', 'request_id': 'req-e261ec46-6467-4153-8706-b401bad829d6'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:32.494150 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e261ec46-6467-4153-8706-b401bad829d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ea8667aabf142aeaf83ee10a1f00b7e', 'request_id': 'req-e261ec46-6467-4153-8706-b401bad829d6'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:32.505753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e261ec46-6467-4153-8706-b401bad829d6 admin admin] The token cache is being invalidate because project 9ea8667aabf142aeaf83ee10a1f00b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:32.506296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e261ec46-6467-4153-8706-b401bad829d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:32.506948 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e261ec46-6467-4153-8706-b401bad829d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:32.508499 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 941/1888] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:32 2022] DELETE /identity/v3/projects/9ea8667aabf142aeaf83ee10a1f00b7e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:32.515281 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eae0dc-f096-4b76-8627-19c191b80eda None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:32.515819 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eae0dc-f096-4b76-8627-19c191b80eda None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:32.515917 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eae0dc-f096-4b76-8627-19c191b80eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:32.533088 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-c5eae0dc-f096-4b76-8627-19c191b80eda None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:32.534282 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-c5eae0dc-f096-4b76-8627-19c191b80eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:32.592293 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 948/1889] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:32.599892 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a51aaa-96c5-443c-8f56-4fa30231afb4 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:32.600634 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a51aaa-96c5-443c-8f56-4fa30231afb4 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:32.600915 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a51aaa-96c5-443c-8f56-4fa30231afb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:32.619443 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c5a51aaa-96c5-443c-8f56-4fa30231afb4 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:32.620680 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c5a51aaa-96c5-443c-8f56-4fa30231afb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:32.628502 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 942/1890] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:32.633679 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eae0dc-f096-4b76-8627-19c191b80eda None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:32.643554 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eae0dc-f096-4b76-8627-19c191b80eda None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:32.648195 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f58fb-3794-4e5c-a8d5-51d97faaa4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:32.648835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f58fb-3794-4e5c-a8d5-51d97faaa4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:32.649117 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f58fb-3794-4e5c-a8d5-51d97faaa4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:32.649392 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f58fb-3794-4e5c-a8d5-51d97faaa4b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:32.650118 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f58fb-3794-4e5c-a8d5-51d97faaa4b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:42:32.650421 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f58fb-3794-4e5c-a8d5-51d97faaa4b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:32.652046 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f58fb-3794-4e5c-a8d5-51d97faaa4b0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:32.663822 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 949/1891] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:42:32.668065 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a51aaa-96c5-443c-8f56-4fa30231afb4 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:32.677095 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a51aaa-96c5-443c-8f56-4fa30231afb4 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:32.682880 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5ed80-5f3e-4423-aaaa-ce591c978dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:32.683512 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5ed80-5f3e-4423-aaaa-ce591c978dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:32.683863 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5ed80-5f3e-4423-aaaa-ce591c978dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:32.684135 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5ed80-5f3e-4423-aaaa-ce591c978dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:32.684843 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5ed80-5f3e-4423-aaaa-ce591c978dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:32.686725 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5ed80-5f3e-4423-aaaa-ce591c978dc3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:32.712252 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 943/1892] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:42:32 2022] POST /identity/v3/projects => generated 401 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:42:32.717516 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f58fb-3794-4e5c-a8d5-51d97faaa4b0 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:32.727852 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f58fb-3794-4e5c-a8d5-51d97faaa4b0 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:32.783846 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b774f-dd86-4244-8032-1498cf712e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:32.784543 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b774f-dd86-4244-8032-1498cf712e9e admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:32.784820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b774f-dd86-4244-8032-1498cf712e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:32.785094 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b774f-dd86-4244-8032-1498cf712e9e admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:32.785807 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b774f-dd86-4244-8032-1498cf712e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:32.788459 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b774f-dd86-4244-8032-1498cf712e9e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:32.812703 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 950/1893] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:42:32 2022] POST /identity/v3/users => generated 301 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:42:32.814421 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5ed80-5f3e-4423-aaaa-ce591c978dc3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:32.826899 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5ed80-5f3e-4423-aaaa-ce591c978dc3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:32.832126 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20c2ee-3cf7-448e-8c64-878fd8451d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:32.833036 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20c2ee-3cf7-448e-8c64-878fd8451d33 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:32.833643 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20c2ee-3cf7-448e-8c64-878fd8451d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:32.834120 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20c2ee-3cf7-448e-8c64-878fd8451d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:32.835391 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20c2ee-3cf7-448e-8c64-878fd8451d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:32.837024 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20c2ee-3cf7-448e-8c64-878fd8451d33 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:32.855561 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 944/1894] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:32.856276 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b774f-dd86-4244-8032-1498cf712e9e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:32.868037 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b774f-dd86-4244-8032-1498cf712e9e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:32.873492 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090169b1-cdd2-42c0-b221-3b924498fbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:32.874220 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090169b1-cdd2-42c0-b221-3b924498fbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:32.874512 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090169b1-cdd2-42c0-b221-3b924498fbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:32.874839 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090169b1-cdd2-42c0-b221-3b924498fbd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:32.875640 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090169b1-cdd2-42c0-b221-3b924498fbd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:32.877355 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090169b1-cdd2-42c0-b221-3b924498fbd0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:32.891311 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 951/1895] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:32.892671 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20c2ee-3cf7-448e-8c64-878fd8451d33 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:32.903394 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20c2ee-3cf7-448e-8c64-878fd8451d33 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:32.908028 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f0b6d-402d-46ae-bdc5-3070afcbdf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:32.908902 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f0b6d-402d-46ae-bdc5-3070afcbdf61 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:32.909184 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f0b6d-402d-46ae-bdc5-3070afcbdf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:32.909459 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f0b6d-402d-46ae-bdc5-3070afcbdf61 admin admin] PATH_INFO: `/v3/projects/c66bd698563047689a70f78f5c6d7b0b/users/e0ee836af209479bac813a590ba64cbe/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:32.925359 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f0b6d-402d-46ae-bdc5-3070afcbdf61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c66bd698563047689a70f78f5c6d7b0b, user_id=e0ee836af209479bac813a590ba64cbe, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:32.928067 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f0b6d-402d-46ae-bdc5-3070afcbdf61 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:32.942543 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 945/1896] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:32 2022] PUT /identity/v3/projects/c66bd698563047689a70f78f5c6d7b0b/users/e0ee836af209479bac813a590ba64cbe/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:32.952724 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5ea2e-897c-4634-b9c7-e6ec930e94f4 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:32.953034 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5ea2e-897c-4634-b9c7-e6ec930e94f4 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:32.953296 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5ea2e-897c-4634-b9c7-e6ec930e94f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:32.984470 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-b1a5ea2e-897c-4634-b9c7-e6ec930e94f4 None None] MFA Rules not processed for user `e0ee836af209479bac813a590ba64cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:32.986027 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-b1a5ea2e-897c-4634-b9c7-e6ec930e94f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:33.064912 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 952/1897] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:33.069651 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f0b6d-402d-46ae-bdc5-3070afcbdf61 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:33.129472 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f0b6d-402d-46ae-bdc5-3070afcbdf61 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:33.136266 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4dafb-c9dc-4267-96d0-4ed9416b7e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:33.136979 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4dafb-c9dc-4267-96d0-4ed9416b7e02 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:33.137285 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4dafb-c9dc-4267-96d0-4ed9416b7e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:33.137570 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4dafb-c9dc-4267-96d0-4ed9416b7e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:33.138285 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4dafb-c9dc-4267-96d0-4ed9416b7e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:33.140227 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4dafb-c9dc-4267-96d0-4ed9416b7e02 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:33.165818 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 946/1898] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:42:33 2022] POST /identity/v3/projects => generated 399 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:42:33.169814 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5ea2e-897c-4634-b9c7-e6ec930e94f4 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:33.182024 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5ea2e-897c-4634-b9c7-e6ec930e94f4 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:33.236189 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ad629-2070-4b24-b537-a515832916ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:33.236845 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ad629-2070-4b24-b537-a515832916ec admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:33.237123 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ad629-2070-4b24-b537-a515832916ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:33.237394 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ad629-2070-4b24-b537-a515832916ec admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:33.238085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ad629-2070-4b24-b537-a515832916ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:33.240019 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ad629-2070-4b24-b537-a515832916ec admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:33.261077 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 953/1899] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:42:33 2022] POST /identity/v3/users => generated 306 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:42:33.269904 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4dafb-c9dc-4267-96d0-4ed9416b7e02 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:33.280600 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4dafb-c9dc-4267-96d0-4ed9416b7e02 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:33.285548 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa2273-5933-453f-9dfa-b8814784645c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:33.286202 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa2273-5933-453f-9dfa-b8814784645c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:33.286486 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa2273-5933-453f-9dfa-b8814784645c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:33.286762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa2273-5933-453f-9dfa-b8814784645c admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:33.287522 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa2273-5933-453f-9dfa-b8814784645c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:33.289980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa2273-5933-453f-9dfa-b8814784645c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:33.302102 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 947/1900] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:33.309878 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ad629-2070-4b24-b537-a515832916ec admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:33.318025 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ad629-2070-4b24-b537-a515832916ec admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:33.324058 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384f7bd-8103-4d5d-9e38-2eba268c3cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:33.325004 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384f7bd-8103-4d5d-9e38-2eba268c3cac admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:33.325345 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384f7bd-8103-4d5d-9e38-2eba268c3cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:33.325697 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384f7bd-8103-4d5d-9e38-2eba268c3cac admin admin] PATH_INFO: `/v3/projects/0554f487ebb64a77aa9ab3768ca61ca8/users/4bb30fe2e6bf4648a263efa43dc9a308/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:33.349473 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384f7bd-8103-4d5d-9e38-2eba268c3cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=0554f487ebb64a77aa9ab3768ca61ca8, user_id=4bb30fe2e6bf4648a263efa43dc9a308, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:33.353633 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384f7bd-8103-4d5d-9e38-2eba268c3cac admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:33.371964 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 954/1901] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:33 2022] PUT /identity/v3/projects/0554f487ebb64a77aa9ab3768ca61ca8/users/4bb30fe2e6bf4648a263efa43dc9a308/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:33.376688 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa2273-5933-453f-9dfa-b8814784645c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:33.396826 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa2273-5933-453f-9dfa-b8814784645c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:33.515517 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c7098-fea5-4365-8273-a3c0ccb1bd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:33.516247 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c7098-fea5-4365-8273-a3c0ccb1bd6b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:33.516537 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c7098-fea5-4365-8273-a3c0ccb1bd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:33.516821 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c7098-fea5-4365-8273-a3c0ccb1bd6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:33.517800 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c7098-fea5-4365-8273-a3c0ccb1bd6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:33.519565 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c7098-fea5-4365-8273-a3c0ccb1bd6b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:33.534113 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 948/1902] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:33.541220 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384f7bd-8103-4d5d-9e38-2eba268c3cac admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:33.552178 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384f7bd-8103-4d5d-9e38-2eba268c3cac admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:33.558395 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866710f-48ac-445b-9e71-89158169b99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:33.559287 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866710f-48ac-445b-9e71-89158169b99e admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:33.559573 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866710f-48ac-445b-9e71-89158169b99e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:33.559884 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866710f-48ac-445b-9e71-89158169b99e admin admin] PATH_INFO: `/v3/projects/0554f487ebb64a77aa9ab3768ca61ca8/users/4bb30fe2e6bf4648a263efa43dc9a308/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:33.564256 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866710f-48ac-445b-9e71-89158169b99e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0554f487ebb64a77aa9ab3768ca61ca8, user_id=4bb30fe2e6bf4648a263efa43dc9a308, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:33.575225 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866710f-48ac-445b-9e71-89158169b99e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:33.589903 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 955/1903] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:33 2022] PUT /identity/v3/projects/0554f487ebb64a77aa9ab3768ca61ca8/users/4bb30fe2e6bf4648a263efa43dc9a308/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:33.601259 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48714252-2894-413e-b5ff-0be504eda5a2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:33.602003 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48714252-2894-413e-b5ff-0be504eda5a2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:33.602291 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48714252-2894-413e-b5ff-0be504eda5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:33.642852 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-48714252-2894-413e-b5ff-0be504eda5a2 None None] MFA Rules not processed for user `4bb30fe2e6bf4648a263efa43dc9a308`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:33.644277 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-48714252-2894-413e-b5ff-0be504eda5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:33.734378 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 949/1904] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:33 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:33.746134 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866710f-48ac-445b-9e71-89158169b99e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:33.747899 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-c866710f-48ac-445b-9e71-89158169b99e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:33.808302 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866710f-48ac-445b-9e71-89158169b99e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:33.812270 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75314fba-7ad3-45e4-a5a1-ca197b22cb8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:33.813009 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75314fba-7ad3-45e4-a5a1-ca197b22cb8e service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:33.813334 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75314fba-7ad3-45e4-a5a1-ca197b22cb8e service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:33.813653 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75314fba-7ad3-45e4-a5a1-ca197b22cb8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:33.823920 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75314fba-7ad3-45e4-a5a1-ca197b22cb8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:33.825354 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75314fba-7ad3-45e4-a5a1-ca197b22cb8e service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:33.835038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 956/1905] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:33 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:42:33.912391 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48714252-2894-413e-b5ff-0be504eda5a2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:33.922365 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48714252-2894-413e-b5ff-0be504eda5a2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:33.925992 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529d949-eae4-481d-af12-7112962e8f10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:33.926629 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529d949-eae4-481d-af12-7112962e8f10 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:33.926921 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529d949-eae4-481d-af12-7112962e8f10 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:33.927191 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529d949-eae4-481d-af12-7112962e8f10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:33.997220 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9529d949-eae4-481d-af12-7112962e8f10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:33.998732 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9529d949-eae4-481d-af12-7112962e8f10 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:34.009495 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 950/1906] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:42:50.431806 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75314fba-7ad3-45e4-a5a1-ca197b22cb8e service cinder] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:50.434836 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-75314fba-7ad3-45e4-a5a1-ca197b22cb8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:50.553049 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75314fba-7ad3-45e4-a5a1-ca197b22cb8e service cinder] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:50.560835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9be420-55c9-44c3-af9d-09385d1d7b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:50.561724 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9be420-55c9-44c3-af9d-09385d1d7b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:50.562004 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9be420-55c9-44c3-af9d-09385d1d7b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:50.562285 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9be420-55c9-44c3-af9d-09385d1d7b61 admin admin] PATH_INFO: `/v3/users/bc6151d08fa240bb881a000cd4537941` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:50.564188 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9be420-55c9-44c3-af9d-09385d1d7b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc6151d08fa240bb881a000cd4537941)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:50.566146 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9be420-55c9-44c3-af9d-09385d1d7b61 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:50.660175 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fb9be420-55c9-44c3-af9d-09385d1d7b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc6151d08fa240bb881a000cd4537941'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:50.696113 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fb9be420-55c9-44c3-af9d-09385d1d7b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc6151d08fa240bb881a000cd4537941'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:50.733060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fb9be420-55c9-44c3-af9d-09385d1d7b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc6151d08fa240bb881a000cd4537941'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:50.752618 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fb9be420-55c9-44c3-af9d-09385d1d7b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc6151d08fa240bb881a000cd4537941'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:50.754145 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fb9be420-55c9-44c3-af9d-09385d1d7b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc6151d08fa240bb881a000cd4537941'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:50.772232 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 957/1907] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:42:50 2022] DELETE /identity/v3/users/bc6151d08fa240bb881a000cd4537941 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:50.778275 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cad5c-e0b0-4b38-9db0-c1e0fabaa9a3 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:50.779408 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cad5c-e0b0-4b38-9db0-c1e0fabaa9a3 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:50.779803 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cad5c-e0b0-4b38-9db0-c1e0fabaa9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:50.811907 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-151cad5c-e0b0-4b38-9db0-c1e0fabaa9a3 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:50.813518 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-151cad5c-e0b0-4b38-9db0-c1e0fabaa9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:50.922280 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 951/1908] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:42:50.932766 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9be420-55c9-44c3-af9d-09385d1d7b61 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:50.934755 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-fb9be420-55c9-44c3-af9d-09385d1d7b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:51.070632 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9be420-55c9-44c3-af9d-09385d1d7b61 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:51.087584 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b756e-a2a3-4266-acaf-8165899ad7ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:51.088305 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b756e-a2a3-4266-acaf-8165899ad7ee service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:51.088718 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b756e-a2a3-4266-acaf-8165899ad7ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:51.088902 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b756e-a2a3-4266-acaf-8165899ad7ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:51.095352 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cad5c-e0b0-4b38-9db0-c1e0fabaa9a3 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:51.097401 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-151cad5c-e0b0-4b38-9db0-c1e0fabaa9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:51.106318 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b756e-a2a3-4266-acaf-8165899ad7ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:51.107361 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b756e-a2a3-4266-acaf-8165899ad7ee service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:51.120192 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cad5c-e0b0-4b38-9db0-c1e0fabaa9a3 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:51.131645 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 958/1909] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:42:51.157441 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814edb4-3f0d-4f30-ae41-c8d88ae708bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:51.158337 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814edb4-3f0d-4f30-ae41-c8d88ae708bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:51.158611 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814edb4-3f0d-4f30-ae41-c8d88ae708bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:51.159075 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814edb4-3f0d-4f30-ae41-c8d88ae708bf admin admin] PATH_INFO: `/v3/users/e0ee836af209479bac813a590ba64cbe` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:51.160539 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814edb4-3f0d-4f30-ae41-c8d88ae708bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ee836af209479bac813a590ba64cbe)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:51.162638 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814edb4-3f0d-4f30-ae41-c8d88ae708bf admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:51.255060 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f814edb4-3f0d-4f30-ae41-c8d88ae708bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ee836af209479bac813a590ba64cbe'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:51.266909 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f814edb4-3f0d-4f30-ae41-c8d88ae708bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ee836af209479bac813a590ba64cbe'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:51.279145 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f814edb4-3f0d-4f30-ae41-c8d88ae708bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ee836af209479bac813a590ba64cbe'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:51.290662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f814edb4-3f0d-4f30-ae41-c8d88ae708bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ee836af209479bac813a590ba64cbe'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:51.295702 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f814edb4-3f0d-4f30-ae41-c8d88ae708bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ee836af209479bac813a590ba64cbe'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:51.306231 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 952/1910] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:42:51 2022] DELETE /identity/v3/users/e0ee836af209479bac813a590ba64cbe => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:51.311223 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49589e9-d1bd-4fbf-bdec-e64caf659f83 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:51.311566 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49589e9-d1bd-4fbf-bdec-e64caf659f83 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:51.311873 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49589e9-d1bd-4fbf-bdec-e64caf659f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:51.347064 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-e49589e9-d1bd-4fbf-bdec-e64caf659f83 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:51.348160 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-e49589e9-d1bd-4fbf-bdec-e64caf659f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:51.489952 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 959/1911] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:51.520432 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814edb4-3f0d-4f30-ae41-c8d88ae708bf admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:51.522075 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f814edb4-3f0d-4f30-ae41-c8d88ae708bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:51.639630 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814edb4-3f0d-4f30-ae41-c8d88ae708bf admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:51.667814 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89974fff-e104-4517-a30e-b3bbfa4db2cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:51.669148 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89974fff-e104-4517-a30e-b3bbfa4db2cf service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:51.669653 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89974fff-e104-4517-a30e-b3bbfa4db2cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:51.670387 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89974fff-e104-4517-a30e-b3bbfa4db2cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:51.709141 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89974fff-e104-4517-a30e-b3bbfa4db2cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:51.711062 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89974fff-e104-4517-a30e-b3bbfa4db2cf service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:51.745132 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 953/1912] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:42:52.543200 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49589e9-d1bd-4fbf-bdec-e64caf659f83 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:52.545315 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-e49589e9-d1bd-4fbf-bdec-e64caf659f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:52.595300 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49589e9-d1bd-4fbf-bdec-e64caf659f83 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:52.620679 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b4270-7e98-4baf-897d-f4675f76fa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:52.621925 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b4270-7e98-4baf-897d-f4675f76fa8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:52.623672 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b4270-7e98-4baf-897d-f4675f76fa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:52.624423 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b4270-7e98-4baf-897d-f4675f76fa8a admin admin] PATH_INFO: `/v3/projects/e38cd0d703c84bc8b812b0a41497a858` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:52.626167 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b4270-7e98-4baf-897d-f4675f76fa8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e38cd0d703c84bc8b812b0a41497a858)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:52.628330 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b4270-7e98-4baf-897d-f4675f76fa8a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:52.728456 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e53b4270-7e98-4baf-897d-f4675f76fa8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e38cd0d703c84bc8b812b0a41497a858', 'request_id': 'req-e53b4270-7e98-4baf-897d-f4675f76fa8a'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:52.735923 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e53b4270-7e98-4baf-897d-f4675f76fa8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e38cd0d703c84bc8b812b0a41497a858', 'request_id': 'req-e53b4270-7e98-4baf-897d-f4675f76fa8a'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:52.743369 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e53b4270-7e98-4baf-897d-f4675f76fa8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e38cd0d703c84bc8b812b0a41497a858', 'request_id': 'req-e53b4270-7e98-4baf-897d-f4675f76fa8a'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:52.770227 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e53b4270-7e98-4baf-897d-f4675f76fa8a admin admin] The token cache is being invalidate because project e38cd0d703c84bc8b812b0a41497a858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:52.770835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e53b4270-7e98-4baf-897d-f4675f76fa8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:52.774101 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89974fff-e104-4517-a30e-b3bbfa4db2cf service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:52.775607 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e53b4270-7e98-4baf-897d-f4675f76fa8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:52.776409 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-89974fff-e104-4517-a30e-b3bbfa4db2cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:52.777778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 960/1913] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:52 2022] DELETE /identity/v3/projects/e38cd0d703c84bc8b812b0a41497a858 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:52.783229 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b4270-7e98-4baf-897d-f4675f76fa8a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:52.784942 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-e53b4270-7e98-4baf-897d-f4675f76fa8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:52.814115 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89974fff-e104-4517-a30e-b3bbfa4db2cf service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:52.895094 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b4270-7e98-4baf-897d-f4675f76fa8a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:52.900655 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5666e-0963-4ae8-a3e7-6c1b28d6c77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:52.901730 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5666e-0963-4ae8-a3e7-6c1b28d6c77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:52.902152 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5666e-0963-4ae8-a3e7-6c1b28d6c77b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:52.902527 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5666e-0963-4ae8-a3e7-6c1b28d6c77b admin admin] PATH_INFO: `/v3/users/a93c69cd753c4f2b873c3660901092f6` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:52.904170 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5666e-0963-4ae8-a3e7-6c1b28d6c77b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a93c69cd753c4f2b873c3660901092f6)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:52.906939 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5666e-0963-4ae8-a3e7-6c1b28d6c77b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:52.921062 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e40bf-578c-4e6f-93fc-8b36f1a843f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:52.921982 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e40bf-578c-4e6f-93fc-8b36f1a843f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:52.922316 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e40bf-578c-4e6f-93fc-8b36f1a843f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:52.922819 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e40bf-578c-4e6f-93fc-8b36f1a843f7 admin admin] PATH_INFO: `/v3/projects/c66bd698563047689a70f78f5c6d7b0b` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:52.924252 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e40bf-578c-4e6f-93fc-8b36f1a843f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c66bd698563047689a70f78f5c6d7b0b)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:52.926476 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e40bf-578c-4e6f-93fc-8b36f1a843f7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:52.966931 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-88f5666e-0963-4ae8-a3e7-6c1b28d6c77b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a93c69cd753c4f2b873c3660901092f6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:52.980931 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-88f5666e-0963-4ae8-a3e7-6c1b28d6c77b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a93c69cd753c4f2b873c3660901092f6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:52.981985 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-346e40bf-578c-4e6f-93fc-8b36f1a843f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c66bd698563047689a70f78f5c6d7b0b', 'request_id': 'req-346e40bf-578c-4e6f-93fc-8b36f1a843f7'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:52.990290 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-88f5666e-0963-4ae8-a3e7-6c1b28d6c77b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a93c69cd753c4f2b873c3660901092f6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:52.990534 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-346e40bf-578c-4e6f-93fc-8b36f1a843f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c66bd698563047689a70f78f5c6d7b0b', 'request_id': 'req-346e40bf-578c-4e6f-93fc-8b36f1a843f7'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:52.998459 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-346e40bf-578c-4e6f-93fc-8b36f1a843f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c66bd698563047689a70f78f5c6d7b0b', 'request_id': 'req-346e40bf-578c-4e6f-93fc-8b36f1a843f7'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:53.001873 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-88f5666e-0963-4ae8-a3e7-6c1b28d6c77b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a93c69cd753c4f2b873c3660901092f6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:53.002616 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-88f5666e-0963-4ae8-a3e7-6c1b28d6c77b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a93c69cd753c4f2b873c3660901092f6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:53.013179 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 961/1914] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:42:52 2022] DELETE /identity/v3/users/a93c69cd753c4f2b873c3660901092f6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:53.014619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-346e40bf-578c-4e6f-93fc-8b36f1a843f7 admin admin] The token cache is being invalidate because project c66bd698563047689a70f78f5c6d7b0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:53.014918 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-346e40bf-578c-4e6f-93fc-8b36f1a843f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:53.015575 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-346e40bf-578c-4e6f-93fc-8b36f1a843f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:53.017402 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 954/1915] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:52 2022] DELETE /identity/v3/projects/c66bd698563047689a70f78f5c6d7b0b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:53.021362 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5666e-0963-4ae8-a3e7-6c1b28d6c77b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:53.023121 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-88f5666e-0963-4ae8-a3e7-6c1b28d6c77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:53.119789 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5666e-0963-4ae8-a3e7-6c1b28d6c77b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:53.131679 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0644277-c573-4d2d-9941-c6341fd34587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:53.133469 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0644277-c573-4d2d-9941-c6341fd34587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:53.133768 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0644277-c573-4d2d-9941-c6341fd34587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:53.134050 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0644277-c573-4d2d-9941-c6341fd34587 admin admin] PATH_INFO: `/v3/users/4bb30fe2e6bf4648a263efa43dc9a308` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:53.136703 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0644277-c573-4d2d-9941-c6341fd34587 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb30fe2e6bf4648a263efa43dc9a308)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:53.139882 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0644277-c573-4d2d-9941-c6341fd34587 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:53.206716 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b0644277-c573-4d2d-9941-c6341fd34587 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb30fe2e6bf4648a263efa43dc9a308'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:53.231505 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b0644277-c573-4d2d-9941-c6341fd34587 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb30fe2e6bf4648a263efa43dc9a308'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:53.239463 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b0644277-c573-4d2d-9941-c6341fd34587 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb30fe2e6bf4648a263efa43dc9a308'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:53.250614 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b0644277-c573-4d2d-9941-c6341fd34587 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb30fe2e6bf4648a263efa43dc9a308'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:53.251287 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b0644277-c573-4d2d-9941-c6341fd34587 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb30fe2e6bf4648a263efa43dc9a308'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:53.258903 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 962/1916] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:42:53 2022] DELETE /identity/v3/users/4bb30fe2e6bf4648a263efa43dc9a308 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:53.452864 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e40bf-578c-4e6f-93fc-8b36f1a843f7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:53.455025 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-346e40bf-578c-4e6f-93fc-8b36f1a843f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:53.580732 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e40bf-578c-4e6f-93fc-8b36f1a843f7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:53.716392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d724551-7d16-415e-b8ca-d36152c8f3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:53.717334 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d724551-7d16-415e-b8ca-d36152c8f3e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:53.717622 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d724551-7d16-415e-b8ca-d36152c8f3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:53.717944 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d724551-7d16-415e-b8ca-d36152c8f3e2 admin admin] PATH_INFO: `/v3/projects/35a89622269d43479ee93e3c72f3091b` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:53.720933 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d724551-7d16-415e-b8ca-d36152c8f3e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35a89622269d43479ee93e3c72f3091b)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:53.724633 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d724551-7d16-415e-b8ca-d36152c8f3e2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:53.810814 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3d724551-7d16-415e-b8ca-d36152c8f3e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35a89622269d43479ee93e3c72f3091b', 'request_id': 'req-3d724551-7d16-415e-b8ca-d36152c8f3e2'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:53.817612 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0644277-c573-4d2d-9941-c6341fd34587 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:53.819065 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-b0644277-c573-4d2d-9941-c6341fd34587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:53.821405 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3d724551-7d16-415e-b8ca-d36152c8f3e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35a89622269d43479ee93e3c72f3091b', 'request_id': 'req-3d724551-7d16-415e-b8ca-d36152c8f3e2'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:53.828059 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3d724551-7d16-415e-b8ca-d36152c8f3e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35a89622269d43479ee93e3c72f3091b', 'request_id': 'req-3d724551-7d16-415e-b8ca-d36152c8f3e2'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:53.846624 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0644277-c573-4d2d-9941-c6341fd34587 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:53.870976 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3d724551-7d16-415e-b8ca-d36152c8f3e2 admin admin] The token cache is being invalidate because project 35a89622269d43479ee93e3c72f3091b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:53.871430 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3d724551-7d16-415e-b8ca-d36152c8f3e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:53.873827 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3d724551-7d16-415e-b8ca-d36152c8f3e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:53.878939 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 955/1917] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:53 2022] DELETE /identity/v3/projects/35a89622269d43479ee93e3c72f3091b => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:53.887354 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b3801-d0e4-464c-a5be-5155df2be887 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:53.889983 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b3801-d0e4-464c-a5be-5155df2be887 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:53.890278 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b3801-d0e4-464c-a5be-5155df2be887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:53.918178 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-b05b3801-d0e4-464c-a5be-5155df2be887 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:53.920023 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b05b3801-d0e4-464c-a5be-5155df2be887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:53.934316 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5992749-ea7a-4c57-85c2-cc40c2c45c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:53.935178 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5992749-ea7a-4c57-85c2-cc40c2c45c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:53.936091 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5992749-ea7a-4c57-85c2-cc40c2c45c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:53.936370 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5992749-ea7a-4c57-85c2-cc40c2c45c42 admin admin] PATH_INFO: `/v3/projects/0554f487ebb64a77aa9ab3768ca61ca8` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:53.947284 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5992749-ea7a-4c57-85c2-cc40c2c45c42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0554f487ebb64a77aa9ab3768ca61ca8)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:53.949565 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5992749-ea7a-4c57-85c2-cc40c2c45c42 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:53.949961 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 956/1918] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:53.954527 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b3f11-489c-4955-b082-7ff05f101f85 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:53.954840 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b3f11-489c-4955-b082-7ff05f101f85 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:53.955494 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b3f11-489c-4955-b082-7ff05f101f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:53.989571 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-079b3f11-489c-4955-b082-7ff05f101f85 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:53.994547 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-079b3f11-489c-4955-b082-7ff05f101f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:54.024655 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b5992749-ea7a-4c57-85c2-cc40c2c45c42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0554f487ebb64a77aa9ab3768ca61ca8', 'request_id': 'req-b5992749-ea7a-4c57-85c2-cc40c2c45c42'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:54.032305 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b5992749-ea7a-4c57-85c2-cc40c2c45c42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0554f487ebb64a77aa9ab3768ca61ca8', 'request_id': 'req-b5992749-ea7a-4c57-85c2-cc40c2c45c42'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:54.049551 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b5992749-ea7a-4c57-85c2-cc40c2c45c42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0554f487ebb64a77aa9ab3768ca61ca8', 'request_id': 'req-b5992749-ea7a-4c57-85c2-cc40c2c45c42'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:54.070651 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b5992749-ea7a-4c57-85c2-cc40c2c45c42 admin admin] The token cache is being invalidate because project 0554f487ebb64a77aa9ab3768ca61ca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:54.072366 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b5992749-ea7a-4c57-85c2-cc40c2c45c42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:54.074310 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b5992749-ea7a-4c57-85c2-cc40c2c45c42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:54.077138 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 963/1919] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:53 2022] DELETE /identity/v3/projects/0554f487ebb64a77aa9ab3768ca61ca8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:54.083203 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142cfaf-f2ea-4a81-b689-c6a502bf95f9 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.084978 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142cfaf-f2ea-4a81-b689-c6a502bf95f9 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.086140 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142cfaf-f2ea-4a81-b689-c6a502bf95f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.104557 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 957/1920] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:54.105926 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b3f11-489c-4955-b082-7ff05f101f85 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:54.115742 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b3f11-489c-4955-b082-7ff05f101f85 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:54.116048 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-8142cfaf-f2ea-4a81-b689-c6a502bf95f9 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:54.118227 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-8142cfaf-f2ea-4a81-b689-c6a502bf95f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:54.121834 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd07fc8-397b-4e07-9461-0f49831a16df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:54.122751 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd07fc8-397b-4e07-9461-0f49831a16df admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.122986 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd07fc8-397b-4e07-9461-0f49831a16df admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.123434 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd07fc8-397b-4e07-9461-0f49831a16df admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.124341 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd07fc8-397b-4e07-9461-0f49831a16df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:42:54.124832 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd07fc8-397b-4e07-9461-0f49831a16df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:54.133989 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd07fc8-397b-4e07-9461-0f49831a16df admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:54.134179 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 964/1921] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:42:54.144738 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb061c93-a628-4b6b-ad47-73e1592c515a None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.144966 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb061c93-a628-4b6b-ad47-73e1592c515a None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.145629 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb061c93-a628-4b6b-ad47-73e1592c515a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.150269 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 958/1922] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:42:54.155337 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd07fc8-397b-4e07-9461-0f49831a16df admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:54.170624 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd07fc8-397b-4e07-9461-0f49831a16df admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:54.172096 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-eb061c93-a628-4b6b-ad47-73e1592c515a None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:54.173437 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-eb061c93-a628-4b6b-ad47-73e1592c515a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:54.176695 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c66c33-6f0b-4de1-bfe1-09401727745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:54.177357 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c66c33-6f0b-4de1-bfe1-09401727745a admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.177672 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c66c33-6f0b-4de1-bfe1-09401727745a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.177951 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c66c33-6f0b-4de1-bfe1-09401727745a admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.178869 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c66c33-6f0b-4de1-bfe1-09401727745a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:54.181090 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c66c33-6f0b-4de1-bfe1-09401727745a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:54.185300 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 965/1923] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:42:54.189703 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb061c93-a628-4b6b-ad47-73e1592c515a None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:54.201147 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb061c93-a628-4b6b-ad47-73e1592c515a None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:54.208574 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70dfdc-071e-45c7-9bf6-6dc2d9bee01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:54.209286 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70dfdc-071e-45c7-9bf6-6dc2d9bee01d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.210075 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70dfdc-071e-45c7-9bf6-6dc2d9bee01d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.210549 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70dfdc-071e-45c7-9bf6-6dc2d9bee01d admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.210744 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 959/1924] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:42:54 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:42:54.212184 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70dfdc-071e-45c7-9bf6-6dc2d9bee01d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:42:54.212184 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70dfdc-071e-45c7-9bf6-6dc2d9bee01d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:54.214238 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70dfdc-071e-45c7-9bf6-6dc2d9bee01d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:54.214856 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c66c33-6f0b-4de1-bfe1-09401727745a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:54.228486 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 966/1925] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:42:54.234661 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70dfdc-071e-45c7-9bf6-6dc2d9bee01d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:54.246219 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70dfdc-071e-45c7-9bf6-6dc2d9bee01d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:54.299207 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c66c33-6f0b-4de1-bfe1-09401727745a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:54.310696 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f797d-4222-4222-ad5f-c885e344b8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:54.312114 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f797d-4222-4222-ad5f-c885e344b8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.312114 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f797d-4222-4222-ad5f-c885e344b8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.312874 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f797d-4222-4222-ad5f-c885e344b8a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.313712 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f797d-4222-4222-ad5f-c885e344b8a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:54.316042 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f797d-4222-4222-ad5f-c885e344b8a0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:54.347860 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 960/1926] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:42:54 2022] POST /identity/v3/users => generated 291 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:42:54.352587 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f797d-4222-4222-ad5f-c885e344b8a0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:54.353378 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b2dc7-f7c0-4f5a-bb7a-31d9516ea3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:54.354191 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b2dc7-f7c0-4f5a-bb7a-31d9516ea3bb admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.354475 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b2dc7-f7c0-4f5a-bb7a-31d9516ea3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.354870 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b2dc7-f7c0-4f5a-bb7a-31d9516ea3bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.355582 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b2dc7-f7c0-4f5a-bb7a-31d9516ea3bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:54.357967 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b2dc7-f7c0-4f5a-bb7a-31d9516ea3bb admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:54.362501 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f797d-4222-4222-ad5f-c885e344b8a0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:54.370206 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649ee9b-9c63-4d6a-9fc1-57416290cadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:54.370935 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649ee9b-9c63-4d6a-9fc1-57416290cadd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.371228 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649ee9b-9c63-4d6a-9fc1-57416290cadd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.371509 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649ee9b-9c63-4d6a-9fc1-57416290cadd admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.372283 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649ee9b-9c63-4d6a-9fc1-57416290cadd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:54.373945 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649ee9b-9c63-4d6a-9fc1-57416290cadd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:54.386656 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 961/1927] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:42:54.390825 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649ee9b-9c63-4d6a-9fc1-57416290cadd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:54.399223 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 967/1928] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:42:54 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:42:54.403679 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649ee9b-9c63-4d6a-9fc1-57416290cadd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:54.403894 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b2dc7-f7c0-4f5a-bb7a-31d9516ea3bb admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:54.458336 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3441ff-da92-485e-97fe-0410d8f74361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:54.458921 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3441ff-da92-485e-97fe-0410d8f74361 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.459203 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3441ff-da92-485e-97fe-0410d8f74361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.459478 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3441ff-da92-485e-97fe-0410d8f74361 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.460971 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3441ff-da92-485e-97fe-0410d8f74361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:54.462657 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b2dc7-f7c0-4f5a-bb7a-31d9516ea3bb admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:54.462835 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3441ff-da92-485e-97fe-0410d8f74361 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:54.467376 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc1ae7-2703-4a8b-9d08-ffa19759bd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:54.468083 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc1ae7-2703-4a8b-9d08-ffa19759bd58 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.468367 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc1ae7-2703-4a8b-9d08-ffa19759bd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.468645 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc1ae7-2703-4a8b-9d08-ffa19759bd58 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.469491 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc1ae7-2703-4a8b-9d08-ffa19759bd58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:54.471383 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc1ae7-2703-4a8b-9d08-ffa19759bd58 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:54.473451 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 962/1929] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:42:54.478086 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3441ff-da92-485e-97fe-0410d8f74361 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:54.487712 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3441ff-da92-485e-97fe-0410d8f74361 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:54.491512 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 968/1930] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:42:54 2022] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:42:54.492920 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b1448-0ac7-4b52-8928-ac2e3fb6ce55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:54.493785 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b1448-0ac7-4b52-8928-ac2e3fb6ce55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.494066 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b1448-0ac7-4b52-8928-ac2e3fb6ce55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.494342 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b1448-0ac7-4b52-8928-ac2e3fb6ce55 admin admin] PATH_INFO: `/v3/projects/73712ae944754cc2a7a867a29fee40eb/users/6e534150770b4c06aa38e9a89128ec02/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.495325 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc1ae7-2703-4a8b-9d08-ffa19759bd58 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:54.504714 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc1ae7-2703-4a8b-9d08-ffa19759bd58 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:54.509998 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9fe7a-bc3e-48e3-acd5-4141f4d45d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:54.510316 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b1448-0ac7-4b52-8928-ac2e3fb6ce55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73712ae944754cc2a7a867a29fee40eb, user_id=6e534150770b4c06aa38e9a89128ec02, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:54.510942 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9fe7a-bc3e-48e3-acd5-4141f4d45d92 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.511152 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9fe7a-bc3e-48e3-acd5-4141f4d45d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.511427 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9fe7a-bc3e-48e3-acd5-4141f4d45d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.512209 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9fe7a-bc3e-48e3-acd5-4141f4d45d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:54.513106 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b1448-0ac7-4b52-8928-ac2e3fb6ce55 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:54.513821 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9fe7a-bc3e-48e3-acd5-4141f4d45d92 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:54.528218 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 969/1931] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:54.528459 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 963/1932] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:54 2022] PUT /identity/v3/projects/73712ae944754cc2a7a867a29fee40eb/users/6e534150770b4c06aa38e9a89128ec02/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:54.529793 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9fe7a-bc3e-48e3-acd5-4141f4d45d92 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:54.538572 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f2d92-ee41-4424-af94-17f8129ea19e None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.538876 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f2d92-ee41-4424-af94-17f8129ea19e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.539148 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f2d92-ee41-4424-af94-17f8129ea19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.540425 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9fe7a-bc3e-48e3-acd5-4141f4d45d92 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:54.568093 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-351f2d92-ee41-4424-af94-17f8129ea19e None None] MFA Rules not processed for user `6e534150770b4c06aa38e9a89128ec02`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:54.569934 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-351f2d92-ee41-4424-af94-17f8129ea19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:54.598401 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd6d48-7a9f-4ce2-9bdf-c4b8545df11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:54.599162 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd6d48-7a9f-4ce2-9bdf-c4b8545df11a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.599375 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd6d48-7a9f-4ce2-9bdf-c4b8545df11a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.599642 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd6d48-7a9f-4ce2-9bdf-c4b8545df11a admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.600410 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd6d48-7a9f-4ce2-9bdf-c4b8545df11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:54.602138 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd6d48-7a9f-4ce2-9bdf-c4b8545df11a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:54.615915 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 970/1933] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:42:54.617776 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd6d48-7a9f-4ce2-9bdf-c4b8545df11a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:54.627446 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd6d48-7a9f-4ce2-9bdf-c4b8545df11a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:54.633725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7cc44-bfc1-4733-82dc-2a1fe90eb88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:54.634833 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7cc44-bfc1-4733-82dc-2a1fe90eb88c admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.635156 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7cc44-bfc1-4733-82dc-2a1fe90eb88c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.635621 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7cc44-bfc1-4733-82dc-2a1fe90eb88c admin admin] PATH_INFO: `/v3/projects/c73f6abbaf2344cc9ad75da178017e47/users/162eed3978ba4e778305f72c857e8a3e/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.637010 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 964/1934] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:42:54.641782 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f2d92-ee41-4424-af94-17f8129ea19e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:54.651586 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7cc44-bfc1-4733-82dc-2a1fe90eb88c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c73f6abbaf2344cc9ad75da178017e47, user_id=162eed3978ba4e778305f72c857e8a3e, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:54.652119 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f2d92-ee41-4424-af94-17f8129ea19e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:54.654262 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7cc44-bfc1-4733-82dc-2a1fe90eb88c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:54.656874 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8f0ad-f533-4c84-bb88-c78db229978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:54.657521 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8f0ad-f533-4c84-bb88-c78db229978d admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.657821 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8f0ad-f533-4c84-bb88-c78db229978d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.658097 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8f0ad-f533-4c84-bb88-c78db229978d admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.659011 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8f0ad-f533-4c84-bb88-c78db229978d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:54.661392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8f0ad-f533-4c84-bb88-c78db229978d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:54.667507 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 971/1935] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:54 2022] PUT /identity/v3/projects/c73f6abbaf2344cc9ad75da178017e47/users/162eed3978ba4e778305f72c857e8a3e/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:54.679381 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34040161-b3f3-4ae3-ac47-404e248f954e None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.679637 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34040161-b3f3-4ae3-ac47-404e248f954e None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.679944 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34040161-b3f3-4ae3-ac47-404e248f954e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.687078 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 965/1936] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:42:54 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:42:54.690938 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8f0ad-f533-4c84-bb88-c78db229978d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:54.711861 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-34040161-b3f3-4ae3-ac47-404e248f954e None None] MFA Rules not processed for user `162eed3978ba4e778305f72c857e8a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:54.713012 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-34040161-b3f3-4ae3-ac47-404e248f954e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:54.760382 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8f0ad-f533-4c84-bb88-c78db229978d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:54.765413 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a8cdd-ee07-455e-a0ef-b257f9822496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:54.766128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a8cdd-ee07-455e-a0ef-b257f9822496 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.766412 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a8cdd-ee07-455e-a0ef-b257f9822496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.766688 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a8cdd-ee07-455e-a0ef-b257f9822496 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.767412 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a8cdd-ee07-455e-a0ef-b257f9822496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:54.769407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a8cdd-ee07-455e-a0ef-b257f9822496 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:54.791298 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 972/1937] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:42:54.794762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 966/1938] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:42:54 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:42:54.795991 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34040161-b3f3-4ae3-ac47-404e248f954e None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:54.805931 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a8cdd-ee07-455e-a0ef-b257f9822496 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:54.816145 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a8cdd-ee07-455e-a0ef-b257f9822496 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:54.816814 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34040161-b3f3-4ae3-ac47-404e248f954e None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:54.820887 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d5e8f-9c70-42b7-9ff9-f02feecfd54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:54.821413 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be54e08-b5d6-422c-95c5-3241de2c49d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:54.821819 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d5e8f-9c70-42b7-9ff9-f02feecfd54b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.821920 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d5e8f-9c70-42b7-9ff9-f02feecfd54b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.822060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be54e08-b5d6-422c-95c5-3241de2c49d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.822196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d5e8f-9c70-42b7-9ff9-f02feecfd54b admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.822347 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be54e08-b5d6-422c-95c5-3241de2c49d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.822603 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be54e08-b5d6-422c-95c5-3241de2c49d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.822901 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d5e8f-9c70-42b7-9ff9-f02feecfd54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:54.823342 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be54e08-b5d6-422c-95c5-3241de2c49d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:54.824525 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d5e8f-9c70-42b7-9ff9-f02feecfd54b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:54.825222 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be54e08-b5d6-422c-95c5-3241de2c49d5 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:54.834444 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 967/1939] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:54.838676 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d5e8f-9c70-42b7-9ff9-f02feecfd54b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:54.849082 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d5e8f-9c70-42b7-9ff9-f02feecfd54b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:54.851152 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 973/1940] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:42:54 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:42:54.854979 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be54e08-b5d6-422c-95c5-3241de2c49d5 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:54.911863 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6331ed5-8fd3-4087-b285-409bed00d60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:54.912778 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6331ed5-8fd3-4087-b285-409bed00d60e admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.913700 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6331ed5-8fd3-4087-b285-409bed00d60e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.913980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6331ed5-8fd3-4087-b285-409bed00d60e admin admin] PATH_INFO: `/v3/projects/e089f4306281438d94e1f35d89d45353/users/97c3908ab2e54e9c80288c45d4fa9fa4/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.917481 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be54e08-b5d6-422c-95c5-3241de2c49d5 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:54.922060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cefc9-cf76-4319-b95f-8a8f4b1dce96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:54.922729 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cefc9-cf76-4319-b95f-8a8f4b1dce96 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:54.923009 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cefc9-cf76-4319-b95f-8a8f4b1dce96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:54.923303 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cefc9-cf76-4319-b95f-8a8f4b1dce96 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:54.924067 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cefc9-cf76-4319-b95f-8a8f4b1dce96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:54.925959 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893cefc9-cf76-4319-b95f-8a8f4b1dce96 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:54.929119 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6331ed5-8fd3-4087-b285-409bed00d60e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e089f4306281438d94e1f35d89d45353, user_id=97c3908ab2e54e9c80288c45d4fa9fa4, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:54.931855 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6331ed5-8fd3-4087-b285-409bed00d60e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:54.946103 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 968/1941] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:54 2022] PUT /identity/v3/projects/e089f4306281438d94e1f35d89d45353/users/97c3908ab2e54e9c80288c45d4fa9fa4/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:54.949548 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 974/1942] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:42:54 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:42:54.950229 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6331ed5-8fd3-4087-b285-409bed00d60e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:54.950627 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cefc9-cf76-4319-b95f-8a8f4b1dce96 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:54.960157 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cefc9-cf76-4319-b95f-8a8f4b1dce96 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:55.010296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6331ed5-8fd3-4087-b285-409bed00d60e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:55.015085 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8797ac6-3132-43bc-905e-eefb689b2b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:55.015779 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8797ac6-3132-43bc-905e-eefb689b2b56 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:55.016068 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8797ac6-3132-43bc-905e-eefb689b2b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:55.016348 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8797ac6-3132-43bc-905e-eefb689b2b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:55.017086 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8797ac6-3132-43bc-905e-eefb689b2b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:55.018670 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8797ac6-3132-43bc-905e-eefb689b2b56 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:55.022970 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f24a9-b627-4c09-a465-02212d4b872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:55.023638 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f24a9-b627-4c09-a465-02212d4b872e admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:55.023949 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f24a9-b627-4c09-a465-02212d4b872e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:55.024227 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f24a9-b627-4c09-a465-02212d4b872e admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:55.024965 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f24a9-b627-4c09-a465-02212d4b872e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:55.026552 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f24a9-b627-4c09-a465-02212d4b872e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:55.030303 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 969/1943] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:55.034232 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8797ac6-3132-43bc-905e-eefb689b2b56 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:55.036929 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 975/1944] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:55.041557 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f24a9-b627-4c09-a465-02212d4b872e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:55.048095 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8797ac6-3132-43bc-905e-eefb689b2b56 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:55.051668 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f24a9-b627-4c09-a465-02212d4b872e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:55.056117 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcfcce-5059-4f13-8be4-21975e56822e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:55.057014 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcfcce-5059-4f13-8be4-21975e56822e admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:55.057300 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcfcce-5059-4f13-8be4-21975e56822e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:55.057525 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a377059-86b1-4f81-858e-ae4b838037b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:55.057650 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcfcce-5059-4f13-8be4-21975e56822e admin admin] PATH_INFO: `/v3/projects/e089f4306281438d94e1f35d89d45353/users/97c3908ab2e54e9c80288c45d4fa9fa4/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:55.058408 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a377059-86b1-4f81-858e-ae4b838037b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:55.058693 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a377059-86b1-4f81-858e-ae4b838037b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:55.058972 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a377059-86b1-4f81-858e-ae4b838037b9 admin admin] PATH_INFO: `/v3/projects/7cbe17fac043457980a25813f308ce31/users/a668afc9d44d405290da20fd45eb41d2/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:55.059631 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcfcce-5059-4f13-8be4-21975e56822e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e089f4306281438d94e1f35d89d45353, user_id=97c3908ab2e54e9c80288c45d4fa9fa4, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:55.062322 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcfcce-5059-4f13-8be4-21975e56822e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:55.074061 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a377059-86b1-4f81-858e-ae4b838037b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cbe17fac043457980a25813f308ce31, user_id=a668afc9d44d405290da20fd45eb41d2, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:55.075799 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 970/1945] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:55 2022] PUT /identity/v3/projects/e089f4306281438d94e1f35d89d45353/users/97c3908ab2e54e9c80288c45d4fa9fa4/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:55.076658 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a377059-86b1-4f81-858e-ae4b838037b9 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:55.084146 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c01f7-7ffc-4f09-8561-a8d81f3629d8 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:55.084670 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c01f7-7ffc-4f09-8561-a8d81f3629d8 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:55.085617 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c01f7-7ffc-4f09-8561-a8d81f3629d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:55.094420 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 976/1946] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:55 2022] PUT /identity/v3/projects/7cbe17fac043457980a25813f308ce31/users/a668afc9d44d405290da20fd45eb41d2/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:55.098611 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a377059-86b1-4f81-858e-ae4b838037b9 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:55.124130 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d94c01f7-7ffc-4f09-8561-a8d81f3629d8 None None] MFA Rules not processed for user `97c3908ab2e54e9c80288c45d4fa9fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:55.125371 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d94c01f7-7ffc-4f09-8561-a8d81f3629d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:55.183788 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a377059-86b1-4f81-858e-ae4b838037b9 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:55.189664 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac2aa2-9829-4495-ac04-04cf81dbcc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:55.190560 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac2aa2-9829-4495-ac04-04cf81dbcc99 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:55.190839 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac2aa2-9829-4495-ac04-04cf81dbcc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:55.191117 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac2aa2-9829-4495-ac04-04cf81dbcc99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:55.191937 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac2aa2-9829-4495-ac04-04cf81dbcc99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:55.193637 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac2aa2-9829-4495-ac04-04cf81dbcc99 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:55.207189 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 977/1947] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:42:55.209399 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 971/1948] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:42:55.211674 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac2aa2-9829-4495-ac04-04cf81dbcc99 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:55.222547 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac2aa2-9829-4495-ac04-04cf81dbcc99 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:55.226086 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c01f7-7ffc-4f09-8561-a8d81f3629d8 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:55.227587 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d94c01f7-7ffc-4f09-8561-a8d81f3629d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:55.236448 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2c239-a9ea-44f3-ae67-8dcfb8664d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:55.238137 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2c239-a9ea-44f3-ae67-8dcfb8664d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:55.238484 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2c239-a9ea-44f3-ae67-8dcfb8664d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:55.238968 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2c239-a9ea-44f3-ae67-8dcfb8664d4b admin admin] PATH_INFO: `/v3/projects/7cbe17fac043457980a25813f308ce31/users/a668afc9d44d405290da20fd45eb41d2/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:55.241878 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2c239-a9ea-44f3-ae67-8dcfb8664d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cbe17fac043457980a25813f308ce31, user_id=a668afc9d44d405290da20fd45eb41d2, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:55.245191 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2c239-a9ea-44f3-ae67-8dcfb8664d4b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:55.258546 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 978/1949] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:55 2022] PUT /identity/v3/projects/7cbe17fac043457980a25813f308ce31/users/a668afc9d44d405290da20fd45eb41d2/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:55.269868 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dd50b-fd38-4402-bae7-825fe770cf62 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:55.270241 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dd50b-fd38-4402-bae7-825fe770cf62 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:55.270368 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dd50b-fd38-4402-bae7-825fe770cf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:55.308018 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c01f7-7ffc-4f09-8561-a8d81f3629d8 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:55.317975 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-209dd50b-fd38-4402-bae7-825fe770cf62 None None] MFA Rules not processed for user `a668afc9d44d405290da20fd45eb41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:55.319393 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-209dd50b-fd38-4402-bae7-825fe770cf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:55.385244 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7f6b0-4e43-4ae6-b4af-7fbdbb109e96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:55.386048 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7f6b0-4e43-4ae6-b4af-7fbdbb109e96 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:55.386340 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7f6b0-4e43-4ae6-b4af-7fbdbb109e96 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:55.386620 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7f6b0-4e43-4ae6-b4af-7fbdbb109e96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:55.416268 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 979/1950] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:55.448400 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dd50b-fd38-4402-bae7-825fe770cf62 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:55.449808 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-209dd50b-fd38-4402-bae7-825fe770cf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:55.453270 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7f6b0-4e43-4ae6-b4af-7fbdbb109e96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:55.454707 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7f6b0-4e43-4ae6-b4af-7fbdbb109e96 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:55.461680 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dd50b-fd38-4402-bae7-825fe770cf62 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:55.465079 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 972/1951] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:42:55.465809 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7dd8e-cac1-4bba-bafa-473627adaeb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:55.466503 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7dd8e-cac1-4bba-bafa-473627adaeb5 service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:55.466780 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7dd8e-cac1-4bba-bafa-473627adaeb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:55.467053 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7dd8e-cac1-4bba-bafa-473627adaeb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:55.476470 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7dd8e-cac1-4bba-bafa-473627adaeb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:55.477914 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7dd8e-cac1-4bba-bafa-473627adaeb5 service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:55.487237 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 980/1952] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:42:55.787685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7f6b0-4e43-4ae6-b4af-7fbdbb109e96 service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:55.797494 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7f6b0-4e43-4ae6-b4af-7fbdbb109e96 service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:55.802024 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208e2eb-b9fa-4e01-90af-c3afd7086837 tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c3908ab2e54e9c80288c45d4fa9fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e089f4306281438d94e1f35d89d45353', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:55.802670 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208e2eb-b9fa-4e01-90af-c3afd7086837 tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:55.802979 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208e2eb-b9fa-4e01-90af-c3afd7086837 tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:55.803254 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208e2eb-b9fa-4e01-90af-c3afd7086837 tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:55.804834 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208e2eb-b9fa-4e01-90af-c3afd7086837 tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:42:55.805143 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208e2eb-b9fa-4e01-90af-c3afd7086837 tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:55.806720 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208e2eb-b9fa-4e01-90af-c3afd7086837 tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:55.820229 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 973/1953] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:42:55.824324 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7dd8e-cac1-4bba-bafa-473627adaeb5 service cinder] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:55.834889 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7dd8e-cac1-4bba-bafa-473627adaeb5 service cinder] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:55.840057 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7d045-f16c-4cd3-98e4-95ccc3f2d26e tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c3908ab2e54e9c80288c45d4fa9fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e089f4306281438d94e1f35d89d45353', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:55.840729 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7d045-f16c-4cd3-98e4-95ccc3f2d26e tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:55.841480 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7d045-f16c-4cd3-98e4-95ccc3f2d26e tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:55.841480 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7d045-f16c-4cd3-98e4-95ccc3f2d26e tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:55.841971 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7d045-f16c-4cd3-98e4-95ccc3f2d26e tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:55.843937 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7d045-f16c-4cd3-98e4-95ccc3f2d26e tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:55.875478 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 981/1954] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:42:55 2022] POST /identity/v3/projects => generated 355 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:42:55.879348 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208e2eb-b9fa-4e01-90af-c3afd7086837 tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:55.887452 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7d045-f16c-4cd3-98e4-95ccc3f2d26e tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:55.889527 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208e2eb-b9fa-4e01-90af-c3afd7086837 tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:55.949302 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d8350-835f-4931-805d-2bf45553f5d7 tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c3908ab2e54e9c80288c45d4fa9fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e089f4306281438d94e1f35d89d45353', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:55.949955 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d8350-835f-4931-805d-2bf45553f5d7 tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:55.950245 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d8350-835f-4931-805d-2bf45553f5d7 tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:55.950519 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d8350-835f-4931-805d-2bf45553f5d7 tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:55.951244 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d8350-835f-4931-805d-2bf45553f5d7 tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:42:55.951548 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d8350-835f-4931-805d-2bf45553f5d7 tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:55.953186 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d8350-835f-4931-805d-2bf45553f5d7 tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:55.953709 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7d045-f16c-4cd3-98e4-95ccc3f2d26e tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:55.958468 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac3a66-302e-4013-a392-83a4b89533d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:55.959378 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac3a66-302e-4013-a392-83a4b89533d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:55.960179 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac3a66-302e-4013-a392-83a4b89533d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:55.960545 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac3a66-302e-4013-a392-83a4b89533d3 admin admin] PATH_INFO: `/v3/users/162eed3978ba4e778305f72c857e8a3e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:55.961859 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac3a66-302e-4013-a392-83a4b89533d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=162eed3978ba4e778305f72c857e8a3e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:55.963854 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac3a66-302e-4013-a392-83a4b89533d3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:55.965002 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 974/1955] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:42:56.004702 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d8350-835f-4931-805d-2bf45553f5d7 tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:56.011169 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-24ac3a66-302e-4013-a392-83a4b89533d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '162eed3978ba4e778305f72c857e8a3e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.015552 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d8350-835f-4931-805d-2bf45553f5d7 tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:56.020646 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521701c9-7268-4de7-b118-7bff4f22311c tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97c3908ab2e54e9c80288c45d4fa9fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e089f4306281438d94e1f35d89d45353', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:56.021486 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521701c9-7268-4de7-b118-7bff4f22311c tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:56.021767 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521701c9-7268-4de7-b118-7bff4f22311c tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:56.022040 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521701c9-7268-4de7-b118-7bff4f22311c tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] PATH_INFO: `/v3/projects/161bdd7a198f4036b5e0f0f2c45de392` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:56.022722 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-24ac3a66-302e-4013-a392-83a4b89533d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '162eed3978ba4e778305f72c857e8a3e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.023581 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521701c9-7268-4de7-b118-7bff4f22311c tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] RBAC: Authorizing `identity:delete_project(project_id=161bdd7a198f4036b5e0f0f2c45de392)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:56.025567 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521701c9-7268-4de7-b118-7bff4f22311c tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:56.029359 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-24ac3a66-302e-4013-a392-83a4b89533d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '162eed3978ba4e778305f72c857e8a3e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.037933 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-24ac3a66-302e-4013-a392-83a4b89533d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '162eed3978ba4e778305f72c857e8a3e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.038507 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-24ac3a66-302e-4013-a392-83a4b89533d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '162eed3978ba4e778305f72c857e8a3e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.044835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 982/1956] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:42:55 2022] DELETE /identity/v3/users/162eed3978ba4e778305f72c857e8a3e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:56.049166 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731eec2-9860-4ea5-ae3b-357e61c899f1 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:56.049467 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731eec2-9860-4ea5-ae3b-357e61c899f1 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:56.049726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731eec2-9860-4ea5-ae3b-357e61c899f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:56.068544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-4731eec2-9860-4ea5-ae3b-357e61c899f1 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:56.069818 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-4731eec2-9860-4ea5-ae3b-357e61c899f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:56.075381 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-521701c9-7268-4de7-b118-7bff4f22311c tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '161bdd7a198f4036b5e0f0f2c45de392', 'request_id': 'req-521701c9-7268-4de7-b118-7bff4f22311c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.081775 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-521701c9-7268-4de7-b118-7bff4f22311c tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '161bdd7a198f4036b5e0f0f2c45de392', 'request_id': 'req-521701c9-7268-4de7-b118-7bff4f22311c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.087533 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-521701c9-7268-4de7-b118-7bff4f22311c tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '161bdd7a198f4036b5e0f0f2c45de392', 'request_id': 'req-521701c9-7268-4de7-b118-7bff4f22311c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.099230 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-521701c9-7268-4de7-b118-7bff4f22311c tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] The token cache is being invalidate because project 161bdd7a198f4036b5e0f0f2c45de392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:56.099516 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-521701c9-7268-4de7-b118-7bff4f22311c tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.100177 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-521701c9-7268-4de7-b118-7bff4f22311c tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.102065 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 975/1957] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:56 2022] DELETE /identity/v3/projects/161bdd7a198f4036b5e0f0f2c45de392 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:56.128313 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 983/1958] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:42:56.138812 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521701c9-7268-4de7-b118-7bff4f22311c tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:56.140312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-521701c9-7268-4de7-b118-7bff4f22311c tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:56.198398 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521701c9-7268-4de7-b118-7bff4f22311c tempest-VolumeQuotaClassesTest-1860466290 tempest-VolumeQuotaClassesTest-1860466290-project-admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:56.202018 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7dc72e-5909-43d0-816f-7d3021711c66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:56.202701 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dc72e-5909-43d0-816f-7d3021711c66 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:56.203008 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dc72e-5909-43d0-816f-7d3021711c66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:56.203296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dc72e-5909-43d0-816f-7d3021711c66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:56.213455 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7dc72e-5909-43d0-816f-7d3021711c66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:56.214926 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7dc72e-5909-43d0-816f-7d3021711c66 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:56.224765 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 976/1959] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:42:56.296185 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731eec2-9860-4ea5-ae3b-357e61c899f1 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:56.297682 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-4731eec2-9860-4ea5-ae3b-357e61c899f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:56.310070 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731eec2-9860-4ea5-ae3b-357e61c899f1 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:56.316251 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a3332-b8e5-4c81-95fc-f76a124e536a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:56.317141 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a3332-b8e5-4c81-95fc-f76a124e536a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:56.317384 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a3332-b8e5-4c81-95fc-f76a124e536a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:56.317770 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a3332-b8e5-4c81-95fc-f76a124e536a admin admin] PATH_INFO: `/v3/users/6e534150770b4c06aa38e9a89128ec02` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:56.319947 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a3332-b8e5-4c81-95fc-f76a124e536a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e534150770b4c06aa38e9a89128ec02)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:56.322508 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a3332-b8e5-4c81-95fc-f76a124e536a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:56.374019 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-356a3332-b8e5-4c81-95fc-f76a124e536a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e534150770b4c06aa38e9a89128ec02'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.394792 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-356a3332-b8e5-4c81-95fc-f76a124e536a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e534150770b4c06aa38e9a89128ec02'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.406132 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-356a3332-b8e5-4c81-95fc-f76a124e536a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e534150770b4c06aa38e9a89128ec02'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.414481 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-356a3332-b8e5-4c81-95fc-f76a124e536a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e534150770b4c06aa38e9a89128ec02'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.415214 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-356a3332-b8e5-4c81-95fc-f76a124e536a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e534150770b4c06aa38e9a89128ec02'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.421964 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 984/1960] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:42:56 2022] DELETE /identity/v3/users/6e534150770b4c06aa38e9a89128ec02 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:56.426538 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685314c1-ebdb-4556-bfc4-561c85de214b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:56.426832 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685314c1-ebdb-4556-bfc4-561c85de214b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:56.427113 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685314c1-ebdb-4556-bfc4-561c85de214b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:56.446856 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-685314c1-ebdb-4556-bfc4-561c85de214b None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:56.449249 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-685314c1-ebdb-4556-bfc4-561c85de214b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:56.527594 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 977/1961] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:56.537342 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a3332-b8e5-4c81-95fc-f76a124e536a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:56.539635 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-356a3332-b8e5-4c81-95fc-f76a124e536a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:56.560337 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685314c1-ebdb-4556-bfc4-561c85de214b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:56.562178 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-685314c1-ebdb-4556-bfc4-561c85de214b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:56.573792 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685314c1-ebdb-4556-bfc4-561c85de214b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:56.579642 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9e3bc-a790-444b-a7f3-02e431250f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:56.580712 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9e3bc-a790-444b-a7f3-02e431250f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:56.581019 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9e3bc-a790-444b-a7f3-02e431250f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:56.581345 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9e3bc-a790-444b-a7f3-02e431250f25 admin admin] PATH_INFO: `/v3/projects/c73f6abbaf2344cc9ad75da178017e47` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:56.582626 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9e3bc-a790-444b-a7f3-02e431250f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c73f6abbaf2344cc9ad75da178017e47)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:56.584872 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9e3bc-a790-444b-a7f3-02e431250f25 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:56.624184 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a3332-b8e5-4c81-95fc-f76a124e536a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:56.624184 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7c1c2-ff28-49a6-8ad8-dbfe1a99c349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:56.624184 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7c1c2-ff28-49a6-8ad8-dbfe1a99c349 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:56.624184 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7c1c2-ff28-49a6-8ad8-dbfe1a99c349 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:56.624671 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7c1c2-ff28-49a6-8ad8-dbfe1a99c349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:56.634357 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7c1c2-ff28-49a6-8ad8-dbfe1a99c349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:56.636911 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7c1c2-ff28-49a6-8ad8-dbfe1a99c349 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:56.638834 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d4c9e3bc-a790-444b-a7f3-02e431250f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c73f6abbaf2344cc9ad75da178017e47', 'request_id': 'req-d4c9e3bc-a790-444b-a7f3-02e431250f25'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.644928 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d4c9e3bc-a790-444b-a7f3-02e431250f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c73f6abbaf2344cc9ad75da178017e47', 'request_id': 'req-d4c9e3bc-a790-444b-a7f3-02e431250f25'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.647224 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 985/1962] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:42:56.651552 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d4c9e3bc-a790-444b-a7f3-02e431250f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c73f6abbaf2344cc9ad75da178017e47', 'request_id': 'req-d4c9e3bc-a790-444b-a7f3-02e431250f25'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.664338 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d4c9e3bc-a790-444b-a7f3-02e431250f25 admin admin] The token cache is being invalidate because project c73f6abbaf2344cc9ad75da178017e47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:56.664644 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d4c9e3bc-a790-444b-a7f3-02e431250f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.665267 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d4c9e3bc-a790-444b-a7f3-02e431250f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.667204 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 978/1963] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:56 2022] DELETE /identity/v3/projects/c73f6abbaf2344cc9ad75da178017e47 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:56.671267 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7c1c2-ff28-49a6-8ad8-dbfe1a99c349 service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:56.682436 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7c1c2-ff28-49a6-8ad8-dbfe1a99c349 service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:56.742662 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cbf35-cd32-463f-9aab-4cd563974de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:56.743516 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cbf35-cd32-463f-9aab-4cd563974de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:56.743877 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cbf35-cd32-463f-9aab-4cd563974de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:56.744286 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cbf35-cd32-463f-9aab-4cd563974de0 admin admin] PATH_INFO: `/v3/users/a668afc9d44d405290da20fd45eb41d2` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:56.745377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cbf35-cd32-463f-9aab-4cd563974de0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a668afc9d44d405290da20fd45eb41d2)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:56.747495 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cbf35-cd32-463f-9aab-4cd563974de0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:56.794967 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-437cbf35-cd32-463f-9aab-4cd563974de0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a668afc9d44d405290da20fd45eb41d2'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.808212 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-437cbf35-cd32-463f-9aab-4cd563974de0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a668afc9d44d405290da20fd45eb41d2'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.815463 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-437cbf35-cd32-463f-9aab-4cd563974de0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a668afc9d44d405290da20fd45eb41d2'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.823064 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-437cbf35-cd32-463f-9aab-4cd563974de0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a668afc9d44d405290da20fd45eb41d2'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.823897 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-437cbf35-cd32-463f-9aab-4cd563974de0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a668afc9d44d405290da20fd45eb41d2'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:56.830336 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 986/1964] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:42:56 2022] DELETE /identity/v3/users/a668afc9d44d405290da20fd45eb41d2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:56.922831 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9e3bc-a790-444b-a7f3-02e431250f25 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:56.924374 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d4c9e3bc-a790-444b-a7f3-02e431250f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:56.940853 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9e3bc-a790-444b-a7f3-02e431250f25 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:57.013264 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dee252-02a5-4770-af65-6a8dc65977c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:57.014178 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dee252-02a5-4770-af65-6a8dc65977c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:57.014502 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dee252-02a5-4770-af65-6a8dc65977c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:57.014780 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dee252-02a5-4770-af65-6a8dc65977c5 admin admin] PATH_INFO: `/v3/projects/73712ae944754cc2a7a867a29fee40eb` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:57.016105 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dee252-02a5-4770-af65-6a8dc65977c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73712ae944754cc2a7a867a29fee40eb)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:57.018081 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dee252-02a5-4770-af65-6a8dc65977c5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:57.063625 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d1dee252-02a5-4770-af65-6a8dc65977c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73712ae944754cc2a7a867a29fee40eb', 'request_id': 'req-d1dee252-02a5-4770-af65-6a8dc65977c5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:57.070634 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d1dee252-02a5-4770-af65-6a8dc65977c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73712ae944754cc2a7a867a29fee40eb', 'request_id': 'req-d1dee252-02a5-4770-af65-6a8dc65977c5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:57.075895 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d1dee252-02a5-4770-af65-6a8dc65977c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73712ae944754cc2a7a867a29fee40eb', 'request_id': 'req-d1dee252-02a5-4770-af65-6a8dc65977c5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:57.088394 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d1dee252-02a5-4770-af65-6a8dc65977c5 admin admin] The token cache is being invalidate because project 73712ae944754cc2a7a867a29fee40eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:57.088760 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d1dee252-02a5-4770-af65-6a8dc65977c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:57.089598 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d1dee252-02a5-4770-af65-6a8dc65977c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:57.091165 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 979/1965] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:56 2022] DELETE /identity/v3/projects/73712ae944754cc2a7a867a29fee40eb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:57.095705 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cbf35-cd32-463f-9aab-4cd563974de0 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:57.097156 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-437cbf35-cd32-463f-9aab-4cd563974de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:57.112291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cbf35-cd32-463f-9aab-4cd563974de0 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:57.122340 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dee252-02a5-4770-af65-6a8dc65977c5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:57.123988 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d1dee252-02a5-4770-af65-6a8dc65977c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:57.174552 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38de70-220c-47c8-89c7-c4b35308b4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:57.175674 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38de70-220c-47c8-89c7-c4b35308b4a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:57.175983 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38de70-220c-47c8-89c7-c4b35308b4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:57.176259 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38de70-220c-47c8-89c7-c4b35308b4a2 admin admin] PATH_INFO: `/v3/users/97c3908ab2e54e9c80288c45d4fa9fa4` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:57.177475 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38de70-220c-47c8-89c7-c4b35308b4a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c3908ab2e54e9c80288c45d4fa9fa4)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:57.180072 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38de70-220c-47c8-89c7-c4b35308b4a2 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:57.196354 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dee252-02a5-4770-af65-6a8dc65977c5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:57.201117 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b8d25-3c69-415a-b270-1c253968221f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:57.201967 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b8d25-3c69-415a-b270-1c253968221f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:57.202247 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b8d25-3c69-415a-b270-1c253968221f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:57.202516 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b8d25-3c69-415a-b270-1c253968221f admin admin] PATH_INFO: `/v3/projects/7cbe17fac043457980a25813f308ce31` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:57.203976 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b8d25-3c69-415a-b270-1c253968221f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cbe17fac043457980a25813f308ce31)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:57.206202 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b8d25-3c69-415a-b270-1c253968221f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:57.229714 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-2d38de70-220c-47c8-89c7-c4b35308b4a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c3908ab2e54e9c80288c45d4fa9fa4'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:57.242437 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-2d38de70-220c-47c8-89c7-c4b35308b4a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c3908ab2e54e9c80288c45d4fa9fa4'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:57.249164 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-2d38de70-220c-47c8-89c7-c4b35308b4a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c3908ab2e54e9c80288c45d4fa9fa4'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:57.254709 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-684b8d25-3c69-415a-b270-1c253968221f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cbe17fac043457980a25813f308ce31', 'request_id': 'req-684b8d25-3c69-415a-b270-1c253968221f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:57.257037 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-2d38de70-220c-47c8-89c7-c4b35308b4a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c3908ab2e54e9c80288c45d4fa9fa4'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:57.257779 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-2d38de70-220c-47c8-89c7-c4b35308b4a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c3908ab2e54e9c80288c45d4fa9fa4'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:57.266323 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-684b8d25-3c69-415a-b270-1c253968221f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cbe17fac043457980a25813f308ce31', 'request_id': 'req-684b8d25-3c69-415a-b270-1c253968221f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:57.267886 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 987/1966] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:42:57 2022] DELETE /identity/v3/users/97c3908ab2e54e9c80288c45d4fa9fa4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:57.268456 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-684b8d25-3c69-415a-b270-1c253968221f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cbe17fac043457980a25813f308ce31', 'request_id': 'req-684b8d25-3c69-415a-b270-1c253968221f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:57.282287 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-684b8d25-3c69-415a-b270-1c253968221f admin admin] The token cache is being invalidate because project 7cbe17fac043457980a25813f308ce31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:57.282577 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-684b8d25-3c69-415a-b270-1c253968221f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:57.283200 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-684b8d25-3c69-415a-b270-1c253968221f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:57.285048 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 980/1967] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:57 2022] DELETE /identity/v3/projects/7cbe17fac043457980a25813f308ce31 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:57.291937 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd882a4-e34e-4a68-9c9a-cf0290501896 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:57.292256 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd882a4-e34e-4a68-9c9a-cf0290501896 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:57.292538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd882a4-e34e-4a68-9c9a-cf0290501896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:57.311942 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-8cd882a4-e34e-4a68-9c9a-cf0290501896 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:57.313473 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-8cd882a4-e34e-4a68-9c9a-cf0290501896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:57.378670 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 988/1968] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:57.387557 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29c9c7-429d-4b54-b245-b68bb78d26fc None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:57.387870 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29c9c7-429d-4b54-b245-b68bb78d26fc None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:57.388149 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29c9c7-429d-4b54-b245-b68bb78d26fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:57.408278 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ab29c9c7-429d-4b54-b245-b68bb78d26fc None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:57.409504 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ab29c9c7-429d-4b54-b245-b68bb78d26fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:57.418964 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 981/1969] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:57.423129 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd882a4-e34e-4a68-9c9a-cf0290501896 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:57.434441 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd882a4-e34e-4a68-9c9a-cf0290501896 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:57.440530 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a9b22-206d-40cd-85ce-fdb2452e9142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:57.441348 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a9b22-206d-40cd-85ce-fdb2452e9142 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:57.441657 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a9b22-206d-40cd-85ce-fdb2452e9142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:57.442051 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a9b22-206d-40cd-85ce-fdb2452e9142 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:57.442941 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a9b22-206d-40cd-85ce-fdb2452e9142 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:42:57.443363 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a9b22-206d-40cd-85ce-fdb2452e9142 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:57.445319 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a9b22-206d-40cd-85ce-fdb2452e9142 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:57.457407 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 989/1970] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:42:57.462596 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29c9c7-429d-4b54-b245-b68bb78d26fc None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:57.472724 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29c9c7-429d-4b54-b245-b68bb78d26fc None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:57.478400 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b444f-e9a6-43ff-b458-bda5b2e42204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:57.479135 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b444f-e9a6-43ff-b458-bda5b2e42204 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:57.479482 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b444f-e9a6-43ff-b458-bda5b2e42204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:57.479859 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b444f-e9a6-43ff-b458-bda5b2e42204 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:57.480726 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b444f-e9a6-43ff-b458-bda5b2e42204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:57.482679 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b444f-e9a6-43ff-b458-bda5b2e42204 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:57.511832 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 982/1971] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:42:57 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:42:57.514131 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a9b22-206d-40cd-85ce-fdb2452e9142 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:57.524754 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a9b22-206d-40cd-85ce-fdb2452e9142 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:57.569449 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b444f-e9a6-43ff-b458-bda5b2e42204 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:57.571620 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0e2b444f-e9a6-43ff-b458-bda5b2e42204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:57.588293 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4143b-780b-4347-be55-45d32b528a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:57.588965 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4143b-780b-4347-be55-45d32b528a0b admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:57.589258 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4143b-780b-4347-be55-45d32b528a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:57.589519 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4143b-780b-4347-be55-45d32b528a0b admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:57.590229 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4143b-780b-4347-be55-45d32b528a0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:57.592173 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4143b-780b-4347-be55-45d32b528a0b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:57.614513 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 990/1972] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:42:57 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:42:57.618396 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4143b-780b-4347-be55-45d32b528a0b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:57.627678 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4143b-780b-4347-be55-45d32b528a0b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:57.633658 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0154907-aa15-48f6-b5cb-b9831cffdfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:57.634524 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0154907-aa15-48f6-b5cb-b9831cffdfeb admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:57.634806 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0154907-aa15-48f6-b5cb-b9831cffdfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:57.635085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0154907-aa15-48f6-b5cb-b9831cffdfeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:57.635893 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0154907-aa15-48f6-b5cb-b9831cffdfeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:57.637689 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0154907-aa15-48f6-b5cb-b9831cffdfeb admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:57.647979 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b444f-e9a6-43ff-b458-bda5b2e42204 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:57.649446 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 991/1973] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:42:57.653278 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0154907-aa15-48f6-b5cb-b9831cffdfeb admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:57.653467 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62f58b-e7c5-48f1-b41f-e82ad09b40c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:57.654606 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62f58b-e7c5-48f1-b41f-e82ad09b40c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:57.654960 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62f58b-e7c5-48f1-b41f-e82ad09b40c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:57.655312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62f58b-e7c5-48f1-b41f-e82ad09b40c8 admin admin] PATH_INFO: `/v3/projects/e089f4306281438d94e1f35d89d45353` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:57.656653 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62f58b-e7c5-48f1-b41f-e82ad09b40c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e089f4306281438d94e1f35d89d45353)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:57.658665 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62f58b-e7c5-48f1-b41f-e82ad09b40c8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:57.663591 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0154907-aa15-48f6-b5cb-b9831cffdfeb admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:57.669104 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca54d4d-d985-4fe0-a930-c6354a2fe53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:57.669763 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca54d4d-d985-4fe0-a930-c6354a2fe53d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:57.670044 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca54d4d-d985-4fe0-a930-c6354a2fe53d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:57.670322 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca54d4d-d985-4fe0-a930-c6354a2fe53d admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:57.671056 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca54d4d-d985-4fe0-a930-c6354a2fe53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:57.672672 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca54d4d-d985-4fe0-a930-c6354a2fe53d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:57.684389 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 992/1974] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:42:57.688334 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca54d4d-d985-4fe0-a930-c6354a2fe53d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:57.698575 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca54d4d-d985-4fe0-a930-c6354a2fe53d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:57.713270 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ac62f58b-e7c5-48f1-b41f-e82ad09b40c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e089f4306281438d94e1f35d89d45353', 'request_id': 'req-ac62f58b-e7c5-48f1-b41f-e82ad09b40c8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:57.719593 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ac62f58b-e7c5-48f1-b41f-e82ad09b40c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e089f4306281438d94e1f35d89d45353', 'request_id': 'req-ac62f58b-e7c5-48f1-b41f-e82ad09b40c8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:57.726273 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ac62f58b-e7c5-48f1-b41f-e82ad09b40c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e089f4306281438d94e1f35d89d45353', 'request_id': 'req-ac62f58b-e7c5-48f1-b41f-e82ad09b40c8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:57.738540 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ac62f58b-e7c5-48f1-b41f-e82ad09b40c8 admin admin] The token cache is being invalidate because project e089f4306281438d94e1f35d89d45353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:57.738839 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ac62f58b-e7c5-48f1-b41f-e82ad09b40c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:57.739499 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ac62f58b-e7c5-48f1-b41f-e82ad09b40c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:57.741383 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 983/1975] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:57 2022] DELETE /identity/v3/projects/e089f4306281438d94e1f35d89d45353 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:57.746544 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d4638-d8a3-46fc-aa75-ac0b9a2178f1 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:57.746834 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d4638-d8a3-46fc-aa75-ac0b9a2178f1 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:57.747110 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d4638-d8a3-46fc-aa75-ac0b9a2178f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:57.756765 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34b48d-c5b2-4276-acb2-2d0c8c53e6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:57.757890 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34b48d-c5b2-4276-acb2-2d0c8c53e6b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:57.758179 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34b48d-c5b2-4276-acb2-2d0c8c53e6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:57.758926 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34b48d-c5b2-4276-acb2-2d0c8c53e6b2 admin admin] PATH_INFO: `/v3/projects/1ca9a274a0234d7ab73443f0a6e7ffa3/users/5ba02f43847a43428e4347e30a6740af/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:57.765676 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d74d4638-d8a3-46fc-aa75-ac0b9a2178f1 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:57.766904 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d74d4638-d8a3-46fc-aa75-ac0b9a2178f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:57.773613 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34b48d-c5b2-4276-acb2-2d0c8c53e6b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ca9a274a0234d7ab73443f0a6e7ffa3, user_id=5ba02f43847a43428e4347e30a6740af, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:57.775718 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 984/1976] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:42:57.776297 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34b48d-c5b2-4276-acb2-2d0c8c53e6b2 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:57.783521 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f67fb8-18d8-417d-b074-10a9d48c1aab None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:57.783837 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f67fb8-18d8-417d-b074-10a9d48c1aab None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:57.784113 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f67fb8-18d8-417d-b074-10a9d48c1aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:57.791208 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 993/1977] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:57 2022] PUT /identity/v3/projects/1ca9a274a0234d7ab73443f0a6e7ffa3/users/5ba02f43847a43428e4347e30a6740af/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:57.802061 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301c09a-293d-4eaa-8575-974a14aacc5e None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:57.802471 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301c09a-293d-4eaa-8575-974a14aacc5e None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:57.802607 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301c09a-293d-4eaa-8575-974a14aacc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:57.808027 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-b6f67fb8-18d8-417d-b074-10a9d48c1aab None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:57.808027 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b6f67fb8-18d8-417d-b074-10a9d48c1aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:57.829357 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-1301c09a-293d-4eaa-8575-974a14aacc5e None None] MFA Rules not processed for user `5ba02f43847a43428e4347e30a6740af`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:57.830480 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-1301c09a-293d-4eaa-8575-974a14aacc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:57.872031 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 985/1978] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:42:57.876131 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f67fb8-18d8-417d-b074-10a9d48c1aab None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:57.885579 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f67fb8-18d8-417d-b074-10a9d48c1aab None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:57.890189 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d390145-029f-4d0b-93aa-5985e8fd52c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:57.890827 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d390145-029f-4d0b-93aa-5985e8fd52c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:57.891107 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d390145-029f-4d0b-93aa-5985e8fd52c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:57.891377 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d390145-029f-4d0b-93aa-5985e8fd52c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:57.892178 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d390145-029f-4d0b-93aa-5985e8fd52c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:42:57.892484 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d390145-029f-4d0b-93aa-5985e8fd52c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:57.894097 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d390145-029f-4d0b-93aa-5985e8fd52c2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:57.894440 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 994/1979] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:42:57.905643 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301c09a-293d-4eaa-8575-974a14aacc5e None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:57.907012 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-1301c09a-293d-4eaa-8575-974a14aacc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:57.907633 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 986/1980] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:42:57.911626 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d390145-029f-4d0b-93aa-5985e8fd52c2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:57.921839 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d390145-029f-4d0b-93aa-5985e8fd52c2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:57.926515 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be96fa7-4c90-4588-95e2-170faea580af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:57.928560 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be96fa7-4c90-4588-95e2-170faea580af admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:57.928893 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be96fa7-4c90-4588-95e2-170faea580af admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:57.929258 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be96fa7-4c90-4588-95e2-170faea580af admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:57.930055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be96fa7-4c90-4588-95e2-170faea580af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:57.932266 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be96fa7-4c90-4588-95e2-170faea580af admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:57.965360 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 987/1981] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:42:57 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:42:57.966463 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be96fa7-4c90-4588-95e2-170faea580af admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:57.969432 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301c09a-293d-4eaa-8575-974a14aacc5e None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:58.024837 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7adb61-3389-441a-8d36-f695fa0112d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:58.025495 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7adb61-3389-441a-8d36-f695fa0112d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:58.025779 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7adb61-3389-441a-8d36-f695fa0112d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:58.026056 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7adb61-3389-441a-8d36-f695fa0112d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:58.042325 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be96fa7-4c90-4588-95e2-170faea580af admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:58.047223 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa4fb7-a92c-4cd2-8424-eade86754be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:58.048025 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa4fb7-a92c-4cd2-8424-eade86754be7 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:58.048307 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa4fb7-a92c-4cd2-8424-eade86754be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:58.048613 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa4fb7-a92c-4cd2-8424-eade86754be7 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:58.049314 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa4fb7-a92c-4cd2-8424-eade86754be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:58.051247 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa4fb7-a92c-4cd2-8424-eade86754be7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:58.074809 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 988/1982] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:42:57 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:42:58.076249 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa4fb7-a92c-4cd2-8424-eade86754be7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:58.083100 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7adb61-3389-441a-8d36-f695fa0112d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:58.084503 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7adb61-3389-441a-8d36-f695fa0112d8 service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:58.086316 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa4fb7-a92c-4cd2-8424-eade86754be7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:58.091093 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e03520-2550-4310-877e-5c01934471c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:58.091789 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e03520-2550-4310-877e-5c01934471c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:58.092073 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e03520-2550-4310-877e-5c01934471c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:58.092347 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e03520-2550-4310-877e-5c01934471c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:58.093075 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e03520-2550-4310-877e-5c01934471c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:58.094558 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 995/1983] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:42:58.094674 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e03520-2550-4310-877e-5c01934471c4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:58.104946 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 989/1984] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:42:58.108875 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7adb61-3389-441a-8d36-f695fa0112d8 service cinder] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:58.119485 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7adb61-3389-441a-8d36-f695fa0112d8 service cinder] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:58.124179 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea1465-810a-4a14-947f-20a77fa603dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:58.124827 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea1465-810a-4a14-947f-20a77fa603dd admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:58.125110 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea1465-810a-4a14-947f-20a77fa603dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:58.125385 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea1465-810a-4a14-947f-20a77fa603dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:58.126118 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea1465-810a-4a14-947f-20a77fa603dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:58.127716 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea1465-810a-4a14-947f-20a77fa603dd admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:58.138253 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 996/1985] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:58.143425 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e03520-2550-4310-877e-5c01934471c4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:58.154303 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e03520-2550-4310-877e-5c01934471c4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:58.158906 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4de1f-8424-40e7-a91a-2cddea1271fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:58.159782 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4de1f-8424-40e7-a91a-2cddea1271fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:58.160089 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4de1f-8424-40e7-a91a-2cddea1271fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:58.160369 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4de1f-8424-40e7-a91a-2cddea1271fe admin admin] PATH_INFO: `/v3/projects/72dfd4a7ff0148f0938a82586e6c4242/users/fd50e1526f0140019fd055f9134c8441/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:58.174678 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4de1f-8424-40e7-a91a-2cddea1271fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=72dfd4a7ff0148f0938a82586e6c4242, user_id=fd50e1526f0140019fd055f9134c8441, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:58.177408 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4de1f-8424-40e7-a91a-2cddea1271fe admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:58.191625 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 990/1986] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:58 2022] PUT /identity/v3/projects/72dfd4a7ff0148f0938a82586e6c4242/users/fd50e1526f0140019fd055f9134c8441/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:42:58.203781 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d79a2-a1cc-4935-897b-bedd60520747 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:58.204065 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d79a2-a1cc-4935-897b-bedd60520747 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:58.204346 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d79a2-a1cc-4935-897b-bedd60520747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:58.232658 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-ce2d79a2-a1cc-4935-897b-bedd60520747 None None] MFA Rules not processed for user `fd50e1526f0140019fd055f9134c8441`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:58.233853 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-ce2d79a2-a1cc-4935-897b-bedd60520747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:58.301931 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 997/1987] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:58.319935 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4de1f-8424-40e7-a91a-2cddea1271fe admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:58.321749 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0eb4de1f-8424-40e7-a91a-2cddea1271fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:58.386821 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4de1f-8424-40e7-a91a-2cddea1271fe admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:58.390647 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86361821-8cb1-4754-9f4d-ce960f227116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:58.391359 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86361821-8cb1-4754-9f4d-ce960f227116 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:58.391710 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86361821-8cb1-4754-9f4d-ce960f227116 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:58.392710 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86361821-8cb1-4754-9f4d-ce960f227116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:58.402607 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86361821-8cb1-4754-9f4d-ce960f227116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:58.404273 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86361821-8cb1-4754-9f4d-ce960f227116 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:58.417709 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 991/1988] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:42:58.437685 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d79a2-a1cc-4935-897b-bedd60520747 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:58.499977 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d79a2-a1cc-4935-897b-bedd60520747 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:58.504568 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9c6b7-c8a2-416d-bc3b-cb42de8b8710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:58.505416 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9c6b7-c8a2-416d-bc3b-cb42de8b8710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:58.505951 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9c6b7-c8a2-416d-bc3b-cb42de8b8710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:58.506230 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9c6b7-c8a2-416d-bc3b-cb42de8b8710 admin admin] PATH_INFO: `/v3/users/fd50e1526f0140019fd055f9134c8441` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:58.508112 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9c6b7-c8a2-416d-bc3b-cb42de8b8710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd50e1526f0140019fd055f9134c8441)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:58.510042 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9c6b7-c8a2-416d-bc3b-cb42de8b8710 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:58.554758 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-77c9c6b7-c8a2-416d-bc3b-cb42de8b8710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd50e1526f0140019fd055f9134c8441'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:58.565892 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-77c9c6b7-c8a2-416d-bc3b-cb42de8b8710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd50e1526f0140019fd055f9134c8441'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:58.573487 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-77c9c6b7-c8a2-416d-bc3b-cb42de8b8710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd50e1526f0140019fd055f9134c8441'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:58.580912 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-77c9c6b7-c8a2-416d-bc3b-cb42de8b8710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd50e1526f0140019fd055f9134c8441'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:58.581833 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-77c9c6b7-c8a2-416d-bc3b-cb42de8b8710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd50e1526f0140019fd055f9134c8441'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:58.587683 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 998/1989] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:42:58 2022] DELETE /identity/v3/users/fd50e1526f0140019fd055f9134c8441 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:58.592230 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ebf4d-7f24-4ab8-91c3-f678df111b2d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:58.592518 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ebf4d-7f24-4ab8-91c3-f678df111b2d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:58.592829 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ebf4d-7f24-4ab8-91c3-f678df111b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:58.610939 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-048ebf4d-7f24-4ab8-91c3-f678df111b2d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:58.612299 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-048ebf4d-7f24-4ab8-91c3-f678df111b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:58.669934 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 992/1990] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:58.680321 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9c6b7-c8a2-416d-bc3b-cb42de8b8710 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:58.681728 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-77c9c6b7-c8a2-416d-bc3b-cb42de8b8710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:58.737432 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9c6b7-c8a2-416d-bc3b-cb42de8b8710 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:58.741758 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a51bd-5b31-4ca5-a23c-5623ec697370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:58.742400 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a51bd-5b31-4ca5-a23c-5623ec697370 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:58.742683 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a51bd-5b31-4ca5-a23c-5623ec697370 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:58.742957 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a51bd-5b31-4ca5-a23c-5623ec697370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:58.751883 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a51bd-5b31-4ca5-a23c-5623ec697370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:58.753304 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a51bd-5b31-4ca5-a23c-5623ec697370 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:58.762970 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 999/1991] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:42:59.058463 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ebf4d-7f24-4ab8-91c3-f678df111b2d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:59.059984 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-048ebf4d-7f24-4ab8-91c3-f678df111b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:59.073128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ebf4d-7f24-4ab8-91c3-f678df111b2d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:59.077724 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f3f14-dac3-4753-ba47-b0203832511c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:59.078602 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f3f14-dac3-4753-ba47-b0203832511c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:59.078880 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f3f14-dac3-4753-ba47-b0203832511c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:59.079196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f3f14-dac3-4753-ba47-b0203832511c admin admin] PATH_INFO: `/v3/projects/72dfd4a7ff0148f0938a82586e6c4242` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:59.080437 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f3f14-dac3-4753-ba47-b0203832511c admin admin] RBAC: Authorizing `identity:delete_project(project_id=72dfd4a7ff0148f0938a82586e6c4242)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:59.082377 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f3f14-dac3-4753-ba47-b0203832511c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:59.129246 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-276f3f14-dac3-4753-ba47-b0203832511c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72dfd4a7ff0148f0938a82586e6c4242', 'request_id': 'req-276f3f14-dac3-4753-ba47-b0203832511c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:59.137049 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-276f3f14-dac3-4753-ba47-b0203832511c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72dfd4a7ff0148f0938a82586e6c4242', 'request_id': 'req-276f3f14-dac3-4753-ba47-b0203832511c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:59.143855 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-276f3f14-dac3-4753-ba47-b0203832511c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72dfd4a7ff0148f0938a82586e6c4242', 'request_id': 'req-276f3f14-dac3-4753-ba47-b0203832511c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:59.158552 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-276f3f14-dac3-4753-ba47-b0203832511c admin admin] The token cache is being invalidate because project 72dfd4a7ff0148f0938a82586e6c4242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:42:59.158841 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-276f3f14-dac3-4753-ba47-b0203832511c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:59.159458 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-276f3f14-dac3-4753-ba47-b0203832511c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:42:59.161044 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 993/1992] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:42:59 2022] DELETE /identity/v3/projects/72dfd4a7ff0148f0938a82586e6c4242 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:59.167234 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f15be-1b7f-4883-b622-810ef5ae9483 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:59.167772 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f15be-1b7f-4883-b622-810ef5ae9483 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:59.167772 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f15be-1b7f-4883-b622-810ef5ae9483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:59.185435 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-491f15be-1b7f-4883-b622-810ef5ae9483 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:59.186614 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-491f15be-1b7f-4883-b622-810ef5ae9483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:59.244645 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1000/1993] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:59.252336 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54af1b-d321-4189-849a-be39a0a5c814 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:59.252624 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54af1b-d321-4189-849a-be39a0a5c814 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:59.252900 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54af1b-d321-4189-849a-be39a0a5c814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:59.271442 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-5f54af1b-d321-4189-849a-be39a0a5c814 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:59.272661 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5f54af1b-d321-4189-849a-be39a0a5c814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:59.280387 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 994/1994] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:59.284534 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f15be-1b7f-4883-b622-810ef5ae9483 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:59.294660 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f15be-1b7f-4883-b622-810ef5ae9483 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:59.299257 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0ed6a-b89f-4109-9318-88c547e5a708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:59.299939 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0ed6a-b89f-4109-9318-88c547e5a708 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:59.300225 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0ed6a-b89f-4109-9318-88c547e5a708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:59.300504 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0ed6a-b89f-4109-9318-88c547e5a708 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:59.301233 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0ed6a-b89f-4109-9318-88c547e5a708 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:42:59.301551 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0ed6a-b89f-4109-9318-88c547e5a708 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:59.303151 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0ed6a-b89f-4109-9318-88c547e5a708 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:59.314959 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1001/1995] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:42:59.318943 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54af1b-d321-4189-849a-be39a0a5c814 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:59.328566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54af1b-d321-4189-849a-be39a0a5c814 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:59.333528 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f058e8-56ea-4d2b-bcb0-3da53e69cd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:59.334167 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f058e8-56ea-4d2b-bcb0-3da53e69cd2a admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:59.334452 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f058e8-56ea-4d2b-bcb0-3da53e69cd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:59.334722 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f058e8-56ea-4d2b-bcb0-3da53e69cd2a admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:59.335429 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f058e8-56ea-4d2b-bcb0-3da53e69cd2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:59.338204 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f058e8-56ea-4d2b-bcb0-3da53e69cd2a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:59.367306 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 995/1996] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:42:59 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:42:59.371391 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0ed6a-b89f-4109-9318-88c547e5a708 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:59.381611 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0ed6a-b89f-4109-9318-88c547e5a708 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:59.440034 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85897cc-d459-4442-a609-d60d2ebf5f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:59.440702 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85897cc-d459-4442-a609-d60d2ebf5f35 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:59.440977 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85897cc-d459-4442-a609-d60d2ebf5f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:59.441248 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85897cc-d459-4442-a609-d60d2ebf5f35 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:59.441958 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85897cc-d459-4442-a609-d60d2ebf5f35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:59.443875 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85897cc-d459-4442-a609-d60d2ebf5f35 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:59.464380 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1002/1997] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:42:59 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:42:59.468422 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f058e8-56ea-4d2b-bcb0-3da53e69cd2a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:59.478819 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f058e8-56ea-4d2b-bcb0-3da53e69cd2a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:59.483559 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49401ddf-6221-4bdb-be57-64f421a8895a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:59.484251 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49401ddf-6221-4bdb-be57-64f421a8895a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:59.484539 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49401ddf-6221-4bdb-be57-64f421a8895a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:59.484813 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49401ddf-6221-4bdb-be57-64f421a8895a admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:59.485550 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49401ddf-6221-4bdb-be57-64f421a8895a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:59.487139 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49401ddf-6221-4bdb-be57-64f421a8895a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:59.497496 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 996/1998] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:59.501214 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85897cc-d459-4442-a609-d60d2ebf5f35 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:59.512064 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85897cc-d459-4442-a609-d60d2ebf5f35 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:59.516637 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de5004-452f-41df-83b0-3c33381e80c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:59.517278 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de5004-452f-41df-83b0-3c33381e80c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:59.517554 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de5004-452f-41df-83b0-3c33381e80c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:59.517830 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de5004-452f-41df-83b0-3c33381e80c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:59.518555 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de5004-452f-41df-83b0-3c33381e80c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:59.520154 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de5004-452f-41df-83b0-3c33381e80c4 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:59.530340 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1003/1999] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:42:59.534267 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49401ddf-6221-4bdb-be57-64f421a8895a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:59.544276 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49401ddf-6221-4bdb-be57-64f421a8895a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:59.548918 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd21e00-54e1-49df-b113-69bbeff7eb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:59.549771 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd21e00-54e1-49df-b113-69bbeff7eb96 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:59.550050 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd21e00-54e1-49df-b113-69bbeff7eb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:59.550320 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd21e00-54e1-49df-b113-69bbeff7eb96 admin admin] PATH_INFO: `/v3/projects/b859a738020949f9b8a32e68b517988d/users/86b550ccc85f470294e9df790c2cf7b6/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:59.565387 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd21e00-54e1-49df-b113-69bbeff7eb96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b859a738020949f9b8a32e68b517988d, user_id=86b550ccc85f470294e9df790c2cf7b6, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:59.568042 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd21e00-54e1-49df-b113-69bbeff7eb96 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:59.580982 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 997/2000] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:42:59 2022] PUT /identity/v3/projects/b859a738020949f9b8a32e68b517988d/users/86b550ccc85f470294e9df790c2cf7b6/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:42:59.592013 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4eb80-4b11-47a9-b735-984ba7bfdc5a None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:59.592306 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4eb80-4b11-47a9-b735-984ba7bfdc5a None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:59.592586 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4eb80-4b11-47a9-b735-984ba7bfdc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:59.618597 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-ffd4eb80-4b11-47a9-b735-984ba7bfdc5a None None] MFA Rules not processed for user `86b550ccc85f470294e9df790c2cf7b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:42:59.619847 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-ffd4eb80-4b11-47a9-b735-984ba7bfdc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:59.687027 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1004/2001] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:42:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:42:59.698742 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd21e00-54e1-49df-b113-69bbeff7eb96 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:42:59.700434 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cbd21e00-54e1-49df-b113-69bbeff7eb96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:42:59.753605 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd21e00-54e1-49df-b113-69bbeff7eb96 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:42:59.758254 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7d9a9-788c-49a5-aeed-54f60d06bacd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10453496872a45a9867fc6a13a13de49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:42:59.758890 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7d9a9-788c-49a5-aeed-54f60d06bacd service glance] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:42:59.759168 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7d9a9-788c-49a5-aeed-54f60d06bacd service glance] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:42:59.759441 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7d9a9-788c-49a5-aeed-54f60d06bacd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:42:59.767498 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7d9a9-788c-49a5-aeed-54f60d06bacd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:42:59.768945 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7d9a9-788c-49a5-aeed-54f60d06bacd service glance] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:42:59.777682 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 998/2002] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:42:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:43:04.237467 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4eb80-4b11-47a9-b735-984ba7bfdc5a None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:04.238934 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-ffd4eb80-4b11-47a9-b735-984ba7bfdc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:04.307129 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4eb80-4b11-47a9-b735-984ba7bfdc5a None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:04.315341 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5b9ff-2fba-43d9-817a-e9a3baaba72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:04.316248 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5b9ff-2fba-43d9-817a-e9a3baaba72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:04.316536 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5b9ff-2fba-43d9-817a-e9a3baaba72b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:04.316812 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5b9ff-2fba-43d9-817a-e9a3baaba72b admin admin] PATH_INFO: `/v3/users/5ba02f43847a43428e4347e30a6740af` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:04.318137 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5b9ff-2fba-43d9-817a-e9a3baaba72b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba02f43847a43428e4347e30a6740af)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:04.320129 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5b9ff-2fba-43d9-817a-e9a3baaba72b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:04.369501 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-aab5b9ff-2fba-43d9-817a-e9a3baaba72b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba02f43847a43428e4347e30a6740af'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:04.382800 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-aab5b9ff-2fba-43d9-817a-e9a3baaba72b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba02f43847a43428e4347e30a6740af'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:04.390431 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-aab5b9ff-2fba-43d9-817a-e9a3baaba72b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba02f43847a43428e4347e30a6740af'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:04.399880 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-aab5b9ff-2fba-43d9-817a-e9a3baaba72b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba02f43847a43428e4347e30a6740af'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:04.400536 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-aab5b9ff-2fba-43d9-817a-e9a3baaba72b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba02f43847a43428e4347e30a6740af'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:04.416807 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1005/2003] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:43:04 2022] DELETE /identity/v3/users/5ba02f43847a43428e4347e30a6740af => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:04.421668 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a49f68-fb33-471a-a0dc-b120cfd3c741 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:04.422125 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a49f68-fb33-471a-a0dc-b120cfd3c741 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:04.422231 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a49f68-fb33-471a-a0dc-b120cfd3c741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:04.439244 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-a7a49f68-fb33-471a-a0dc-b120cfd3c741 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:04.440466 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a7a49f68-fb33-471a-a0dc-b120cfd3c741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:04.497706 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5b9ff-2fba-43d9-817a-e9a3baaba72b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:04.498621 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 999/2004] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:04.499081 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-aab5b9ff-2fba-43d9-817a-e9a3baaba72b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:04.509155 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a49f68-fb33-471a-a0dc-b120cfd3c741 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:04.510551 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a7a49f68-fb33-471a-a0dc-b120cfd3c741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:04.514641 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5b9ff-2fba-43d9-817a-e9a3baaba72b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:04.519591 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf4b73-30f4-433b-8f38-e39c41485220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:04.520510 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf4b73-30f4-433b-8f38-e39c41485220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:04.520826 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf4b73-30f4-433b-8f38-e39c41485220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:04.521156 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf4b73-30f4-433b-8f38-e39c41485220 admin admin] PATH_INFO: `/v3/users/32e8605de1074074a00142f348f38814` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:04.522479 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf4b73-30f4-433b-8f38-e39c41485220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32e8605de1074074a00142f348f38814)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:04.524987 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf4b73-30f4-433b-8f38-e39c41485220 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:04.567152 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a49f68-fb33-471a-a0dc-b120cfd3c741 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:04.571447 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1a1b9-a327-4761-ba19-99df17f5d450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:04.572212 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1a1b9-a327-4761-ba19-99df17f5d450 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:04.572496 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1a1b9-a327-4761-ba19-99df17f5d450 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:04.572773 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1a1b9-a327-4761-ba19-99df17f5d450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:04.572943 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-3daf4b73-30f4-433b-8f38-e39c41485220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32e8605de1074074a00142f348f38814'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:04.581752 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b1a1b9-a327-4761-ba19-99df17f5d450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:04.583191 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b1a1b9-a327-4761-ba19-99df17f5d450 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:04.584419 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-3daf4b73-30f4-433b-8f38-e39c41485220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32e8605de1074074a00142f348f38814'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:04.591569 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-3daf4b73-30f4-433b-8f38-e39c41485220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32e8605de1074074a00142f348f38814'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:04.592764 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1000/2005] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:43:04.598981 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-3daf4b73-30f4-433b-8f38-e39c41485220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32e8605de1074074a00142f348f38814'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:04.599569 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-3daf4b73-30f4-433b-8f38-e39c41485220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32e8605de1074074a00142f348f38814'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:04.608194 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1006/2006] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:43:04 2022] DELETE /identity/v3/users/32e8605de1074074a00142f348f38814 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:43:04.613092 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287c24f-ceef-49de-8b74-81ca340ad7e5 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:04.613552 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287c24f-ceef-49de-8b74-81ca340ad7e5 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:04.613833 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287c24f-ceef-49de-8b74-81ca340ad7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:04.632938 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-b287c24f-ceef-49de-8b74-81ca340ad7e5 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:04.634161 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b287c24f-ceef-49de-8b74-81ca340ad7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:04.701520 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1001/2007] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:43:04.711185 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf4b73-30f4-433b-8f38-e39c41485220 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:04.713121 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-3daf4b73-30f4-433b-8f38-e39c41485220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:04.792432 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf4b73-30f4-433b-8f38-e39c41485220 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:04.800007 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807bab5-fc3e-4ae8-8fd7-62a080a09fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:04.800674 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807bab5-fc3e-4ae8-8fd7-62a080a09fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:04.800958 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807bab5-fc3e-4ae8-8fd7-62a080a09fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:04.801235 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807bab5-fc3e-4ae8-8fd7-62a080a09fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:04.812087 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807bab5-fc3e-4ae8-8fd7-62a080a09fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:04.813648 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807bab5-fc3e-4ae8-8fd7-62a080a09fb4 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:04.824330 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1007/2008] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:43:05.061449 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287c24f-ceef-49de-8b74-81ca340ad7e5 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:05.062957 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b287c24f-ceef-49de-8b74-81ca340ad7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:05.075624 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287c24f-ceef-49de-8b74-81ca340ad7e5 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:05.080289 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81157043-816f-4aa0-b4f6-e266e7d7b75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:05.081166 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81157043-816f-4aa0-b4f6-e266e7d7b75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:05.081559 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81157043-816f-4aa0-b4f6-e266e7d7b75d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:05.081871 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81157043-816f-4aa0-b4f6-e266e7d7b75d admin admin] PATH_INFO: `/v3/projects/1ca9a274a0234d7ab73443f0a6e7ffa3` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:05.083072 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81157043-816f-4aa0-b4f6-e266e7d7b75d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ca9a274a0234d7ab73443f0a6e7ffa3)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:05.084997 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81157043-816f-4aa0-b4f6-e266e7d7b75d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:05.140203 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-81157043-816f-4aa0-b4f6-e266e7d7b75d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ca9a274a0234d7ab73443f0a6e7ffa3', 'request_id': 'req-81157043-816f-4aa0-b4f6-e266e7d7b75d'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:05.146503 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-81157043-816f-4aa0-b4f6-e266e7d7b75d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ca9a274a0234d7ab73443f0a6e7ffa3', 'request_id': 'req-81157043-816f-4aa0-b4f6-e266e7d7b75d'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:05.152021 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-81157043-816f-4aa0-b4f6-e266e7d7b75d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ca9a274a0234d7ab73443f0a6e7ffa3', 'request_id': 'req-81157043-816f-4aa0-b4f6-e266e7d7b75d'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:05.164812 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-81157043-816f-4aa0-b4f6-e266e7d7b75d admin admin] The token cache is being invalidate because project 1ca9a274a0234d7ab73443f0a6e7ffa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:43:05.165106 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-81157043-816f-4aa0-b4f6-e266e7d7b75d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:05.165743 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-81157043-816f-4aa0-b4f6-e266e7d7b75d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:05.167289 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1002/2009] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:43:05 2022] DELETE /identity/v3/projects/1ca9a274a0234d7ab73443f0a6e7ffa3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:43:05.172891 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e9548-3b59-48f8-a4dd-db0722bcf6ec None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:05.173184 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e9548-3b59-48f8-a4dd-db0722bcf6ec None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:05.173461 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e9548-3b59-48f8-a4dd-db0722bcf6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:05.191769 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-be7e9548-3b59-48f8-a4dd-db0722bcf6ec None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:05.192998 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-be7e9548-3b59-48f8-a4dd-db0722bcf6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:05.232076 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81157043-816f-4aa0-b4f6-e266e7d7b75d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:05.233487 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-81157043-816f-4aa0-b4f6-e266e7d7b75d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:05.272073 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1008/2010] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:05.280807 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad324655-bf11-484c-87ec-e7ff956e2606 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:05.281097 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad324655-bf11-484c-87ec-e7ff956e2606 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:05.281373 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad324655-bf11-484c-87ec-e7ff956e2606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:05.300668 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-ad324655-bf11-484c-87ec-e7ff956e2606 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:05.301861 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-ad324655-bf11-484c-87ec-e7ff956e2606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:05.304149 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81157043-816f-4aa0-b4f6-e266e7d7b75d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:05.308921 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ac93e-e9c2-4e7f-9c5e-c8c4c3001dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:05.310114 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1009/2011] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:43:05.310244 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ac93e-e9c2-4e7f-9c5e-c8c4c3001dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:05.310436 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ac93e-e9c2-4e7f-9c5e-c8c4c3001dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:05.310784 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ac93e-e9c2-4e7f-9c5e-c8c4c3001dd0 admin admin] PATH_INFO: `/v3/projects/d3a15648d20643ce864338037c9ec67d` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:05.312060 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ac93e-e9c2-4e7f-9c5e-c8c4c3001dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a15648d20643ce864338037c9ec67d)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:05.314258 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad324655-bf11-484c-87ec-e7ff956e2606 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:05.314606 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ac93e-e9c2-4e7f-9c5e-c8c4c3001dd0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:05.326682 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad324655-bf11-484c-87ec-e7ff956e2606 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:05.333972 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032734bd-23c0-431e-a83a-ae9639e0ae6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:05.335002 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032734bd-23c0-431e-a83a-ae9639e0ae6c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:05.336205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032734bd-23c0-431e-a83a-ae9639e0ae6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:05.336478 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032734bd-23c0-431e-a83a-ae9639e0ae6c admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:05.337220 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032734bd-23c0-431e-a83a-ae9639e0ae6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:43:05.337525 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032734bd-23c0-431e-a83a-ae9639e0ae6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:05.339162 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032734bd-23c0-431e-a83a-ae9639e0ae6c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:05.351779 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1010/2012] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:43:05.356017 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032734bd-23c0-431e-a83a-ae9639e0ae6c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:05.365459 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032734bd-23c0-431e-a83a-ae9639e0ae6c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:05.370129 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c70ac93e-e9c2-4e7f-9c5e-c8c4c3001dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a15648d20643ce864338037c9ec67d', 'request_id': 'req-c70ac93e-e9c2-4e7f-9c5e-c8c4c3001dd0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:05.376233 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c70ac93e-e9c2-4e7f-9c5e-c8c4c3001dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a15648d20643ce864338037c9ec67d', 'request_id': 'req-c70ac93e-e9c2-4e7f-9c5e-c8c4c3001dd0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:05.382626 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c70ac93e-e9c2-4e7f-9c5e-c8c4c3001dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a15648d20643ce864338037c9ec67d', 'request_id': 'req-c70ac93e-e9c2-4e7f-9c5e-c8c4c3001dd0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:05.396861 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c70ac93e-e9c2-4e7f-9c5e-c8c4c3001dd0 admin admin] The token cache is being invalidate because project d3a15648d20643ce864338037c9ec67d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:43:05.397076 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c70ac93e-e9c2-4e7f-9c5e-c8c4c3001dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:05.397762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c70ac93e-e9c2-4e7f-9c5e-c8c4c3001dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:05.399949 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1003/2013] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:43:05 2022] DELETE /identity/v3/projects/d3a15648d20643ce864338037c9ec67d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:05.403689 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ac93e-e9c2-4e7f-9c5e-c8c4c3001dd0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:05.405141 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c70ac93e-e9c2-4e7f-9c5e-c8c4c3001dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:05.423464 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a45e4-48cd-4584-8e3e-599d4939eee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:05.424139 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a45e4-48cd-4584-8e3e-599d4939eee0 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:05.424826 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a45e4-48cd-4584-8e3e-599d4939eee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:05.424826 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a45e4-48cd-4584-8e3e-599d4939eee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:05.425377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a45e4-48cd-4584-8e3e-599d4939eee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:05.428326 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a45e4-48cd-4584-8e3e-599d4939eee0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:05.454345 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1011/2014] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:43:05 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:43:05.458341 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a45e4-48cd-4584-8e3e-599d4939eee0 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:05.461412 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-932a45e4-48cd-4584-8e3e-599d4939eee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:05.476880 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ac93e-e9c2-4e7f-9c5e-c8c4c3001dd0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:05.529544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a45e4-48cd-4584-8e3e-599d4939eee0 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:05.532189 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc17f73-c541-4619-8fca-7cc5447eea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:05.533152 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc17f73-c541-4619-8fca-7cc5447eea11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:05.533489 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc17f73-c541-4619-8fca-7cc5447eea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:05.533894 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc17f73-c541-4619-8fca-7cc5447eea11 admin admin] PATH_INFO: `/v3/users/c76a792d59984856ae801fc087558198` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:05.535195 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc17f73-c541-4619-8fca-7cc5447eea11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c76a792d59984856ae801fc087558198)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:05.537207 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc17f73-c541-4619-8fca-7cc5447eea11 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:05.540135 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7f41a-10fe-47fb-bac1-756cdc9fd75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:05.541061 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7f41a-10fe-47fb-bac1-756cdc9fd75b admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:05.541348 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7f41a-10fe-47fb-bac1-756cdc9fd75b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:05.541623 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7f41a-10fe-47fb-bac1-756cdc9fd75b admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:05.542341 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7f41a-10fe-47fb-bac1-756cdc9fd75b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:05.544300 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7f41a-10fe-47fb-bac1-756cdc9fd75b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:05.568531 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1012/2015] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:43:05 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:43:05.570410 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7f41a-10fe-47fb-bac1-756cdc9fd75b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:05.580216 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7f41a-10fe-47fb-bac1-756cdc9fd75b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:05.583587 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9dc17f73-c541-4619-8fca-7cc5447eea11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c76a792d59984856ae801fc087558198'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:05.584895 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7925740-a12c-43ab-a6ca-09b1e9ce2317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:05.586178 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7925740-a12c-43ab-a6ca-09b1e9ce2317 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:05.586461 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7925740-a12c-43ab-a6ca-09b1e9ce2317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:05.586760 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7925740-a12c-43ab-a6ca-09b1e9ce2317 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:05.587466 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7925740-a12c-43ab-a6ca-09b1e9ce2317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:05.589094 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7925740-a12c-43ab-a6ca-09b1e9ce2317 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:05.590805 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9dc17f73-c541-4619-8fca-7cc5447eea11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c76a792d59984856ae801fc087558198'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:05.600457 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1013/2016] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:43:05.603801 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9dc17f73-c541-4619-8fca-7cc5447eea11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c76a792d59984856ae801fc087558198'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:05.604914 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7925740-a12c-43ab-a6ca-09b1e9ce2317 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:05.611280 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9dc17f73-c541-4619-8fca-7cc5447eea11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c76a792d59984856ae801fc087558198'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:05.611941 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9dc17f73-c541-4619-8fca-7cc5447eea11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c76a792d59984856ae801fc087558198'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:05.615636 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7925740-a12c-43ab-a6ca-09b1e9ce2317 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:05.618556 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1004/2017] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:43:05 2022] DELETE /identity/v3/users/c76a792d59984856ae801fc087558198 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:43:05.620834 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236342c5-6f4c-443c-8726-6583f201d40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:05.621545 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236342c5-6f4c-443c-8726-6583f201d40d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:05.621826 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236342c5-6f4c-443c-8726-6583f201d40d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:05.622103 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236342c5-6f4c-443c-8726-6583f201d40d admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:05.622839 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236342c5-6f4c-443c-8726-6583f201d40d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:05.624473 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236342c5-6f4c-443c-8726-6583f201d40d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:05.639825 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1014/2018] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:43:05.644565 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc17f73-c541-4619-8fca-7cc5447eea11 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:05.646018 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9dc17f73-c541-4619-8fca-7cc5447eea11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:05.713072 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc17f73-c541-4619-8fca-7cc5447eea11 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:05.717819 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71425b62-7efc-4ef8-9c35-aa41a1e6ae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:05.718695 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71425b62-7efc-4ef8-9c35-aa41a1e6ae96 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:05.718979 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71425b62-7efc-4ef8-9c35-aa41a1e6ae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:05.719275 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71425b62-7efc-4ef8-9c35-aa41a1e6ae96 admin admin] PATH_INFO: `/v3/projects/82109ab07882467bb75fe01c154fbbb5/users/d82f340df87346cea3eb5a091d93d3ee/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:05.734073 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71425b62-7efc-4ef8-9c35-aa41a1e6ae96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82109ab07882467bb75fe01c154fbbb5, user_id=d82f340df87346cea3eb5a091d93d3ee, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:05.736807 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71425b62-7efc-4ef8-9c35-aa41a1e6ae96 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:05.757724 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1005/2019] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:43:05 2022] PUT /identity/v3/projects/82109ab07882467bb75fe01c154fbbb5/users/d82f340df87346cea3eb5a091d93d3ee/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:05.761256 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2c175-fbc7-451d-aa9d-70c653b7ef5e None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:05.761545 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2c175-fbc7-451d-aa9d-70c653b7ef5e None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:05.761871 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2c175-fbc7-451d-aa9d-70c653b7ef5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:05.791017 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-3cf2c175-fbc7-451d-aa9d-70c653b7ef5e None None] MFA Rules not processed for user `d82f340df87346cea3eb5a091d93d3ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:05.792360 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-3cf2c175-fbc7-451d-aa9d-70c653b7ef5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:05.858092 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1015/2020] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:43:05.869630 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71425b62-7efc-4ef8-9c35-aa41a1e6ae96 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:05.871430 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-71425b62-7efc-4ef8-9c35-aa41a1e6ae96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:05.900553 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2c175-fbc7-451d-aa9d-70c653b7ef5e None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:05.902097 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-3cf2c175-fbc7-451d-aa9d-70c653b7ef5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:05.952567 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71425b62-7efc-4ef8-9c35-aa41a1e6ae96 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:05.964767 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acda11-5b84-491b-99a3-18748a3b07f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:05.966557 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acda11-5b84-491b-99a3-18748a3b07f1 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:05.967056 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acda11-5b84-491b-99a3-18748a3b07f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:05.967521 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acda11-5b84-491b-99a3-18748a3b07f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:05.982139 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acda11-5b84-491b-99a3-18748a3b07f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:05.985103 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acda11-5b84-491b-99a3-18748a3b07f1 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:06.013435 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1006/2021] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:43:06.021216 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2c175-fbc7-451d-aa9d-70c653b7ef5e None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:06.028303 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f957ac-10b2-412e-8ca9-6a9003a436d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:06.029173 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f957ac-10b2-412e-8ca9-6a9003a436d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:06.029455 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f957ac-10b2-412e-8ca9-6a9003a436d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:06.029728 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f957ac-10b2-412e-8ca9-6a9003a436d6 admin admin] PATH_INFO: `/v3/projects/1b2d519dbc004a46a1a2e5d91d06c9f5` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:06.031127 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f957ac-10b2-412e-8ca9-6a9003a436d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b2d519dbc004a46a1a2e5d91d06c9f5)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:06.033089 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f957ac-10b2-412e-8ca9-6a9003a436d6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:06.124628 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-32f957ac-10b2-412e-8ca9-6a9003a436d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b2d519dbc004a46a1a2e5d91d06c9f5', 'request_id': 'req-32f957ac-10b2-412e-8ca9-6a9003a436d6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:06.132861 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-32f957ac-10b2-412e-8ca9-6a9003a436d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b2d519dbc004a46a1a2e5d91d06c9f5', 'request_id': 'req-32f957ac-10b2-412e-8ca9-6a9003a436d6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:06.142952 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-32f957ac-10b2-412e-8ca9-6a9003a436d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b2d519dbc004a46a1a2e5d91d06c9f5', 'request_id': 'req-32f957ac-10b2-412e-8ca9-6a9003a436d6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:06.161914 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-32f957ac-10b2-412e-8ca9-6a9003a436d6 admin admin] The token cache is being invalidate because project 1b2d519dbc004a46a1a2e5d91d06c9f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:43:06.162202 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-32f957ac-10b2-412e-8ca9-6a9003a436d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:06.162923 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-32f957ac-10b2-412e-8ca9-6a9003a436d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:06.165542 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1016/2022] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:43:05 2022] DELETE /identity/v3/projects/1b2d519dbc004a46a1a2e5d91d06c9f5 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:06.172473 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844863a-9259-4c12-9f59-65e1cf8f7d88 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:06.172814 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844863a-9259-4c12-9f59-65e1cf8f7d88 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:06.173563 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844863a-9259-4c12-9f59-65e1cf8f7d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:06.196684 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-0844863a-9259-4c12-9f59-65e1cf8f7d88 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:06.197907 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0844863a-9259-4c12-9f59-65e1cf8f7d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:06.269030 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1007/2023] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:43:06.278853 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072cf20-b0d5-4aaf-9a22-fdbcb48c4dd4 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:06.279479 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072cf20-b0d5-4aaf-9a22-fdbcb48c4dd4 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:06.279479 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072cf20-b0d5-4aaf-9a22-fdbcb48c4dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:06.299914 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-7072cf20-b0d5-4aaf-9a22-fdbcb48c4dd4 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:06.301001 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-7072cf20-b0d5-4aaf-9a22-fdbcb48c4dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:06.314562 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1017/2024] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:06.319030 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844863a-9259-4c12-9f59-65e1cf8f7d88 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:06.330354 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844863a-9259-4c12-9f59-65e1cf8f7d88 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:06.336071 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb381d2d-0c84-48df-b04a-796f58544f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:06.336739 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb381d2d-0c84-48df-b04a-796f58544f1a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:06.337005 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb381d2d-0c84-48df-b04a-796f58544f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:06.337356 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb381d2d-0c84-48df-b04a-796f58544f1a admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:06.338091 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb381d2d-0c84-48df-b04a-796f58544f1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:43:06.338310 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb381d2d-0c84-48df-b04a-796f58544f1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:06.339951 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb381d2d-0c84-48df-b04a-796f58544f1a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:06.354752 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1008/2025] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:43:06.359391 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072cf20-b0d5-4aaf-9a22-fdbcb48c4dd4 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:06.370286 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072cf20-b0d5-4aaf-9a22-fdbcb48c4dd4 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:06.375969 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccc8a4-f0b3-4515-9947-7e5571d81e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:06.376678 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccc8a4-f0b3-4515-9947-7e5571d81e53 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:06.376977 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccc8a4-f0b3-4515-9947-7e5571d81e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:06.377253 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccc8a4-f0b3-4515-9947-7e5571d81e53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:06.378001 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bccc8a4-f0b3-4515-9947-7e5571d81e53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:06.380034 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bccc8a4-f0b3-4515-9947-7e5571d81e53 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:06.411148 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1018/2026] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:43:06 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:43:06.412306 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb381d2d-0c84-48df-b04a-796f58544f1a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:06.423246 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb381d2d-0c84-48df-b04a-796f58544f1a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:06.478951 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5d1dc-2d79-4781-bad3-c4ac03ddb1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:06.479629 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5d1dc-2d79-4781-bad3-c4ac03ddb1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:06.479949 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5d1dc-2d79-4781-bad3-c4ac03ddb1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:06.480228 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5d1dc-2d79-4781-bad3-c4ac03ddb1c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:06.480932 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5d1dc-2d79-4781-bad3-c4ac03ddb1c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:06.482850 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5d1dc-2d79-4781-bad3-c4ac03ddb1c9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:06.507436 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1009/2027] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:43:06 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:43:06.508642 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccc8a4-f0b3-4515-9947-7e5571d81e53 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:06.518865 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccc8a4-f0b3-4515-9947-7e5571d81e53 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:06.524426 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c709084-2c66-4f98-8637-aaa98b0d3a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:06.525056 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c709084-2c66-4f98-8637-aaa98b0d3a04 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:06.525341 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c709084-2c66-4f98-8637-aaa98b0d3a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:06.525621 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c709084-2c66-4f98-8637-aaa98b0d3a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:06.526360 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c709084-2c66-4f98-8637-aaa98b0d3a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:06.527982 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c709084-2c66-4f98-8637-aaa98b0d3a04 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:06.538117 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1019/2028] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:43:06.542599 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5d1dc-2d79-4781-bad3-c4ac03ddb1c9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:06.552555 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5d1dc-2d79-4781-bad3-c4ac03ddb1c9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:06.557386 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe981907-9d91-4dca-bd4d-744abd3dccdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:06.558032 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe981907-9d91-4dca-bd4d-744abd3dccdd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:06.558313 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe981907-9d91-4dca-bd4d-744abd3dccdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:06.558589 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe981907-9d91-4dca-bd4d-744abd3dccdd admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:06.559319 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe981907-9d91-4dca-bd4d-744abd3dccdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:06.560938 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe981907-9d91-4dca-bd4d-744abd3dccdd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:06.571024 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1010/2029] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:43:06.574783 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c709084-2c66-4f98-8637-aaa98b0d3a04 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:06.584470 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c709084-2c66-4f98-8637-aaa98b0d3a04 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:06.589933 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88f432-4b83-4610-8cd4-1926f017c6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:06.590791 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88f432-4b83-4610-8cd4-1926f017c6f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:06.591071 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88f432-4b83-4610-8cd4-1926f017c6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:06.591348 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88f432-4b83-4610-8cd4-1926f017c6f3 admin admin] PATH_INFO: `/v3/projects/bdd3d5feed9748999a7c89e69e1bfef8/users/556cfe2898d7413d8c0298bc4a0dcb76/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:06.606893 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88f432-4b83-4610-8cd4-1926f017c6f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd3d5feed9748999a7c89e69e1bfef8, user_id=556cfe2898d7413d8c0298bc4a0dcb76, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:06.609642 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88f432-4b83-4610-8cd4-1926f017c6f3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:06.623182 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1020/2030] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:43:06 2022] PUT /identity/v3/projects/bdd3d5feed9748999a7c89e69e1bfef8/users/556cfe2898d7413d8c0298bc4a0dcb76/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:06.628411 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd045d-938a-480d-ad58-6bad82931881 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:06.628726 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd045d-938a-480d-ad58-6bad82931881 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:06.629000 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd045d-938a-480d-ad58-6bad82931881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:06.647330 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-16cd045d-938a-480d-ad58-6bad82931881 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:06.649207 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-16cd045d-938a-480d-ad58-6bad82931881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:06.707083 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1011/2031] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:06.717383 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88f432-4b83-4610-8cd4-1926f017c6f3 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:06.719196 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-2a88f432-4b83-4610-8cd4-1926f017c6f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:06.781111 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88f432-4b83-4610-8cd4-1926f017c6f3 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:06.784759 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc2da2-eb5d-469e-b00f-c02c7e9da125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:06.785399 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc2da2-eb5d-469e-b00f-c02c7e9da125 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:06.785681 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc2da2-eb5d-469e-b00f-c02c7e9da125 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:06.785958 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc2da2-eb5d-469e-b00f-c02c7e9da125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:06.795399 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc2da2-eb5d-469e-b00f-c02c7e9da125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:06.796866 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc2da2-eb5d-469e-b00f-c02c7e9da125 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:06.806657 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1021/2032] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:43:07.854379 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4167f-65d8-43b7-b048-1a32f9c8054b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:07.854826 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4167f-65d8-43b7-b048-1a32f9c8054b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:07.854971 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4167f-65d8-43b7-b048-1a32f9c8054b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:07.882952 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-25d4167f-65d8-43b7-b048-1a32f9c8054b None None] MFA Rules not processed for user `556cfe2898d7413d8c0298bc4a0dcb76`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:07.884362 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-25d4167f-65d8-43b7-b048-1a32f9c8054b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:07.950497 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1012/2033] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:07.954942 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc2da2-eb5d-469e-b00f-c02c7e9da125 service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:07.965437 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc2da2-eb5d-469e-b00f-c02c7e9da125 service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:07.970683 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa3ff6-a51c-4d17-b79f-1e24d9135dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:07.971330 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa3ff6-a51c-4d17-b79f-1e24d9135dbf admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:07.971613 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa3ff6-a51c-4d17-b79f-1e24d9135dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:07.971929 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa3ff6-a51c-4d17-b79f-1e24d9135dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:07.972644 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa3ff6-a51c-4d17-b79f-1e24d9135dbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:07.974530 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa3ff6-a51c-4d17-b79f-1e24d9135dbf admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:08.003911 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1022/2034] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:43:07 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:43:08.009392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4167f-65d8-43b7-b048-1a32f9c8054b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:08.021051 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4167f-65d8-43b7-b048-1a32f9c8054b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:08.080998 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867c7e5-15d3-4897-8de5-53c9886fda1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:08.081659 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c7e5-15d3-4897-8de5-53c9886fda1f admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:08.081937 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c7e5-15d3-4897-8de5-53c9886fda1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:08.082207 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c7e5-15d3-4897-8de5-53c9886fda1f admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:08.082904 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867c7e5-15d3-4897-8de5-53c9886fda1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:08.084849 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867c7e5-15d3-4897-8de5-53c9886fda1f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:08.104512 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1013/2035] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:43:08 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:43:08.108822 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa3ff6-a51c-4d17-b79f-1e24d9135dbf admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:08.119544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa3ff6-a51c-4d17-b79f-1e24d9135dbf admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:08.124935 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39093b-a7cc-4dc6-b4dd-d9b0ae0232a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:08.125721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39093b-a7cc-4dc6-b4dd-d9b0ae0232a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:08.132117 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39093b-a7cc-4dc6-b4dd-d9b0ae0232a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:08.132737 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39093b-a7cc-4dc6-b4dd-d9b0ae0232a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:08.134838 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39093b-a7cc-4dc6-b4dd-d9b0ae0232a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:08.136560 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39093b-a7cc-4dc6-b4dd-d9b0ae0232a3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:08.152725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1023/2036] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:43:08.153925 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867c7e5-15d3-4897-8de5-53c9886fda1f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:08.163612 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867c7e5-15d3-4897-8de5-53c9886fda1f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:08.168313 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b730a5e-03f2-432d-a454-aca11a2e1b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:08.169187 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b730a5e-03f2-432d-a454-aca11a2e1b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:08.169463 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b730a5e-03f2-432d-a454-aca11a2e1b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:08.169734 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b730a5e-03f2-432d-a454-aca11a2e1b55 admin admin] PATH_INFO: `/v3/projects/af1c56da97394a80af809d475615d45c/users/590b11d6e1e6488cbacb5778f634c6fb/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:08.188089 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b730a5e-03f2-432d-a454-aca11a2e1b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af1c56da97394a80af809d475615d45c, user_id=590b11d6e1e6488cbacb5778f634c6fb, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:08.190763 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b730a5e-03f2-432d-a454-aca11a2e1b55 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:08.204181 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1014/2037] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:43:08 2022] PUT /identity/v3/projects/af1c56da97394a80af809d475615d45c/users/590b11d6e1e6488cbacb5778f634c6fb/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:08.208726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39093b-a7cc-4dc6-b4dd-d9b0ae0232a3 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:08.220105 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39093b-a7cc-4dc6-b4dd-d9b0ae0232a3 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:08.275044 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08613958-0054-438a-8063-188d8a78bdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:08.275718 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08613958-0054-438a-8063-188d8a78bdcd admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:08.276031 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08613958-0054-438a-8063-188d8a78bdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:08.276311 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08613958-0054-438a-8063-188d8a78bdcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:08.277491 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08613958-0054-438a-8063-188d8a78bdcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:08.278738 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08613958-0054-438a-8063-188d8a78bdcd admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:08.291789 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1024/2038] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:43:08.296273 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b730a5e-03f2-432d-a454-aca11a2e1b55 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:08.307577 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b730a5e-03f2-432d-a454-aca11a2e1b55 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:08.312461 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9c51d-2a70-4e6e-adea-facd4cddcc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:08.313341 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9c51d-2a70-4e6e-adea-facd4cddcc9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:08.313625 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9c51d-2a70-4e6e-adea-facd4cddcc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:08.313905 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9c51d-2a70-4e6e-adea-facd4cddcc9f admin admin] PATH_INFO: `/v3/projects/af1c56da97394a80af809d475615d45c/users/590b11d6e1e6488cbacb5778f634c6fb/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:08.315923 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9c51d-2a70-4e6e-adea-facd4cddcc9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=af1c56da97394a80af809d475615d45c, user_id=590b11d6e1e6488cbacb5778f634c6fb, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:08.318667 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9c51d-2a70-4e6e-adea-facd4cddcc9f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:08.329613 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1015/2039] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:43:08 2022] PUT /identity/v3/projects/af1c56da97394a80af809d475615d45c/users/590b11d6e1e6488cbacb5778f634c6fb/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:08.477312 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef04df-79f6-4d68-b8b7-b58e33e0c034 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:08.477685 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef04df-79f6-4d68-b8b7-b58e33e0c034 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:08.478033 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef04df-79f6-4d68-b8b7-b58e33e0c034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:08.496687 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-d0ef04df-79f6-4d68-b8b7-b58e33e0c034 None None] MFA Rules not processed for user `d82f340df87346cea3eb5a091d93d3ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:08.497981 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d0ef04df-79f6-4d68-b8b7-b58e33e0c034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:08.562904 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1025/2040] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:09.148651 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af027d3e-1ab1-4768-959a-e2b7ea217990 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:09.149216 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af027d3e-1ab1-4768-959a-e2b7ea217990 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:09.149216 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af027d3e-1ab1-4768-959a-e2b7ea217990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:09.195445 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-af027d3e-1ab1-4768-959a-e2b7ea217990 None None] MFA Rules not processed for user `590b11d6e1e6488cbacb5778f634c6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:09.197050 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-af027d3e-1ab1-4768-959a-e2b7ea217990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:09.293591 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1016/2041] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:09.305292 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef04df-79f6-4d68-b8b7-b58e33e0c034 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:09.306825 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d0ef04df-79f6-4d68-b8b7-b58e33e0c034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:09.395827 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef04df-79f6-4d68-b8b7-b58e33e0c034 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:09.400146 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4046f2-018e-4565-8431-8932c0b30461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:09.400829 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4046f2-018e-4565-8431-8932c0b30461 service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:09.401115 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4046f2-018e-4565-8431-8932c0b30461 service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:09.401400 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4046f2-018e-4565-8431-8932c0b30461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:09.463800 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4046f2-018e-4565-8431-8932c0b30461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:09.465786 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4046f2-018e-4565-8431-8932c0b30461 service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:09.476803 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1026/2042] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:43:11.835743 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af027d3e-1ab1-4768-959a-e2b7ea217990 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:11.838108 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-af027d3e-1ab1-4768-959a-e2b7ea217990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:11.929347 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af027d3e-1ab1-4768-959a-e2b7ea217990 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:11.936261 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca0884-5148-401a-988a-41c88e1aa7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:11.937207 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca0884-5148-401a-988a-41c88e1aa7d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:11.937553 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca0884-5148-401a-988a-41c88e1aa7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:11.937893 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca0884-5148-401a-988a-41c88e1aa7d5 admin admin] PATH_INFO: `/v3/users/b846098f335a42e0892f7f35007ef234` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:11.939938 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca0884-5148-401a-988a-41c88e1aa7d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b846098f335a42e0892f7f35007ef234)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:11.942229 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca0884-5148-401a-988a-41c88e1aa7d5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:11.955330 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4046f2-018e-4565-8431-8932c0b30461 service cinder] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:11.957406 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-6a4046f2-018e-4565-8431-8932c0b30461 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:11.978566 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4046f2-018e-4565-8431-8932c0b30461 service cinder] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:11.989104 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48be76c-7554-4442-a742-3757fdbe5379 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:11.989757 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48be76c-7554-4442-a742-3757fdbe5379 service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:11.990214 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48be76c-7554-4442-a742-3757fdbe5379 service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:11.990672 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48be76c-7554-4442-a742-3757fdbe5379 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:12.011615 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48be76c-7554-4442-a742-3757fdbe5379 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:12.013124 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48be76c-7554-4442-a742-3757fdbe5379 service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:12.031324 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-16ca0884-5148-401a-988a-41c88e1aa7d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b846098f335a42e0892f7f35007ef234'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:12.032980 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1027/2043] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:43:12.042129 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-16ca0884-5148-401a-988a-41c88e1aa7d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b846098f335a42e0892f7f35007ef234'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:12.071319 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-16ca0884-5148-401a-988a-41c88e1aa7d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b846098f335a42e0892f7f35007ef234'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:12.082645 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-16ca0884-5148-401a-988a-41c88e1aa7d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b846098f335a42e0892f7f35007ef234'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:12.083585 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-16ca0884-5148-401a-988a-41c88e1aa7d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b846098f335a42e0892f7f35007ef234'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:12.092684 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1017/2044] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:43:11 2022] DELETE /identity/v3/users/b846098f335a42e0892f7f35007ef234 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:12.404812 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48be76c-7554-4442-a742-3757fdbe5379 service cinder] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:12.419235 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48be76c-7554-4442-a742-3757fdbe5379 service cinder] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:12.492182 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36adeb9-1333-48b7-a8b9-876706f9742e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:12.493146 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36adeb9-1333-48b7-a8b9-876706f9742e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:12.494133 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36adeb9-1333-48b7-a8b9-876706f9742e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:12.495194 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36adeb9-1333-48b7-a8b9-876706f9742e admin admin] PATH_INFO: `/v3/projects/dbcf2a29fa234f62a1c82620e2c1cbcd` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:12.497245 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36adeb9-1333-48b7-a8b9-876706f9742e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbcf2a29fa234f62a1c82620e2c1cbcd)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:12.500085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36adeb9-1333-48b7-a8b9-876706f9742e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:12.593303 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e36adeb9-1333-48b7-a8b9-876706f9742e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'request_id': 'req-e36adeb9-1333-48b7-a8b9-876706f9742e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:12.601558 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e36adeb9-1333-48b7-a8b9-876706f9742e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'request_id': 'req-e36adeb9-1333-48b7-a8b9-876706f9742e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:12.615727 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e36adeb9-1333-48b7-a8b9-876706f9742e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'request_id': 'req-e36adeb9-1333-48b7-a8b9-876706f9742e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:12.632690 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e36adeb9-1333-48b7-a8b9-876706f9742e admin admin] The token cache is being invalidate because project dbcf2a29fa234f62a1c82620e2c1cbcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:43:12.633007 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e36adeb9-1333-48b7-a8b9-876706f9742e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:12.633638 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-e36adeb9-1333-48b7-a8b9-876706f9742e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:12.640433 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1028/2045] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:43:12 2022] DELETE /identity/v3/projects/dbcf2a29fa234f62a1c82620e2c1cbcd => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:12.643057 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5ea64-4b82-41f4-98ac-4b2a73c853d8 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:12.643349 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5ea64-4b82-41f4-98ac-4b2a73c853d8 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:12.643628 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5ea64-4b82-41f4-98ac-4b2a73c853d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:12.664197 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e2e5ea64-4b82-41f4-98ac-4b2a73c853d8 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:12.665575 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e2e5ea64-4b82-41f4-98ac-4b2a73c853d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:12.748472 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1018/2046] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:12.756206 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20504a-8fa1-412e-91d5-0e3f7dbd6618 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:12.756491 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20504a-8fa1-412e-91d5-0e3f7dbd6618 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:12.756944 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20504a-8fa1-412e-91d5-0e3f7dbd6618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:12.782123 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-ea20504a-8fa1-412e-91d5-0e3f7dbd6618 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:12.783461 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-ea20504a-8fa1-412e-91d5-0e3f7dbd6618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:12.793657 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1029/2047] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:43:12.798197 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5ea64-4b82-41f4-98ac-4b2a73c853d8 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:12.814779 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5ea64-4b82-41f4-98ac-4b2a73c853d8 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:12.827476 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8776d50-774a-42fc-86ce-738e01eed882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:12.828486 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8776d50-774a-42fc-86ce-738e01eed882 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:12.828777 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8776d50-774a-42fc-86ce-738e01eed882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:12.829055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8776d50-774a-42fc-86ce-738e01eed882 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:12.829979 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8776d50-774a-42fc-86ce-738e01eed882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:43:12.830294 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8776d50-774a-42fc-86ce-738e01eed882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:12.833413 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8776d50-774a-42fc-86ce-738e01eed882 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:12.862896 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1019/2048] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:43:12.863542 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20504a-8fa1-412e-91d5-0e3f7dbd6618 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:12.873519 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20504a-8fa1-412e-91d5-0e3f7dbd6618 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:12.878303 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f187016-63ec-40c6-882e-688bca217163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:12.879020 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f187016-63ec-40c6-882e-688bca217163 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:12.879370 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f187016-63ec-40c6-882e-688bca217163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:12.879713 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f187016-63ec-40c6-882e-688bca217163 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:12.880777 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f187016-63ec-40c6-882e-688bca217163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:12.882751 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f187016-63ec-40c6-882e-688bca217163 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:12.909063 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1030/2049] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:43:12 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:43:12.913244 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8776d50-774a-42fc-86ce-738e01eed882 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:12.928168 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8776d50-774a-42fc-86ce-738e01eed882 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:12.988678 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a548f-378a-4f36-baca-dd7305c5b711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:12.989665 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a548f-378a-4f36-baca-dd7305c5b711 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:12.990018 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a548f-378a-4f36-baca-dd7305c5b711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:12.990294 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a548f-378a-4f36-baca-dd7305c5b711 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:12.991110 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a548f-378a-4f36-baca-dd7305c5b711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:12.993212 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a548f-378a-4f36-baca-dd7305c5b711 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:13.019986 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1020/2050] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:43:12 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:43:13.024449 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f187016-63ec-40c6-882e-688bca217163 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:13.039780 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f187016-63ec-40c6-882e-688bca217163 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:13.047340 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16f510-21cf-446b-989d-08d442126bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:13.048149 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16f510-21cf-446b-989d-08d442126bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:13.052586 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16f510-21cf-446b-989d-08d442126bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:13.052919 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16f510-21cf-446b-989d-08d442126bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:13.053719 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16f510-21cf-446b-989d-08d442126bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:13.055368 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16f510-21cf-446b-989d-08d442126bb2 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:13.067643 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1031/2051] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:43:13.071518 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a548f-378a-4f36-baca-dd7305c5b711 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:13.081441 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a548f-378a-4f36-baca-dd7305c5b711 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:13.086328 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab454c-111e-47c3-8783-55a7a810d68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:13.086990 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab454c-111e-47c3-8783-55a7a810d68a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:13.087268 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab454c-111e-47c3-8783-55a7a810d68a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:13.088132 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab454c-111e-47c3-8783-55a7a810d68a admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:13.088864 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab454c-111e-47c3-8783-55a7a810d68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:13.090458 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab454c-111e-47c3-8783-55a7a810d68a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:13.101081 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1021/2052] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:43:13.106245 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16f510-21cf-446b-989d-08d442126bb2 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:13.120798 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16f510-21cf-446b-989d-08d442126bb2 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:13.125533 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f22a3-f1df-40ce-b579-d866b45b657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:13.126406 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f22a3-f1df-40ce-b579-d866b45b657e admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:13.126684 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f22a3-f1df-40ce-b579-d866b45b657e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:13.127076 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f22a3-f1df-40ce-b579-d866b45b657e admin admin] PATH_INFO: `/v3/projects/3b57fcb90a594af1b70daaecbf9efd96/users/a5eff85a200a4a599e0cefe8d681d72d/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:13.143051 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f22a3-f1df-40ce-b579-d866b45b657e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b57fcb90a594af1b70daaecbf9efd96, user_id=a5eff85a200a4a599e0cefe8d681d72d, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:13.145807 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f22a3-f1df-40ce-b579-d866b45b657e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:13.159536 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1032/2053] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:43:13 2022] PUT /identity/v3/projects/3b57fcb90a594af1b70daaecbf9efd96/users/a5eff85a200a4a599e0cefe8d681d72d/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:43:13.164584 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b3027-68b2-49e3-aab2-1aad48ceecab None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:13.164878 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b3027-68b2-49e3-aab2-1aad48ceecab None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:13.165161 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b3027-68b2-49e3-aab2-1aad48ceecab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:13.185367 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-317b3027-68b2-49e3-aab2-1aad48ceecab None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:13.186579 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-317b3027-68b2-49e3-aab2-1aad48ceecab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:13.250879 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1022/2054] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:13.262768 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f22a3-f1df-40ce-b579-d866b45b657e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:13.264909 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-702f22a3-f1df-40ce-b579-d866b45b657e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:13.335725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f22a3-f1df-40ce-b579-d866b45b657e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:13.340327 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f433fba-c3a1-4648-9d77-0578e5bb264b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:13.340945 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f433fba-c3a1-4648-9d77-0578e5bb264b service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:13.341304 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f433fba-c3a1-4648-9d77-0578e5bb264b service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:13.341657 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f433fba-c3a1-4648-9d77-0578e5bb264b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:13.351302 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f433fba-c3a1-4648-9d77-0578e5bb264b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:13.352839 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f433fba-c3a1-4648-9d77-0578e5bb264b service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:13.363862 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1033/2055] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:43:14.084306 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45542e-e76d-45b5-8e06-82ec133508c7 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:14.085215 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45542e-e76d-45b5-8e06-82ec133508c7 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:14.085824 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45542e-e76d-45b5-8e06-82ec133508c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:14.115611 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-7e45542e-e76d-45b5-8e06-82ec133508c7 None None] MFA Rules not processed for user `a5eff85a200a4a599e0cefe8d681d72d`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:14.116895 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7e45542e-e76d-45b5-8e06-82ec133508c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:14.184931 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1023/2056] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:14.196574 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd5793-70ad-4fdf-ba51-871fe25f4830 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:14.197665 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd5793-70ad-4fdf-ba51-871fe25f4830 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:14.197772 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd5793-70ad-4fdf-ba51-871fe25f4830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:14.215141 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-c6bd5793-70ad-4fdf-ba51-871fe25f4830 None None] MFA Rules not processed for user `a5eff85a200a4a599e0cefe8d681d72d`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:14.216374 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-c6bd5793-70ad-4fdf-ba51-871fe25f4830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:14.224176 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1034/2057] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:43:14.235177 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45542e-e76d-45b5-8e06-82ec133508c7 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:14.236643 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7e45542e-e76d-45b5-8e06-82ec133508c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:14.308270 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45542e-e76d-45b5-8e06-82ec133508c7 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:14.314440 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adcd34-e0b4-415d-9261-8943bc75cb1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:14.315111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adcd34-e0b4-415d-9261-8943bc75cb1f service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:14.315392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adcd34-e0b4-415d-9261-8943bc75cb1f service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:14.315668 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adcd34-e0b4-415d-9261-8943bc75cb1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:14.324173 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6adcd34-e0b4-415d-9261-8943bc75cb1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:14.325781 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6adcd34-e0b4-415d-9261-8943bc75cb1f service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:14.335055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1024/2058] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:43:32.133829 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95caa9-0692-4de4-a417-ec6844f8b2b2 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:32.134322 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95caa9-0692-4de4-a417-ec6844f8b2b2 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:32.134424 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95caa9-0692-4de4-a417-ec6844f8b2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:32.152786 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-eb95caa9-0692-4de4-a417-ec6844f8b2b2 None None] MFA Rules not processed for user `9761863f36284bd4be1ce29c86b631cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:32.153993 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-eb95caa9-0692-4de4-a417-ec6844f8b2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:32.209679 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1035/2059] 10.222.0.35 () {58 vars in 1009 bytes} [Tue Feb 8 16:43:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:32.256292 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adcd34-e0b4-415d-9261-8943bc75cb1f service nova] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:32.257702 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e6adcd34-e0b4-415d-9261-8943bc75cb1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:32.334698 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adcd34-e0b4-415d-9261-8943bc75cb1f service nova] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:32.341830 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd529763-a4a1-4584-994b-dcea8cc916ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00fd3c05cd8e4167946a1f567df2cc6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:32.342797 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd529763-a4a1-4584-994b-dcea8cc916ad service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:32.343077 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd529763-a4a1-4584-994b-dcea8cc916ad service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:32.343348 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd529763-a4a1-4584-994b-dcea8cc916ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:32.352151 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd529763-a4a1-4584-994b-dcea8cc916ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:32.354373 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd529763-a4a1-4584-994b-dcea8cc916ad service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:32.363824 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1025/2060] 10.222.0.35 () {60 vars in 1384 bytes} [Tue Feb 8 16:43:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 08 16:43:33.021304 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5393b4e-1bc1-42cf-bd51-8808699aafd1 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:33.021767 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5393b4e-1bc1-42cf-bd51-8808699aafd1 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:33.022149 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5393b4e-1bc1-42cf-bd51-8808699aafd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:33.045771 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-e5393b4e-1bc1-42cf-bd51-8808699aafd1 None None] MFA Rules not processed for user `9761863f36284bd4be1ce29c86b631cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:33.046980 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-e5393b4e-1bc1-42cf-bd51-8808699aafd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:33.055399 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1036/2061] 10.222.0.35 () {58 vars in 967 bytes} [Tue Feb 8 16:43:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:33.070772 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd529763-a4a1-4584-994b-dcea8cc916ad service swift] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:33.083373 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd529763-a4a1-4584-994b-dcea8cc916ad service swift] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:33.089595 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf28a1d-0556-4926-8eb3-e5cb7abcaac0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00fd3c05cd8e4167946a1f567df2cc6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:33.090229 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf28a1d-0556-4926-8eb3-e5cb7abcaac0 service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:33.090500 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf28a1d-0556-4926-8eb3-e5cb7abcaac0 service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:33.090772 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf28a1d-0556-4926-8eb3-e5cb7abcaac0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:33.100759 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf28a1d-0556-4926-8eb3-e5cb7abcaac0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:33.102362 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf28a1d-0556-4926-8eb3-e5cb7abcaac0 service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:33.111600 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1026/2062] 10.222.0.35 () {60 vars in 1384 bytes} [Tue Feb 8 16:43:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 08 16:43:33.318447 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87993ff2-d838-4853-b710-b4051ade148c None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:33.318893 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87993ff2-d838-4853-b710-b4051ade148c None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:33.318984 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87993ff2-d838-4853-b710-b4051ade148c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:33.337718 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-87993ff2-d838-4853-b710-b4051ade148c None None] MFA Rules not processed for user `9761863f36284bd4be1ce29c86b631cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:33.339203 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-87993ff2-d838-4853-b710-b4051ade148c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:33.346354 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1037/2063] 10.222.0.35 () {58 vars in 1009 bytes} [Tue Feb 8 16:43:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:33.358928 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf28a1d-0556-4926-8eb3-e5cb7abcaac0 service swift] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:33.369142 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf28a1d-0556-4926-8eb3-e5cb7abcaac0 service swift] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:33.374868 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb8283-6d26-4cea-81b5-a68e0256998c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00fd3c05cd8e4167946a1f567df2cc6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:33.375489 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb8283-6d26-4cea-81b5-a68e0256998c service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:33.375800 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb8283-6d26-4cea-81b5-a68e0256998c service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:33.376088 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb8283-6d26-4cea-81b5-a68e0256998c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:33.384294 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb8283-6d26-4cea-81b5-a68e0256998c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:33.386674 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb8283-6d26-4cea-81b5-a68e0256998c service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:33.394737 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1027/2064] 10.222.0.35 () {60 vars in 1384 bytes} [Tue Feb 8 16:43:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:43:33.714193 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5c0d3-0045-47b6-a885-d78c2d228f96 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:33.714478 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5c0d3-0045-47b6-a885-d78c2d228f96 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:33.714753 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5c0d3-0045-47b6-a885-d78c2d228f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:33.732333 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-7db5c0d3-0045-47b6-a885-d78c2d228f96 None None] MFA Rules not processed for user `9761863f36284bd4be1ce29c86b631cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:33.733494 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-7db5c0d3-0045-47b6-a885-d78c2d228f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:33.740422 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1038/2065] 10.222.0.35 () {58 vars in 967 bytes} [Tue Feb 8 16:43:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:33.753179 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb8283-6d26-4cea-81b5-a68e0256998c service swift] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:33.763733 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb8283-6d26-4cea-81b5-a68e0256998c service swift] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:33.768848 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050146b-fff5-4c43-8614-d75d15b91aa1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00fd3c05cd8e4167946a1f567df2cc6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:33.769446 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050146b-fff5-4c43-8614-d75d15b91aa1 service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:33.769736 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050146b-fff5-4c43-8614-d75d15b91aa1 service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:33.770017 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050146b-fff5-4c43-8614-d75d15b91aa1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:33.778322 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050146b-fff5-4c43-8614-d75d15b91aa1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:33.779922 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050146b-fff5-4c43-8614-d75d15b91aa1 service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:33.788048 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1028/2066] 10.222.0.35 () {60 vars in 1384 bytes} [Tue Feb 8 16:43:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 08 16:43:40.046421 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5c0d3-0045-47b6-a885-d78c2d228f96 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:40.047848 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-7db5c0d3-0045-47b6-a885-d78c2d228f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:40.061865 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5c0d3-0045-47b6-a885-d78c2d228f96 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:40.066257 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb829773-3dea-4977-acf8-b78c15de29e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:40.067104 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb829773-3dea-4977-acf8-b78c15de29e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:40.067381 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb829773-3dea-4977-acf8-b78c15de29e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:40.067653 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb829773-3dea-4977-acf8-b78c15de29e4 admin admin] PATH_INFO: `/v3/users/d82f340df87346cea3eb5a091d93d3ee` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:40.068901 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb829773-3dea-4977-acf8-b78c15de29e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d82f340df87346cea3eb5a091d93d3ee)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:40.070821 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb829773-3dea-4977-acf8-b78c15de29e4 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:40.113752 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-cb829773-3dea-4977-acf8-b78c15de29e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd82f340df87346cea3eb5a091d93d3ee'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:40.125245 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-cb829773-3dea-4977-acf8-b78c15de29e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd82f340df87346cea3eb5a091d93d3ee'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:40.131997 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-cb829773-3dea-4977-acf8-b78c15de29e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd82f340df87346cea3eb5a091d93d3ee'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:40.139906 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-cb829773-3dea-4977-acf8-b78c15de29e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd82f340df87346cea3eb5a091d93d3ee'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:40.140523 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-cb829773-3dea-4977-acf8-b78c15de29e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd82f340df87346cea3eb5a091d93d3ee'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:40.146368 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1039/2067] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:43:40 2022] DELETE /identity/v3/users/d82f340df87346cea3eb5a091d93d3ee => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:40.151422 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e30858-7ded-499e-852d-8ed518a26896 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:40.151981 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e30858-7ded-499e-852d-8ed518a26896 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:40.151981 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e30858-7ded-499e-852d-8ed518a26896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:40.170089 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-08e30858-7ded-499e-852d-8ed518a26896 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:40.171329 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-08e30858-7ded-499e-852d-8ed518a26896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:40.229053 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1029/2068] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:40.240284 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb829773-3dea-4977-acf8-b78c15de29e4 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:40.241744 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-cb829773-3dea-4977-acf8-b78c15de29e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:40.300709 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb829773-3dea-4977-acf8-b78c15de29e4 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:40.305474 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d29b31-8499-4d90-ad52-12ab3e2b590e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:40.306118 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d29b31-8499-4d90-ad52-12ab3e2b590e service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:40.306620 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d29b31-8499-4d90-ad52-12ab3e2b590e service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:40.307071 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d29b31-8499-4d90-ad52-12ab3e2b590e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:40.321669 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d29b31-8499-4d90-ad52-12ab3e2b590e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:40.323347 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d29b31-8499-4d90-ad52-12ab3e2b590e service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:40.342584 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1040/2069] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:43:40.511950 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e30858-7ded-499e-852d-8ed518a26896 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:40.513358 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-08e30858-7ded-499e-852d-8ed518a26896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:40.529940 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e30858-7ded-499e-852d-8ed518a26896 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:40.536407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a11ea-e574-41ae-818b-0de48674f4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:40.538457 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a11ea-e574-41ae-818b-0de48674f4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:40.539222 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a11ea-e574-41ae-818b-0de48674f4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:40.539498 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a11ea-e574-41ae-818b-0de48674f4ea admin admin] PATH_INFO: `/v3/projects/82109ab07882467bb75fe01c154fbbb5` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:40.540754 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a11ea-e574-41ae-818b-0de48674f4ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=82109ab07882467bb75fe01c154fbbb5)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:40.543203 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a11ea-e574-41ae-818b-0de48674f4ea admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:40.589748 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b54a11ea-e574-41ae-818b-0de48674f4ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82109ab07882467bb75fe01c154fbbb5', 'request_id': 'req-b54a11ea-e574-41ae-818b-0de48674f4ea'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:40.595682 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b54a11ea-e574-41ae-818b-0de48674f4ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82109ab07882467bb75fe01c154fbbb5', 'request_id': 'req-b54a11ea-e574-41ae-818b-0de48674f4ea'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:40.600908 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b54a11ea-e574-41ae-818b-0de48674f4ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82109ab07882467bb75fe01c154fbbb5', 'request_id': 'req-b54a11ea-e574-41ae-818b-0de48674f4ea'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:40.613399 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b54a11ea-e574-41ae-818b-0de48674f4ea admin admin] The token cache is being invalidate because project 82109ab07882467bb75fe01c154fbbb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:43:40.613686 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b54a11ea-e574-41ae-818b-0de48674f4ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:40.614317 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b54a11ea-e574-41ae-818b-0de48674f4ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:40.615864 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1030/2070] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:43:40 2022] DELETE /identity/v3/projects/82109ab07882467bb75fe01c154fbbb5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:40.622061 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430391-93ae-4d12-9aff-efced1af39a0 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:40.622350 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430391-93ae-4d12-9aff-efced1af39a0 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:40.622627 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430391-93ae-4d12-9aff-efced1af39a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:40.640819 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-fc430391-93ae-4d12-9aff-efced1af39a0 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:40.642124 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-fc430391-93ae-4d12-9aff-efced1af39a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:40.700169 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1041/2071] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:40.707800 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebc604-b26f-4ade-b7be-dec0182670d7 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:40.708094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebc604-b26f-4ade-b7be-dec0182670d7 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:40.708368 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebc604-b26f-4ade-b7be-dec0182670d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:40.727670 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-01ebc604-b26f-4ade-b7be-dec0182670d7 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:40.729437 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-01ebc604-b26f-4ade-b7be-dec0182670d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:40.737515 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1031/2072] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:40.741521 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc430391-93ae-4d12-9aff-efced1af39a0 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:40.751836 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc430391-93ae-4d12-9aff-efced1af39a0 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:40.756727 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee546f-8c6d-4f90-a277-476215dd8c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:40.757375 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee546f-8c6d-4f90-a277-476215dd8c46 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:40.757660 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee546f-8c6d-4f90-a277-476215dd8c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:40.757938 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee546f-8c6d-4f90-a277-476215dd8c46 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:40.758681 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee546f-8c6d-4f90-a277-476215dd8c46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:43:40.758987 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee546f-8c6d-4f90-a277-476215dd8c46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:40.760647 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee546f-8c6d-4f90-a277-476215dd8c46 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:40.772145 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1042/2073] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:43:40.776902 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebc604-b26f-4ade-b7be-dec0182670d7 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:40.785861 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebc604-b26f-4ade-b7be-dec0182670d7 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:40.791420 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc97153-9f4e-445c-a469-2d1c9dccb6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:40.792323 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc97153-9f4e-445c-a469-2d1c9dccb6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:40.792606 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc97153-9f4e-445c-a469-2d1c9dccb6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:40.792885 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc97153-9f4e-445c-a469-2d1c9dccb6d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:40.793656 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc97153-9f4e-445c-a469-2d1c9dccb6d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:40.795539 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc97153-9f4e-445c-a469-2d1c9dccb6d9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:40.820827 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1032/2074] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:43:40 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:43:40.824829 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee546f-8c6d-4f90-a277-476215dd8c46 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:40.834887 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee546f-8c6d-4f90-a277-476215dd8c46 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:40.894090 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60572f82-107e-4bd5-8d88-3b8be631e190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:40.894837 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60572f82-107e-4bd5-8d88-3b8be631e190 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:40.895303 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60572f82-107e-4bd5-8d88-3b8be631e190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:40.895775 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60572f82-107e-4bd5-8d88-3b8be631e190 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:40.896572 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60572f82-107e-4bd5-8d88-3b8be631e190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:40.898547 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60572f82-107e-4bd5-8d88-3b8be631e190 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:40.921649 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1043/2075] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:43:40 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:43:40.925869 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc97153-9f4e-445c-a469-2d1c9dccb6d9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:40.942019 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc97153-9f4e-445c-a469-2d1c9dccb6d9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:40.947794 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f4e49-4240-45a0-a3d0-dde4d020644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:40.948545 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f4e49-4240-45a0-a3d0-dde4d020644c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:40.948909 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f4e49-4240-45a0-a3d0-dde4d020644c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:40.949279 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f4e49-4240-45a0-a3d0-dde4d020644c admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:40.950030 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f4e49-4240-45a0-a3d0-dde4d020644c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:40.951625 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f4e49-4240-45a0-a3d0-dde4d020644c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:40.966063 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1033/2076] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:43:40.970037 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60572f82-107e-4bd5-8d88-3b8be631e190 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:40.982281 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60572f82-107e-4bd5-8d88-3b8be631e190 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:40.988117 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219c29e-00e7-4ec2-8110-0d349e9e5777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:40.988862 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219c29e-00e7-4ec2-8110-0d349e9e5777 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:40.989214 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219c29e-00e7-4ec2-8110-0d349e9e5777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:40.989564 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219c29e-00e7-4ec2-8110-0d349e9e5777 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:40.990393 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219c29e-00e7-4ec2-8110-0d349e9e5777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:40.992117 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219c29e-00e7-4ec2-8110-0d349e9e5777 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:41.005942 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1044/2077] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:43:41.010236 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f4e49-4240-45a0-a3d0-dde4d020644c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:41.021516 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f4e49-4240-45a0-a3d0-dde4d020644c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:41.029689 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d624e21-40a9-4445-8d65-f2a82a7096c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:41.030579 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d624e21-40a9-4445-8d65-f2a82a7096c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:41.030858 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d624e21-40a9-4445-8d65-f2a82a7096c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:41.031131 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d624e21-40a9-4445-8d65-f2a82a7096c0 admin admin] PATH_INFO: `/v3/projects/55220445da0d49ac8713e9036e8e6e06/users/2a7421e6184e497eb23bf9f87957322c/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:41.051205 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d624e21-40a9-4445-8d65-f2a82a7096c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55220445da0d49ac8713e9036e8e6e06, user_id=2a7421e6184e497eb23bf9f87957322c, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:41.055073 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d624e21-40a9-4445-8d65-f2a82a7096c0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:41.079484 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1034/2078] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:43:41 2022] PUT /identity/v3/projects/55220445da0d49ac8713e9036e8e6e06/users/2a7421e6184e497eb23bf9f87957322c/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:41.084099 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c8246-0db0-4920-835d-44a56a0418e5 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:41.084606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c8246-0db0-4920-835d-44a56a0418e5 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:41.084698 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c8246-0db0-4920-835d-44a56a0418e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:41.102918 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-047c8246-0db0-4920-835d-44a56a0418e5 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:41.104424 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-047c8246-0db0-4920-835d-44a56a0418e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:41.167026 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1045/2079] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:43:41.179431 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d624e21-40a9-4445-8d65-f2a82a7096c0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:41.182758 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0d624e21-40a9-4445-8d65-f2a82a7096c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:41.255088 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d624e21-40a9-4445-8d65-f2a82a7096c0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:41.259452 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d1b6c-faed-4019-9e64-165595d79ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:41.260509 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d1b6c-faed-4019-9e64-165595d79ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:41.260783 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d1b6c-faed-4019-9e64-165595d79ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:41.261244 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d1b6c-faed-4019-9e64-165595d79ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:41.279343 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d1b6c-faed-4019-9e64-165595d79ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:41.280919 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d1b6c-faed-4019-9e64-165595d79ad8 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:41.296312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1035/2080] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:43:42.127003 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0364a-6353-457c-bb36-83ce146251ef None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:42.127523 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0364a-6353-457c-bb36-83ce146251ef None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:42.127739 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0364a-6353-457c-bb36-83ce146251ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:42.160895 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-dca0364a-6353-457c-bb36-83ce146251ef None None] MFA Rules not processed for user `2a7421e6184e497eb23bf9f87957322c`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:42.162347 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-dca0364a-6353-457c-bb36-83ce146251ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:42.236525 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1046/2081] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:42.247924 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d1b6c-faed-4019-9e64-165595d79ad8 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:42.249522 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a05d1b6c-faed-4019-9e64-165595d79ad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:42.313807 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d1b6c-faed-4019-9e64-165595d79ad8 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:42.317790 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3ea44-50b9-4106-ac48-1939dab3e20f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:42.318433 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3ea44-50b9-4106-ac48-1939dab3e20f service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:42.318717 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3ea44-50b9-4106-ac48-1939dab3e20f service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:42.318995 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3ea44-50b9-4106-ac48-1939dab3e20f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:42.328114 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3ea44-50b9-4106-ac48-1939dab3e20f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:42.329536 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3ea44-50b9-4106-ac48-1939dab3e20f service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:42.338690 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1036/2082] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:43:43.677468 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648811a-9182-4f16-9ac4-247e8fb57bf8 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:43.678295 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648811a-9182-4f16-9ac4-247e8fb57bf8 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:43.678759 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648811a-9182-4f16-9ac4-247e8fb57bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:43.720006 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-0648811a-9182-4f16-9ac4-247e8fb57bf8 None None] MFA Rules not processed for user `2a7421e6184e497eb23bf9f87957322c`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:43.720006 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-0648811a-9182-4f16-9ac4-247e8fb57bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:43.727354 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1047/2083] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:44.690989 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3ea44-50b9-4106-ac48-1939dab3e20f service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:44.692750 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2cc3ea44-50b9-4106-ac48-1939dab3e20f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:44.716940 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3ea44-50b9-4106-ac48-1939dab3e20f service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:44.722532 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb86576-e0eb-4bbd-92c2-51810aceb56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:44.723557 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb86576-e0eb-4bbd-92c2-51810aceb56a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:44.724089 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb86576-e0eb-4bbd-92c2-51810aceb56a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:44.724503 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb86576-e0eb-4bbd-92c2-51810aceb56a admin admin] PATH_INFO: `/v3/users/556cfe2898d7413d8c0298bc4a0dcb76` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:44.727664 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb86576-e0eb-4bbd-92c2-51810aceb56a admin admin] RBAC: Authorizing `identity:delete_user(user_id=556cfe2898d7413d8c0298bc4a0dcb76)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:44.731920 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb86576-e0eb-4bbd-92c2-51810aceb56a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:44.792650 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3eb86576-e0eb-4bbd-92c2-51810aceb56a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '556cfe2898d7413d8c0298bc4a0dcb76'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:44.803648 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3eb86576-e0eb-4bbd-92c2-51810aceb56a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '556cfe2898d7413d8c0298bc4a0dcb76'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:44.817304 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3eb86576-e0eb-4bbd-92c2-51810aceb56a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '556cfe2898d7413d8c0298bc4a0dcb76'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:44.828818 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3eb86576-e0eb-4bbd-92c2-51810aceb56a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '556cfe2898d7413d8c0298bc4a0dcb76'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:44.829518 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3eb86576-e0eb-4bbd-92c2-51810aceb56a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '556cfe2898d7413d8c0298bc4a0dcb76'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:44.845124 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1037/2084] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:43:44 2022] DELETE /identity/v3/users/556cfe2898d7413d8c0298bc4a0dcb76 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:45.065950 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648811a-9182-4f16-9ac4-247e8fb57bf8 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:45.079137 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648811a-9182-4f16-9ac4-247e8fb57bf8 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:45.159670 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364919a2-a1bd-4d67-bf1a-50f517a91813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:45.160876 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364919a2-a1bd-4d67-bf1a-50f517a91813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:45.161153 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364919a2-a1bd-4d67-bf1a-50f517a91813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:45.161468 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364919a2-a1bd-4d67-bf1a-50f517a91813 admin admin] PATH_INFO: `/v3/projects/bdd3d5feed9748999a7c89e69e1bfef8` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:45.162875 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364919a2-a1bd-4d67-bf1a-50f517a91813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd3d5feed9748999a7c89e69e1bfef8)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:45.165059 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364919a2-a1bd-4d67-bf1a-50f517a91813 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:45.214642 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-364919a2-a1bd-4d67-bf1a-50f517a91813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd3d5feed9748999a7c89e69e1bfef8', 'request_id': 'req-364919a2-a1bd-4d67-bf1a-50f517a91813'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:45.220904 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-364919a2-a1bd-4d67-bf1a-50f517a91813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd3d5feed9748999a7c89e69e1bfef8', 'request_id': 'req-364919a2-a1bd-4d67-bf1a-50f517a91813'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:45.227801 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-364919a2-a1bd-4d67-bf1a-50f517a91813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd3d5feed9748999a7c89e69e1bfef8', 'request_id': 'req-364919a2-a1bd-4d67-bf1a-50f517a91813'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:45.240234 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-364919a2-a1bd-4d67-bf1a-50f517a91813 admin admin] The token cache is being invalidate because project bdd3d5feed9748999a7c89e69e1bfef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:43:45.240520 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-364919a2-a1bd-4d67-bf1a-50f517a91813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:45.241155 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-364919a2-a1bd-4d67-bf1a-50f517a91813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:45.243003 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1048/2085] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:43:45 2022] DELETE /identity/v3/projects/bdd3d5feed9748999a7c89e69e1bfef8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:45.246837 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb86576-e0eb-4bbd-92c2-51810aceb56a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:45.248351 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3eb86576-e0eb-4bbd-92c2-51810aceb56a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:45.265375 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb86576-e0eb-4bbd-92c2-51810aceb56a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:45.330223 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdae84f-448b-4110-a542-ad06a2dd4e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:45.331052 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdae84f-448b-4110-a542-ad06a2dd4e76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:45.331339 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdae84f-448b-4110-a542-ad06a2dd4e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:45.331615 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdae84f-448b-4110-a542-ad06a2dd4e76 admin admin] PATH_INFO: `/v3/users/590b11d6e1e6488cbacb5778f634c6fb` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:45.332845 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdae84f-448b-4110-a542-ad06a2dd4e76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=590b11d6e1e6488cbacb5778f634c6fb)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:45.334792 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdae84f-448b-4110-a542-ad06a2dd4e76 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:45.381115 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4fdae84f-448b-4110-a542-ad06a2dd4e76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '590b11d6e1e6488cbacb5778f634c6fb'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:45.388981 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4fdae84f-448b-4110-a542-ad06a2dd4e76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '590b11d6e1e6488cbacb5778f634c6fb'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:45.400517 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4fdae84f-448b-4110-a542-ad06a2dd4e76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '590b11d6e1e6488cbacb5778f634c6fb'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:45.407856 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4fdae84f-448b-4110-a542-ad06a2dd4e76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '590b11d6e1e6488cbacb5778f634c6fb'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:45.408646 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4fdae84f-448b-4110-a542-ad06a2dd4e76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '590b11d6e1e6488cbacb5778f634c6fb'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:45.414532 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1038/2086] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:43:45 2022] DELETE /identity/v3/users/590b11d6e1e6488cbacb5778f634c6fb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:45.580806 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364919a2-a1bd-4d67-bf1a-50f517a91813 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:45.582310 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-364919a2-a1bd-4d67-bf1a-50f517a91813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:45.596567 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364919a2-a1bd-4d67-bf1a-50f517a91813 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:45.623491 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdae84f-448b-4110-a542-ad06a2dd4e76 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:45.625055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4fdae84f-448b-4110-a542-ad06a2dd4e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:45.668659 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dff20-597b-4520-b168-d90269f67dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:45.669825 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dff20-597b-4520-b168-d90269f67dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:45.670261 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dff20-597b-4520-b168-d90269f67dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:45.670689 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dff20-597b-4520-b168-d90269f67dc0 admin admin] PATH_INFO: `/v3/projects/af1c56da97394a80af809d475615d45c` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:45.672517 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dff20-597b-4520-b168-d90269f67dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af1c56da97394a80af809d475615d45c)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:45.674909 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dff20-597b-4520-b168-d90269f67dc0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:45.715127 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdae84f-448b-4110-a542-ad06a2dd4e76 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:45.721686 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ff2ba-1e1d-42ca-943e-abdcf0bcd484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:45.722805 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ff2ba-1e1d-42ca-943e-abdcf0bcd484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:45.723140 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ff2ba-1e1d-42ca-943e-abdcf0bcd484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:45.723500 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ff2ba-1e1d-42ca-943e-abdcf0bcd484 admin admin] PATH_INFO: `/v3/users/3b659dbcbb0c48c09d2d362f1385a45e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:45.724797 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ff2ba-1e1d-42ca-943e-abdcf0bcd484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b659dbcbb0c48c09d2d362f1385a45e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:45.726926 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ff2ba-1e1d-42ca-943e-abdcf0bcd484 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:45.757989 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-3c3dff20-597b-4520-b168-d90269f67dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af1c56da97394a80af809d475615d45c', 'request_id': 'req-3c3dff20-597b-4520-b168-d90269f67dc0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:45.766742 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-3c3dff20-597b-4520-b168-d90269f67dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af1c56da97394a80af809d475615d45c', 'request_id': 'req-3c3dff20-597b-4520-b168-d90269f67dc0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:45.773047 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-3c3dff20-597b-4520-b168-d90269f67dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af1c56da97394a80af809d475615d45c', 'request_id': 'req-3c3dff20-597b-4520-b168-d90269f67dc0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:45.788065 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-3c3dff20-597b-4520-b168-d90269f67dc0 admin admin] The token cache is being invalidate because project af1c56da97394a80af809d475615d45c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:43:45.788438 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-3c3dff20-597b-4520-b168-d90269f67dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:45.789154 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-3c3dff20-597b-4520-b168-d90269f67dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:45.791668 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-643ff2ba-1e1d-42ca-943e-abdcf0bcd484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b659dbcbb0c48c09d2d362f1385a45e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:45.792475 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1049/2087] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:43:45 2022] DELETE /identity/v3/projects/af1c56da97394a80af809d475615d45c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:45.799812 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-643ff2ba-1e1d-42ca-943e-abdcf0bcd484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b659dbcbb0c48c09d2d362f1385a45e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:45.800375 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be6bee-c4f3-4a83-8206-3792bec4db33 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:45.800662 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be6bee-c4f3-4a83-8206-3792bec4db33 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:45.800938 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be6bee-c4f3-4a83-8206-3792bec4db33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:45.814355 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-643ff2ba-1e1d-42ca-943e-abdcf0bcd484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b659dbcbb0c48c09d2d362f1385a45e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:45.825802 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-643ff2ba-1e1d-42ca-943e-abdcf0bcd484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b659dbcbb0c48c09d2d362f1385a45e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:45.826490 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-a5be6bee-c4f3-4a83-8206-3792bec4db33 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:45.827010 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-643ff2ba-1e1d-42ca-943e-abdcf0bcd484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b659dbcbb0c48c09d2d362f1385a45e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:45.828063 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a5be6bee-c4f3-4a83-8206-3792bec4db33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:45.836019 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1039/2088] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:43:45 2022] DELETE /identity/v3/users/3b659dbcbb0c48c09d2d362f1385a45e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:43:45.841700 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19a1c3-6f50-4678-99d5-77ddfcb1ce40 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:45.842043 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19a1c3-6f50-4678-99d5-77ddfcb1ce40 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:45.842333 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19a1c3-6f50-4678-99d5-77ddfcb1ce40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:45.860718 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-0c19a1c3-6f50-4678-99d5-77ddfcb1ce40 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:45.864819 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0c19a1c3-6f50-4678-99d5-77ddfcb1ce40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:45.904682 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1050/2089] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:45.913273 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702b586-4b8f-40bd-97a5-223ee2855ac0 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:45.913617 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702b586-4b8f-40bd-97a5-223ee2855ac0 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:45.913905 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702b586-4b8f-40bd-97a5-223ee2855ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:45.932798 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-2702b586-4b8f-40bd-97a5-223ee2855ac0 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:45.934002 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-2702b586-4b8f-40bd-97a5-223ee2855ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:45.949867 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1040/2090] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:45.960057 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19a1c3-6f50-4678-99d5-77ddfcb1ce40 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:45.961990 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0c19a1c3-6f50-4678-99d5-77ddfcb1ce40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:46.009800 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1051/2091] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:43:46.013558 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702b586-4b8f-40bd-97a5-223ee2855ac0 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:46.015239 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-2702b586-4b8f-40bd-97a5-223ee2855ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:46.029345 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702b586-4b8f-40bd-97a5-223ee2855ac0 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:46.033042 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19a1c3-6f50-4678-99d5-77ddfcb1ce40 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:46.035046 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e92d6-2aea-486a-aa71-479319581080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:46.036498 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e92d6-2aea-486a-aa71-479319581080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:46.036873 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e92d6-2aea-486a-aa71-479319581080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:46.037363 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ef223-e3dc-46b6-b9a6-910943e176ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:46.037609 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e92d6-2aea-486a-aa71-479319581080 admin admin] PATH_INFO: `/v3/users/86b550ccc85f470294e9df790c2cf7b6` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:46.037827 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ef223-e3dc-46b6-b9a6-910943e176ba service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:46.038114 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ef223-e3dc-46b6-b9a6-910943e176ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:46.038392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ef223-e3dc-46b6-b9a6-910943e176ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:46.039804 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e92d6-2aea-486a-aa71-479319581080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86b550ccc85f470294e9df790c2cf7b6)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:46.042669 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e92d6-2aea-486a-aa71-479319581080 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:46.050808 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ef223-e3dc-46b6-b9a6-910943e176ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:46.052582 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ef223-e3dc-46b6-b9a6-910943e176ba service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:46.063810 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1041/2092] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:43:46.064711 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ef223-e3dc-46b6-b9a6-910943e176ba service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:46.086114 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ef223-e3dc-46b6-b9a6-910943e176ba service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:46.093908 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a932ff-276c-4df0-9232-550f742433b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:46.094815 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a932ff-276c-4df0-9232-550f742433b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:46.095366 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a932ff-276c-4df0-9232-550f742433b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:46.095647 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a932ff-276c-4df0-9232-550f742433b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:46.096607 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a932ff-276c-4df0-9232-550f742433b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:43:46.096974 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a932ff-276c-4df0-9232-550f742433b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:46.100013 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a932ff-276c-4df0-9232-550f742433b0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:46.127654 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1042/2093] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:43:46.128782 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a932ff-276c-4df0-9232-550f742433b0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:46.131095 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c46e92d6-2aea-486a-aa71-479319581080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86b550ccc85f470294e9df790c2cf7b6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:46.141858 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a932ff-276c-4df0-9232-550f742433b0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:46.147388 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dcd49-5cd7-465c-8ce1-82e002a1e366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:46.148150 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dcd49-5cd7-465c-8ce1-82e002a1e366 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:46.148434 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dcd49-5cd7-465c-8ce1-82e002a1e366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:46.148903 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dcd49-5cd7-465c-8ce1-82e002a1e366 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:46.149514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5dcd49-5cd7-465c-8ce1-82e002a1e366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:46.151972 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5dcd49-5cd7-465c-8ce1-82e002a1e366 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:46.175953 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c46e92d6-2aea-486a-aa71-479319581080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86b550ccc85f470294e9df790c2cf7b6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:46.197979 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c46e92d6-2aea-486a-aa71-479319581080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86b550ccc85f470294e9df790c2cf7b6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:46.198179 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1043/2094] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:43:46 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:43:46.199708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dcd49-5cd7-465c-8ce1-82e002a1e366 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:46.214401 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c46e92d6-2aea-486a-aa71-479319581080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86b550ccc85f470294e9df790c2cf7b6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:46.216254 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c46e92d6-2aea-486a-aa71-479319581080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86b550ccc85f470294e9df790c2cf7b6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:46.226240 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1052/2095] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:43:46 2022] DELETE /identity/v3/users/86b550ccc85f470294e9df790c2cf7b6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:46.231222 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf31d70-5f80-4e60-9326-99212850b40c None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:46.231977 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf31d70-5f80-4e60-9326-99212850b40c None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:46.232471 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf31d70-5f80-4e60-9326-99212850b40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:46.251212 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-7bf31d70-5f80-4e60-9326-99212850b40c None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:46.252491 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-7bf31d70-5f80-4e60-9326-99212850b40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:46.284240 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dcd49-5cd7-465c-8ce1-82e002a1e366 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:46.364425 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1053/2096] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:46.376528 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf31d70-5f80-4e60-9326-99212850b40c None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:46.379271 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-7bf31d70-5f80-4e60-9326-99212850b40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:46.389567 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd547a-2462-4ae5-88e4-d1a56aa8bc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:46.390254 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd547a-2462-4ae5-88e4-d1a56aa8bc01 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:46.390538 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd547a-2462-4ae5-88e4-d1a56aa8bc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:46.391006 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd547a-2462-4ae5-88e4-d1a56aa8bc01 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:46.391524 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd547a-2462-4ae5-88e4-d1a56aa8bc01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:46.393527 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd547a-2462-4ae5-88e4-d1a56aa8bc01 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:46.424566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1044/2097] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:43:46 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:43:46.428738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd547a-2462-4ae5-88e4-d1a56aa8bc01 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:46.431356 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-13bd547a-2462-4ae5-88e4-d1a56aa8bc01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:46.448674 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd547a-2462-4ae5-88e4-d1a56aa8bc01 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:46.455552 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce0a4d-5456-438f-adf4-ffb382cbe214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:46.456392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce0a4d-5456-438f-adf4-ffb382cbe214 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:46.456822 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce0a4d-5456-438f-adf4-ffb382cbe214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:46.457200 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce0a4d-5456-438f-adf4-ffb382cbe214 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:46.458227 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce0a4d-5456-438f-adf4-ffb382cbe214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:46.461710 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce0a4d-5456-438f-adf4-ffb382cbe214 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:46.467038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf31d70-5f80-4e60-9326-99212850b40c None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:46.473276 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3c460-113c-4759-ab77-94c7d198bbaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:46.473992 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3c460-113c-4759-ab77-94c7d198bbaf service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:46.474274 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3c460-113c-4759-ab77-94c7d198bbaf service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:46.474544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3c460-113c-4759-ab77-94c7d198bbaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:46.476208 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1045/2098] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:43:46.480065 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce0a4d-5456-438f-adf4-ffb382cbe214 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:46.487597 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3c460-113c-4759-ab77-94c7d198bbaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:46.489878 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3c460-113c-4759-ab77-94c7d198bbaf service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:46.494285 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce0a4d-5456-438f-adf4-ffb382cbe214 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:46.501698 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946fe17-049e-4a94-afd4-2ddcb610fd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:46.502531 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946fe17-049e-4a94-afd4-2ddcb610fd33 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:46.502814 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946fe17-049e-4a94-afd4-2ddcb610fd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:46.503087 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946fe17-049e-4a94-afd4-2ddcb610fd33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:46.503854 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946fe17-049e-4a94-afd4-2ddcb610fd33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:46.505822 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946fe17-049e-4a94-afd4-2ddcb610fd33 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:46.506843 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1054/2099] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:43:46.517100 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1046/2100] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:43:46.521040 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3c460-113c-4759-ab77-94c7d198bbaf service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:46.531353 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3c460-113c-4759-ab77-94c7d198bbaf service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:46.537564 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4793a02-6507-44bd-9940-5a57b703d56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:46.538443 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4793a02-6507-44bd-9940-5a57b703d56a admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:46.538720 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4793a02-6507-44bd-9940-5a57b703d56a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:46.538990 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4793a02-6507-44bd-9940-5a57b703d56a admin admin] PATH_INFO: `/v3/projects/e7290649118b432aa2413ab2b57cb0e2/users/1523800740ee44c5a753f546f49be9ce/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:46.554778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4793a02-6507-44bd-9940-5a57b703d56a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7290649118b432aa2413ab2b57cb0e2, user_id=1523800740ee44c5a753f546f49be9ce, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:46.557643 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4793a02-6507-44bd-9940-5a57b703d56a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:46.574161 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1055/2101] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:43:46 2022] PUT /identity/v3/projects/e7290649118b432aa2413ab2b57cb0e2/users/1523800740ee44c5a753f546f49be9ce/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:43:46.584311 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f3c05-e05d-40a8-915b-3c7171307936 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:46.584591 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f3c05-e05d-40a8-915b-3c7171307936 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:46.584924 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f3c05-e05d-40a8-915b-3c7171307936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:46.637823 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-8a8f3c05-e05d-40a8-915b-3c7171307936 None None] MFA Rules not processed for user `1523800740ee44c5a753f546f49be9ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:46.639310 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-8a8f3c05-e05d-40a8-915b-3c7171307936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:46.672438 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4793a02-6507-44bd-9940-5a57b703d56a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:46.674394 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-e4793a02-6507-44bd-9940-5a57b703d56a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:46.767514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1047/2102] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:46.779628 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f3c05-e05d-40a8-915b-3c7171307936 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:46.781435 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-8a8f3c05-e05d-40a8-915b-3c7171307936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:46.792968 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4793a02-6507-44bd-9940-5a57b703d56a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:46.800191 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f936e-ceaa-41aa-b6bf-d575691b05b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:46.801295 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f936e-ceaa-41aa-b6bf-d575691b05b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:46.802444 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f936e-ceaa-41aa-b6bf-d575691b05b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:46.802879 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f936e-ceaa-41aa-b6bf-d575691b05b1 admin admin] PATH_INFO: `/v3/projects/cbc4338cbbb243d284245804faa793df` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:46.804807 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f936e-ceaa-41aa-b6bf-d575691b05b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc4338cbbb243d284245804faa793df)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:46.807511 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f936e-ceaa-41aa-b6bf-d575691b05b1 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:46.848804 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f3c05-e05d-40a8-915b-3c7171307936 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:46.853811 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a7926-afc3-49a0-b8cb-613b0f28a84a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:46.854566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a7926-afc3-49a0-b8cb-613b0f28a84a service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:46.854990 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a7926-afc3-49a0-b8cb-613b0f28a84a service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:46.855395 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a7926-afc3-49a0-b8cb-613b0f28a84a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:46.867111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a7926-afc3-49a0-b8cb-613b0f28a84a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:46.869487 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a7926-afc3-49a0-b8cb-613b0f28a84a service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:46.870837 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-1b6f936e-ceaa-41aa-b6bf-d575691b05b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc4338cbbb243d284245804faa793df', 'request_id': 'req-1b6f936e-ceaa-41aa-b6bf-d575691b05b1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:46.880348 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-1b6f936e-ceaa-41aa-b6bf-d575691b05b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc4338cbbb243d284245804faa793df', 'request_id': 'req-1b6f936e-ceaa-41aa-b6bf-d575691b05b1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:46.881542 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1048/2103] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:43:46.888386 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-1b6f936e-ceaa-41aa-b6bf-d575691b05b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc4338cbbb243d284245804faa793df', 'request_id': 'req-1b6f936e-ceaa-41aa-b6bf-d575691b05b1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:46.908033 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-1b6f936e-ceaa-41aa-b6bf-d575691b05b1 admin admin] The token cache is being invalidate because project cbc4338cbbb243d284245804faa793df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:43:46.908620 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-1b6f936e-ceaa-41aa-b6bf-d575691b05b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:46.909465 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-1b6f936e-ceaa-41aa-b6bf-d575691b05b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:46.911546 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1056/2104] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:43:46 2022] DELETE /identity/v3/projects/cbc4338cbbb243d284245804faa793df => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:46.918342 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1460ec-2902-411d-b4b1-c3935c7a8dbb None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:46.918840 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1460ec-2902-411d-b4b1-c3935c7a8dbb None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:46.919334 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1460ec-2902-411d-b4b1-c3935c7a8dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:46.944440 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-9a1460ec-2902-411d-b4b1-c3935c7a8dbb None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:46.947680 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9a1460ec-2902-411d-b4b1-c3935c7a8dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:47.045877 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1049/2105] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:43:47.054819 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b91cf0-4e71-497c-926e-46697d04c5f7 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:47.055279 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b91cf0-4e71-497c-926e-46697d04c5f7 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:47.056949 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b91cf0-4e71-497c-926e-46697d04c5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:47.086868 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-21b91cf0-4e71-497c-926e-46697d04c5f7 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:47.090057 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-21b91cf0-4e71-497c-926e-46697d04c5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:47.105997 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1057/2106] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:47.107580 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1460ec-2902-411d-b4b1-c3935c7a8dbb None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:47.122153 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1460ec-2902-411d-b4b1-c3935c7a8dbb None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:47.138763 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f221c2-0b48-45fe-9b40-c25621bd4d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:47.140299 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f221c2-0b48-45fe-9b40-c25621bd4d37 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:47.140904 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f221c2-0b48-45fe-9b40-c25621bd4d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:47.141394 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f221c2-0b48-45fe-9b40-c25621bd4d37 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:47.142623 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f221c2-0b48-45fe-9b40-c25621bd4d37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:43:47.143286 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f221c2-0b48-45fe-9b40-c25621bd4d37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:47.145336 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f221c2-0b48-45fe-9b40-c25621bd4d37 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:47.163089 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1050/2107] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:43:47.164081 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b91cf0-4e71-497c-926e-46697d04c5f7 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:47.174539 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b91cf0-4e71-497c-926e-46697d04c5f7 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:47.180365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc3e54-0769-4282-83b8-00fcaf2b8156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:47.180951 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc3e54-0769-4282-83b8-00fcaf2b8156 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:47.181432 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc3e54-0769-4282-83b8-00fcaf2b8156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:47.181970 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc3e54-0769-4282-83b8-00fcaf2b8156 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:47.182963 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc3e54-0769-4282-83b8-00fcaf2b8156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:47.186020 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc3e54-0769-4282-83b8-00fcaf2b8156 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:47.242676 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1058/2108] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:43:47 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:43:47.247528 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f221c2-0b48-45fe-9b40-c25621bd4d37 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:47.260693 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f221c2-0b48-45fe-9b40-c25621bd4d37 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:47.373996 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc3e54-0769-4282-83b8-00fcaf2b8156 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:47.378251 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-88bc3e54-0769-4282-83b8-00fcaf2b8156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:47.381009 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674781ab-2089-47ea-9ebe-2f51dae0f87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:47.381792 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674781ab-2089-47ea-9ebe-2f51dae0f87d admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:47.382166 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674781ab-2089-47ea-9ebe-2f51dae0f87d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:47.389289 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674781ab-2089-47ea-9ebe-2f51dae0f87d admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:47.390129 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674781ab-2089-47ea-9ebe-2f51dae0f87d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:47.392644 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674781ab-2089-47ea-9ebe-2f51dae0f87d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:47.411076 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc3e54-0769-4282-83b8-00fcaf2b8156 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:47.419376 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b4f12-89fa-4798-8b73-7eb3ef6d1bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:47.421081 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b4f12-89fa-4798-8b73-7eb3ef6d1bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:47.421474 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b4f12-89fa-4798-8b73-7eb3ef6d1bef admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:47.422290 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b4f12-89fa-4798-8b73-7eb3ef6d1bef admin admin] PATH_INFO: `/v3/projects/b859a738020949f9b8a32e68b517988d` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:47.423405 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b4f12-89fa-4798-8b73-7eb3ef6d1bef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b859a738020949f9b8a32e68b517988d)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:47.426712 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b4f12-89fa-4798-8b73-7eb3ef6d1bef admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:47.438950 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1051/2109] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:43:47 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:43:47.440085 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674781ab-2089-47ea-9ebe-2f51dae0f87d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:47.450772 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674781ab-2089-47ea-9ebe-2f51dae0f87d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:47.456610 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90805893-7824-4673-b5de-6900d2bfa4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:47.457353 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90805893-7824-4673-b5de-6900d2bfa4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:47.458039 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90805893-7824-4673-b5de-6900d2bfa4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:47.458435 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90805893-7824-4673-b5de-6900d2bfa4d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:47.459266 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90805893-7824-4673-b5de-6900d2bfa4d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:47.461395 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90805893-7824-4673-b5de-6900d2bfa4d1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:47.472767 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1052/2110] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:43:47.477173 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90805893-7824-4673-b5de-6900d2bfa4d1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:47.486846 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-dd7b4f12-89fa-4798-8b73-7eb3ef6d1bef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b859a738020949f9b8a32e68b517988d', 'request_id': 'req-dd7b4f12-89fa-4798-8b73-7eb3ef6d1bef'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:47.488168 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90805893-7824-4673-b5de-6900d2bfa4d1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:47.495059 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-dd7b4f12-89fa-4798-8b73-7eb3ef6d1bef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b859a738020949f9b8a32e68b517988d', 'request_id': 'req-dd7b4f12-89fa-4798-8b73-7eb3ef6d1bef'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:47.501129 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-dd7b4f12-89fa-4798-8b73-7eb3ef6d1bef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b859a738020949f9b8a32e68b517988d', 'request_id': 'req-dd7b4f12-89fa-4798-8b73-7eb3ef6d1bef'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:47.515349 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-dd7b4f12-89fa-4798-8b73-7eb3ef6d1bef admin admin] The token cache is being invalidate because project b859a738020949f9b8a32e68b517988d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:43:47.515638 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-dd7b4f12-89fa-4798-8b73-7eb3ef6d1bef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:47.516326 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-dd7b4f12-89fa-4798-8b73-7eb3ef6d1bef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:47.517943 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1059/2111] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:43:47 2022] DELETE /identity/v3/projects/b859a738020949f9b8a32e68b517988d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:47.524485 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485496c7-bcf7-4c6f-b312-6034ddec44ac None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:47.524778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485496c7-bcf7-4c6f-b312-6034ddec44ac None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:47.525112 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485496c7-bcf7-4c6f-b312-6034ddec44ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:47.545767 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-485496c7-bcf7-4c6f-b312-6034ddec44ac None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:47.547167 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-485496c7-bcf7-4c6f-b312-6034ddec44ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:47.559901 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80371d-abc4-44b5-a4fc-5bc5c40b2038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:47.561095 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80371d-abc4-44b5-a4fc-5bc5c40b2038 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:47.561581 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80371d-abc4-44b5-a4fc-5bc5c40b2038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:47.561866 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80371d-abc4-44b5-a4fc-5bc5c40b2038 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:47.563678 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80371d-abc4-44b5-a4fc-5bc5c40b2038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:47.565636 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80371d-abc4-44b5-a4fc-5bc5c40b2038 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:47.581458 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1053/2112] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:43:47.585867 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80371d-abc4-44b5-a4fc-5bc5c40b2038 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:47.588759 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-bc80371d-abc4-44b5-a4fc-5bc5c40b2038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:47.603389 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80371d-abc4-44b5-a4fc-5bc5c40b2038 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:47.610910 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518c4cf-dc83-4d1e-bfdd-72b3251c6de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:47.611904 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518c4cf-dc83-4d1e-bfdd-72b3251c6de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:47.612195 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518c4cf-dc83-4d1e-bfdd-72b3251c6de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:47.612551 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518c4cf-dc83-4d1e-bfdd-72b3251c6de6 admin admin] PATH_INFO: `/v3/projects/2127908cbfd54932803d0c689b6d3ea8/users/08ac02b031794b4190eec55f87e9e7cc/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:47.629350 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518c4cf-dc83-4d1e-bfdd-72b3251c6de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2127908cbfd54932803d0c689b6d3ea8, user_id=08ac02b031794b4190eec55f87e9e7cc, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:47.632363 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518c4cf-dc83-4d1e-bfdd-72b3251c6de6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:47.652193 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1060/2113] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:43:47.657525 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72e199-54e1-4243-a2e6-917432d6a2d5 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:47.657867 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72e199-54e1-4243-a2e6-917432d6a2d5 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:47.658186 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72e199-54e1-4243-a2e6-917432d6a2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:47.664622 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1054/2114] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:43:47 2022] PUT /identity/v3/projects/2127908cbfd54932803d0c689b6d3ea8/users/08ac02b031794b4190eec55f87e9e7cc/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:47.675311 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e356e38-078b-48ad-a24a-6588bb221b09 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:47.675596 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e356e38-078b-48ad-a24a-6588bb221b09 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:47.675896 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e356e38-078b-48ad-a24a-6588bb221b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:47.685031 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-fb72e199-54e1-4243-a2e6-917432d6a2d5 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:47.686344 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-fb72e199-54e1-4243-a2e6-917432d6a2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:47.717235 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-5e356e38-078b-48ad-a24a-6588bb221b09 None None] MFA Rules not processed for user `08ac02b031794b4190eec55f87e9e7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:47.718625 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5e356e38-078b-48ad-a24a-6588bb221b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:47.773547 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1061/2115] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:47.778228 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72e199-54e1-4243-a2e6-917432d6a2d5 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:47.794234 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72e199-54e1-4243-a2e6-917432d6a2d5 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:47.794889 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1055/2116] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:43:47.799280 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013ec88-a078-438c-8ab3-9a12113f6cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:47.800132 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013ec88-a078-438c-8ab3-9a12113f6cab admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:47.800415 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013ec88-a078-438c-8ab3-9a12113f6cab admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:47.800695 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013ec88-a078-438c-8ab3-9a12113f6cab admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:47.801504 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013ec88-a078-438c-8ab3-9a12113f6cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:43:47.802073 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013ec88-a078-438c-8ab3-9a12113f6cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:47.803632 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013ec88-a078-438c-8ab3-9a12113f6cab admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:47.808311 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e356e38-078b-48ad-a24a-6588bb221b09 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:47.810397 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5e356e38-078b-48ad-a24a-6588bb221b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:47.818713 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1062/2117] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:43:47.823161 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013ec88-a078-438c-8ab3-9a12113f6cab admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:47.833849 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013ec88-a078-438c-8ab3-9a12113f6cab admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:47.844078 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cd4ca-9d29-408e-bc2e-a8d7fcb916d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:47.851248 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cd4ca-9d29-408e-bc2e-a8d7fcb916d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:47.851622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cd4ca-9d29-408e-bc2e-a8d7fcb916d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:47.852356 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cd4ca-9d29-408e-bc2e-a8d7fcb916d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:47.852812 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cd4ca-9d29-408e-bc2e-a8d7fcb916d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:47.855044 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cd4ca-9d29-408e-bc2e-a8d7fcb916d1 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:47.886185 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e356e38-078b-48ad-a24a-6588bb221b09 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:47.891209 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba61d2c-2aa4-4c1f-ae26-775913d082a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:47.891998 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba61d2c-2aa4-4c1f-ae26-775913d082a3 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:47.892353 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba61d2c-2aa4-4c1f-ae26-775913d082a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:47.892699 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba61d2c-2aa4-4c1f-ae26-775913d082a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:47.895543 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1063/2118] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:43:47 2022] POST /identity/v3/projects => generated 361 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:43:47.899251 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cd4ca-9d29-408e-bc2e-a8d7fcb916d1 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:47.902523 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba61d2c-2aa4-4c1f-ae26-775913d082a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:47.904005 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba61d2c-2aa4-4c1f-ae26-775913d082a3 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:47.913191 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1056/2119] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:43:47.942422 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba61d2c-2aa4-4c1f-ae26-775913d082a3 service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:47.953614 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba61d2c-2aa4-4c1f-ae26-775913d082a3 service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:47.969141 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cd4ca-9d29-408e-bc2e-a8d7fcb916d1 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:47.976233 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a58410-b94c-4f08-bfe2-6f1bceacc33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:47.977188 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a58410-b94c-4f08-bfe2-6f1bceacc33c admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:47.977475 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a58410-b94c-4f08-bfe2-6f1bceacc33c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:47.977753 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a58410-b94c-4f08-bfe2-6f1bceacc33c admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:47.978512 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a58410-b94c-4f08-bfe2-6f1bceacc33c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:47.980971 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a58410-b94c-4f08-bfe2-6f1bceacc33c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:48.004403 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1064/2120] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:43:47 2022] POST /identity/v3/users => generated 281 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:43:48.008343 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a58410-b94c-4f08-bfe2-6f1bceacc33c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:48.013299 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6faf506-5d6d-4d89-b105-4b2d909f1d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:48.014164 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6faf506-5d6d-4d89-b105-4b2d909f1d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:48.014447 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6faf506-5d6d-4d89-b105-4b2d909f1d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:48.014721 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6faf506-5d6d-4d89-b105-4b2d909f1d41 admin admin] PATH_INFO: `/v3/users/08ac02b031794b4190eec55f87e9e7cc` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:48.015993 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6faf506-5d6d-4d89-b105-4b2d909f1d41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08ac02b031794b4190eec55f87e9e7cc)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:48.017909 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6faf506-5d6d-4d89-b105-4b2d909f1d41 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:48.019218 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a58410-b94c-4f08-bfe2-6f1bceacc33c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:48.024614 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5eeee4-9b2d-4053-a68b-a3e62c84f83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:48.025539 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eeee4-9b2d-4053-a68b-a3e62c84f83f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:48.025974 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eeee4-9b2d-4053-a68b-a3e62c84f83f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:48.026299 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eeee4-9b2d-4053-a68b-a3e62c84f83f admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:48.027056 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5eeee4-9b2d-4053-a68b-a3e62c84f83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:48.028696 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5eeee4-9b2d-4053-a68b-a3e62c84f83f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:48.039425 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1065/2121] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:43:48.043939 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5eeee4-9b2d-4053-a68b-a3e62c84f83f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:48.054895 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5eeee4-9b2d-4053-a68b-a3e62c84f83f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:48.061314 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe12b65-faee-408d-b9be-bd728af6f8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:48.062052 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe12b65-faee-408d-b9be-bd728af6f8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:48.062296 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe12b65-faee-408d-b9be-bd728af6f8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:48.062570 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe12b65-faee-408d-b9be-bd728af6f8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:48.063306 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe12b65-faee-408d-b9be-bd728af6f8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:48.064927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe12b65-faee-408d-b9be-bd728af6f8e8 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:48.077515 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e6faf506-5d6d-4d89-b105-4b2d909f1d41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08ac02b031794b4190eec55f87e9e7cc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:48.081208 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1066/2122] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:43:48.082403 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe12b65-faee-408d-b9be-bd728af6f8e8 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:48.085489 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e6faf506-5d6d-4d89-b105-4b2d909f1d41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08ac02b031794b4190eec55f87e9e7cc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:48.095294 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe12b65-faee-408d-b9be-bd728af6f8e8 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:48.100084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e6faf506-5d6d-4d89-b105-4b2d909f1d41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08ac02b031794b4190eec55f87e9e7cc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:48.106507 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f741d24-40e5-4bb4-921e-579106fe2be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:48.108483 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e6faf506-5d6d-4d89-b105-4b2d909f1d41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08ac02b031794b4190eec55f87e9e7cc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:48.108776 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f741d24-40e5-4bb4-921e-579106fe2be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:48.109059 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f741d24-40e5-4bb4-921e-579106fe2be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:48.109163 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e6faf506-5d6d-4d89-b105-4b2d909f1d41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08ac02b031794b4190eec55f87e9e7cc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:48.109375 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f741d24-40e5-4bb4-921e-579106fe2be3 admin admin] PATH_INFO: `/v3/projects/620de5af998947bda2ad875d000e23ba/users/33a199287fec429ca10c783500d7227a/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:48.115342 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1057/2123] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:43:47 2022] DELETE /identity/v3/users/08ac02b031794b4190eec55f87e9e7cc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:43:48.121459 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049f517-9d86-4c81-82a4-e38f996cf264 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:48.121757 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049f517-9d86-4c81-82a4-e38f996cf264 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:48.122033 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049f517-9d86-4c81-82a4-e38f996cf264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:48.126158 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f741d24-40e5-4bb4-921e-579106fe2be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=620de5af998947bda2ad875d000e23ba, user_id=33a199287fec429ca10c783500d7227a, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:48.128916 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f741d24-40e5-4bb4-921e-579106fe2be3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:48.143846 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-6049f517-9d86-4c81-82a4-e38f996cf264 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:48.145272 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6049f517-9d86-4c81-82a4-e38f996cf264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:48.148306 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1067/2124] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:43:48 2022] PUT /identity/v3/projects/620de5af998947bda2ad875d000e23ba/users/33a199287fec429ca10c783500d7227a/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:48.158745 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001fc07-a274-449f-96fc-287e3ad71774 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:48.158991 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001fc07-a274-449f-96fc-287e3ad71774 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:48.159274 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001fc07-a274-449f-96fc-287e3ad71774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:48.189953 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-f001fc07-a274-449f-96fc-287e3ad71774 None None] MFA Rules not processed for user `33a199287fec429ca10c783500d7227a`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:48.191910 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-f001fc07-a274-449f-96fc-287e3ad71774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:48.222989 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1058/2125] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:48.233623 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049f517-9d86-4c81-82a4-e38f996cf264 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:48.235248 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6049f517-9d86-4c81-82a4-e38f996cf264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:48.266506 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1068/2126] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:43:48.303017 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001fc07-a274-449f-96fc-287e3ad71774 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:48.304927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-f001fc07-a274-449f-96fc-287e3ad71774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:48.358778 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049f517-9d86-4c81-82a4-e38f996cf264 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:48.364767 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990416fc-1d7d-4467-8791-3686c7311e75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:48.365146 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990416fc-1d7d-4467-8791-3686c7311e75 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:48.365500 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990416fc-1d7d-4467-8791-3686c7311e75 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:48.365777 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990416fc-1d7d-4467-8791-3686c7311e75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:48.390115 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990416fc-1d7d-4467-8791-3686c7311e75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:48.391865 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990416fc-1d7d-4467-8791-3686c7311e75 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:48.407596 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1059/2127] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:43:48.426464 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001fc07-a274-449f-96fc-287e3ad71774 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:48.432934 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddc086-f915-4359-a560-4717a79ee0ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:48.433833 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddc086-f915-4359-a560-4717a79ee0ed service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:48.434636 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddc086-f915-4359-a560-4717a79ee0ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:48.435301 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddc086-f915-4359-a560-4717a79ee0ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:48.474872 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddc086-f915-4359-a560-4717a79ee0ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:48.477868 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddc086-f915-4359-a560-4717a79ee0ed service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:48.492275 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1069/2128] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:43:48.508945 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990416fc-1d7d-4467-8791-3686c7311e75 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:48.511391 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-990416fc-1d7d-4467-8791-3686c7311e75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:48.525538 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990416fc-1d7d-4467-8791-3686c7311e75 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:48.533270 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95912694-3457-4cae-9cdf-2ef264f87144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:48.534291 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95912694-3457-4cae-9cdf-2ef264f87144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:48.534561 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95912694-3457-4cae-9cdf-2ef264f87144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:48.534838 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95912694-3457-4cae-9cdf-2ef264f87144 admin admin] PATH_INFO: `/v3/users/33a199287fec429ca10c783500d7227a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:48.536119 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95912694-3457-4cae-9cdf-2ef264f87144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33a199287fec429ca10c783500d7227a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:48.538776 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95912694-3457-4cae-9cdf-2ef264f87144 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:48.644750 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-95912694-3457-4cae-9cdf-2ef264f87144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33a199287fec429ca10c783500d7227a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:48.655313 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-95912694-3457-4cae-9cdf-2ef264f87144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33a199287fec429ca10c783500d7227a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:48.680033 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-95912694-3457-4cae-9cdf-2ef264f87144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33a199287fec429ca10c783500d7227a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:48.695126 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-95912694-3457-4cae-9cdf-2ef264f87144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33a199287fec429ca10c783500d7227a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:48.696113 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-95912694-3457-4cae-9cdf-2ef264f87144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33a199287fec429ca10c783500d7227a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:48.706618 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1060/2129] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:43:48 2022] DELETE /identity/v3/users/33a199287fec429ca10c783500d7227a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:48.715951 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fb69f-bf62-42df-b70f-aed6775a7569 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:48.716294 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fb69f-bf62-42df-b70f-aed6775a7569 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:48.716546 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fb69f-bf62-42df-b70f-aed6775a7569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:48.736254 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95912694-3457-4cae-9cdf-2ef264f87144 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:48.739150 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-95912694-3457-4cae-9cdf-2ef264f87144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:48.746147 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-f90fb69f-bf62-42df-b70f-aed6775a7569 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:48.748462 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-f90fb69f-bf62-42df-b70f-aed6775a7569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:48.820032 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95912694-3457-4cae-9cdf-2ef264f87144 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:48.826460 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24abd7-edae-4c1d-8284-9f8bb00c751c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:48.827419 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24abd7-edae-4c1d-8284-9f8bb00c751c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:48.828047 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24abd7-edae-4c1d-8284-9f8bb00c751c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:48.828161 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1070/2130] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:43:48.828255 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24abd7-edae-4c1d-8284-9f8bb00c751c admin admin] PATH_INFO: `/v3/projects/2127908cbfd54932803d0c689b6d3ea8` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:48.829556 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24abd7-edae-4c1d-8284-9f8bb00c751c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2127908cbfd54932803d0c689b6d3ea8)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:48.831641 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24abd7-edae-4c1d-8284-9f8bb00c751c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:48.840298 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fb69f-bf62-42df-b70f-aed6775a7569 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:48.842324 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-f90fb69f-bf62-42df-b70f-aed6775a7569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:48.894757 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ed24abd7-edae-4c1d-8284-9f8bb00c751c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2127908cbfd54932803d0c689b6d3ea8', 'request_id': 'req-ed24abd7-edae-4c1d-8284-9f8bb00c751c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:48.903311 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ed24abd7-edae-4c1d-8284-9f8bb00c751c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2127908cbfd54932803d0c689b6d3ea8', 'request_id': 'req-ed24abd7-edae-4c1d-8284-9f8bb00c751c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:48.913021 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fb69f-bf62-42df-b70f-aed6775a7569 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:48.913690 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ed24abd7-edae-4c1d-8284-9f8bb00c751c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2127908cbfd54932803d0c689b6d3ea8', 'request_id': 'req-ed24abd7-edae-4c1d-8284-9f8bb00c751c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:48.948966 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ed24abd7-edae-4c1d-8284-9f8bb00c751c admin admin] The token cache is being invalidate because project 2127908cbfd54932803d0c689b6d3ea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:43:48.949608 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ed24abd7-edae-4c1d-8284-9f8bb00c751c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:48.950539 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ed24abd7-edae-4c1d-8284-9f8bb00c751c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:48.952685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1061/2131] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:43:48 2022] DELETE /identity/v3/projects/2127908cbfd54932803d0c689b6d3ea8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:43:48.995523 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcaf88-31ab-49f2-b2d2-a3b81f29e2d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:48.996597 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcaf88-31ab-49f2-b2d2-a3b81f29e2d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:48.996975 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcaf88-31ab-49f2-b2d2-a3b81f29e2d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:48.997346 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcaf88-31ab-49f2-b2d2-a3b81f29e2d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:49.005501 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a8dcaf88-31ab-49f2-b2d2-a3b81f29e2d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:49.087067 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcaf88-31ab-49f2-b2d2-a3b81f29e2d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:49.088605 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcaf88-31ab-49f2-b2d2-a3b81f29e2d0 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:49.099242 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1071/2132] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:43:49.355190 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24abd7-edae-4c1d-8284-9f8bb00c751c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:49.356654 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ed24abd7-edae-4c1d-8284-9f8bb00c751c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:49.372491 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24abd7-edae-4c1d-8284-9f8bb00c751c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:49.378463 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5041d-434e-47a8-b9e8-5b45a46b8d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:49.379325 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5041d-434e-47a8-b9e8-5b45a46b8d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:49.379608 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5041d-434e-47a8-b9e8-5b45a46b8d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:49.380178 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5041d-434e-47a8-b9e8-5b45a46b8d9d admin admin] PATH_INFO: `/v3/projects/620de5af998947bda2ad875d000e23ba` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:49.381805 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5041d-434e-47a8-b9e8-5b45a46b8d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=620de5af998947bda2ad875d000e23ba)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:49.388581 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5041d-434e-47a8-b9e8-5b45a46b8d9d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:49.437401 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-93a5041d-434e-47a8-b9e8-5b45a46b8d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '620de5af998947bda2ad875d000e23ba', 'request_id': 'req-93a5041d-434e-47a8-b9e8-5b45a46b8d9d'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:49.443523 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-93a5041d-434e-47a8-b9e8-5b45a46b8d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '620de5af998947bda2ad875d000e23ba', 'request_id': 'req-93a5041d-434e-47a8-b9e8-5b45a46b8d9d'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:49.449272 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-93a5041d-434e-47a8-b9e8-5b45a46b8d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '620de5af998947bda2ad875d000e23ba', 'request_id': 'req-93a5041d-434e-47a8-b9e8-5b45a46b8d9d'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:49.461535 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-93a5041d-434e-47a8-b9e8-5b45a46b8d9d admin admin] The token cache is being invalidate because project 620de5af998947bda2ad875d000e23ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:43:49.461822 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-93a5041d-434e-47a8-b9e8-5b45a46b8d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:49.462832 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-93a5041d-434e-47a8-b9e8-5b45a46b8d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:49.464411 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1062/2133] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:43:49 2022] DELETE /identity/v3/projects/620de5af998947bda2ad875d000e23ba => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:49.470073 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777150f-89b2-45ba-8d98-cfba9b0dcc49 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:49.470527 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777150f-89b2-45ba-8d98-cfba9b0dcc49 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:49.470615 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777150f-89b2-45ba-8d98-cfba9b0dcc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:49.489341 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-8777150f-89b2-45ba-8d98-cfba9b0dcc49 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:49.490922 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-8777150f-89b2-45ba-8d98-cfba9b0dcc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:49.551286 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1072/2134] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:49.560498 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345ec29-2119-411b-9ef3-25be1ce1fcfa None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:49.560787 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345ec29-2119-411b-9ef3-25be1ce1fcfa None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:49.561091 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345ec29-2119-411b-9ef3-25be1ce1fcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:49.579524 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-4345ec29-2119-411b-9ef3-25be1ce1fcfa None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:49.580810 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4345ec29-2119-411b-9ef3-25be1ce1fcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:49.588848 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1063/2135] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:43:49.593043 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777150f-89b2-45ba-8d98-cfba9b0dcc49 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:49.602691 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777150f-89b2-45ba-8d98-cfba9b0dcc49 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:49.608036 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf14b4-4403-47b0-b203-5e8c030e7b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:49.608687 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf14b4-4403-47b0-b203-5e8c030e7b39 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:49.608968 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf14b4-4403-47b0-b203-5e8c030e7b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:49.609241 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf14b4-4403-47b0-b203-5e8c030e7b39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:49.610008 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf14b4-4403-47b0-b203-5e8c030e7b39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:43:49.610334 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf14b4-4403-47b0-b203-5e8c030e7b39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:49.611987 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf14b4-4403-47b0-b203-5e8c030e7b39 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:49.626835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1073/2136] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:43:49.628466 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345ec29-2119-411b-9ef3-25be1ce1fcfa None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:49.638143 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345ec29-2119-411b-9ef3-25be1ce1fcfa None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:49.643660 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173382e-0417-40be-8194-d2f379a4fc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:49.644777 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173382e-0417-40be-8194-d2f379a4fc9d admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:49.645061 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173382e-0417-40be-8194-d2f379a4fc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:49.645519 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173382e-0417-40be-8194-d2f379a4fc9d admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:49.646433 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173382e-0417-40be-8194-d2f379a4fc9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:49.648262 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173382e-0417-40be-8194-d2f379a4fc9d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:49.675052 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1064/2137] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:43:49 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:43:49.679456 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf14b4-4403-47b0-b203-5e8c030e7b39 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:49.690363 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf14b4-4403-47b0-b203-5e8c030e7b39 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:49.750396 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea073a6a-0148-48f8-a65d-43a3ab8562f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:49.751447 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea073a6a-0148-48f8-a65d-43a3ab8562f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:49.751992 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea073a6a-0148-48f8-a65d-43a3ab8562f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:49.752486 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea073a6a-0148-48f8-a65d-43a3ab8562f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:49.753475 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea073a6a-0148-48f8-a65d-43a3ab8562f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:49.755994 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea073a6a-0148-48f8-a65d-43a3ab8562f3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:49.776179 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1074/2138] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:43:49 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:43:49.780273 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173382e-0417-40be-8194-d2f379a4fc9d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:49.790823 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173382e-0417-40be-8194-d2f379a4fc9d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:49.796127 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2b406-9618-4c08-b455-6395a3b12a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:49.796817 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2b406-9618-4c08-b455-6395a3b12a16 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:49.797098 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2b406-9618-4c08-b455-6395a3b12a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:49.797375 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2b406-9618-4c08-b455-6395a3b12a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:49.798113 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2b406-9618-4c08-b455-6395a3b12a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:49.799722 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2b406-9618-4c08-b455-6395a3b12a16 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:49.809907 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1065/2139] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:43:49.814141 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea073a6a-0148-48f8-a65d-43a3ab8562f3 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:49.824596 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea073a6a-0148-48f8-a65d-43a3ab8562f3 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:49.829220 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62855e5a-76d2-41dd-b583-6a524267b51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:49.829861 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62855e5a-76d2-41dd-b583-6a524267b51a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:49.830147 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62855e5a-76d2-41dd-b583-6a524267b51a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:49.830427 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62855e5a-76d2-41dd-b583-6a524267b51a admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:49.831161 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62855e5a-76d2-41dd-b583-6a524267b51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:49.832797 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62855e5a-76d2-41dd-b583-6a524267b51a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:49.843117 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1075/2140] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:43:49.847023 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2b406-9618-4c08-b455-6395a3b12a16 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:49.857632 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2b406-9618-4c08-b455-6395a3b12a16 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:49.862444 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa6fbf-8bec-45a0-b1cf-4fba3a6a9575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:49.863322 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa6fbf-8bec-45a0-b1cf-4fba3a6a9575 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:49.863601 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa6fbf-8bec-45a0-b1cf-4fba3a6a9575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:49.863918 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa6fbf-8bec-45a0-b1cf-4fba3a6a9575 admin admin] PATH_INFO: `/v3/projects/5f8b86b7b5014f6d93a6c76cf0c0e5bd/users/11e45187ee044ad4ba1ead3720c951cc/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:49.878306 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa6fbf-8bec-45a0-b1cf-4fba3a6a9575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8b86b7b5014f6d93a6c76cf0c0e5bd, user_id=11e45187ee044ad4ba1ead3720c951cc, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:49.881370 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa6fbf-8bec-45a0-b1cf-4fba3a6a9575 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:49.895058 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1066/2141] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:43:49 2022] PUT /identity/v3/projects/5f8b86b7b5014f6d93a6c76cf0c0e5bd/users/11e45187ee044ad4ba1ead3720c951cc/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:49.905685 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f77ed-10b4-434d-9379-65a904bfea2d None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:49.905976 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f77ed-10b4-434d-9379-65a904bfea2d None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:49.906254 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f77ed-10b4-434d-9379-65a904bfea2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:49.932443 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-f96f77ed-10b4-434d-9379-65a904bfea2d None None] MFA Rules not processed for user `11e45187ee044ad4ba1ead3720c951cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:49.933625 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-f96f77ed-10b4-434d-9379-65a904bfea2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:49.996481 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1076/2142] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:50.007723 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa6fbf-8bec-45a0-b1cf-4fba3a6a9575 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:50.009438 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-83aa6fbf-8bec-45a0-b1cf-4fba3a6a9575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:50.064694 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa6fbf-8bec-45a0-b1cf-4fba3a6a9575 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:50.068406 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ecc52-5899-4dc1-99cc-989bda0cd147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:50.069038 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ecc52-5899-4dc1-99cc-989bda0cd147 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:50.069320 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ecc52-5899-4dc1-99cc-989bda0cd147 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:50.069595 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ecc52-5899-4dc1-99cc-989bda0cd147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:50.077948 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ecc52-5899-4dc1-99cc-989bda0cd147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:50.079374 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ecc52-5899-4dc1-99cc-989bda0cd147 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:50.095899 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1067/2143] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:43:54.748438 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12fbed-737d-4be4-bac3-519aad94456b None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:54.748880 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12fbed-737d-4be4-bac3-519aad94456b None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:54.749022 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12fbed-737d-4be4-bac3-519aad94456b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:54.766927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-6a12fbed-737d-4be4-bac3-519aad94456b None None] MFA Rules not processed for user `a5eff85a200a4a599e0cefe8d681d72d`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:54.768170 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-6a12fbed-737d-4be4-bac3-519aad94456b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:54.822377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1077/2144] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:55.762608 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ecc52-5899-4dc1-99cc-989bda0cd147 service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:55.825915 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ecc52-5899-4dc1-99cc-989bda0cd147 service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:55.830461 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142eac1-82e4-40a4-83d7-6b5349621e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:55.831326 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142eac1-82e4-40a4-83d7-6b5349621e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:55.831608 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142eac1-82e4-40a4-83d7-6b5349621e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:55.831921 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142eac1-82e4-40a4-83d7-6b5349621e4c admin admin] PATH_INFO: `/v3/users/11e45187ee044ad4ba1ead3720c951cc` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:55.833127 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142eac1-82e4-40a4-83d7-6b5349621e4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e45187ee044ad4ba1ead3720c951cc)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:55.835066 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142eac1-82e4-40a4-83d7-6b5349621e4c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:55.883746 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a142eac1-82e4-40a4-83d7-6b5349621e4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e45187ee044ad4ba1ead3720c951cc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:55.891777 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a142eac1-82e4-40a4-83d7-6b5349621e4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e45187ee044ad4ba1ead3720c951cc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:55.904171 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a142eac1-82e4-40a4-83d7-6b5349621e4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e45187ee044ad4ba1ead3720c951cc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:55.913317 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a142eac1-82e4-40a4-83d7-6b5349621e4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e45187ee044ad4ba1ead3720c951cc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:55.914038 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a142eac1-82e4-40a4-83d7-6b5349621e4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e45187ee044ad4ba1ead3720c951cc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:55.920814 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1068/2145] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:43:55 2022] DELETE /identity/v3/users/11e45187ee044ad4ba1ead3720c951cc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:55.925025 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f43c8a-ece1-41b3-8b7b-751211328709 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:55.925502 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f43c8a-ece1-41b3-8b7b-751211328709 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:55.925595 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f43c8a-ece1-41b3-8b7b-751211328709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:55.944057 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-21f43c8a-ece1-41b3-8b7b-751211328709 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:55.945266 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-21f43c8a-ece1-41b3-8b7b-751211328709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:56.004923 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1078/2146] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:56.015428 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142eac1-82e4-40a4-83d7-6b5349621e4c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:56.016906 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a142eac1-82e4-40a4-83d7-6b5349621e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:56.073825 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142eac1-82e4-40a4-83d7-6b5349621e4c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:56.077670 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961245b1-f6d0-4e94-bf9c-d2c1ed33eb76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:56.078310 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961245b1-f6d0-4e94-bf9c-d2c1ed33eb76 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:56.078593 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961245b1-f6d0-4e94-bf9c-d2c1ed33eb76 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:56.078871 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961245b1-f6d0-4e94-bf9c-d2c1ed33eb76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:56.088823 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961245b1-f6d0-4e94-bf9c-d2c1ed33eb76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:56.090253 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961245b1-f6d0-4e94-bf9c-d2c1ed33eb76 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:56.099479 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1069/2147] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:43:56.361640 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f43c8a-ece1-41b3-8b7b-751211328709 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:56.363266 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-21f43c8a-ece1-41b3-8b7b-751211328709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:56.375684 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f43c8a-ece1-41b3-8b7b-751211328709 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:56.380764 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6da36-6059-4126-8795-bb53a95a0ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:56.381600 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6da36-6059-4126-8795-bb53a95a0ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:56.382080 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6da36-6059-4126-8795-bb53a95a0ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:56.382356 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6da36-6059-4126-8795-bb53a95a0ed8 admin admin] PATH_INFO: `/v3/projects/5f8b86b7b5014f6d93a6c76cf0c0e5bd` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:56.383586 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6da36-6059-4126-8795-bb53a95a0ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f8b86b7b5014f6d93a6c76cf0c0e5bd)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:56.386629 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6da36-6059-4126-8795-bb53a95a0ed8 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:56.448524 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5fe6da36-6059-4126-8795-bb53a95a0ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f8b86b7b5014f6d93a6c76cf0c0e5bd', 'request_id': 'req-5fe6da36-6059-4126-8795-bb53a95a0ed8'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:56.454791 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5fe6da36-6059-4126-8795-bb53a95a0ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f8b86b7b5014f6d93a6c76cf0c0e5bd', 'request_id': 'req-5fe6da36-6059-4126-8795-bb53a95a0ed8'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:56.461791 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5fe6da36-6059-4126-8795-bb53a95a0ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f8b86b7b5014f6d93a6c76cf0c0e5bd', 'request_id': 'req-5fe6da36-6059-4126-8795-bb53a95a0ed8'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:56.479904 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5fe6da36-6059-4126-8795-bb53a95a0ed8 admin admin] The token cache is being invalidate because project 5f8b86b7b5014f6d93a6c76cf0c0e5bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:43:56.480256 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5fe6da36-6059-4126-8795-bb53a95a0ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:56.480891 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5fe6da36-6059-4126-8795-bb53a95a0ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:56.483267 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1079/2148] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:43:56 2022] DELETE /identity/v3/projects/5f8b86b7b5014f6d93a6c76cf0c0e5bd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:56.488857 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305c8b8-ca2c-490a-989b-1fefb31c178b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:56.489193 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305c8b8-ca2c-490a-989b-1fefb31c178b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:56.489921 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305c8b8-ca2c-490a-989b-1fefb31c178b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:56.512151 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2305c8b8-ca2c-490a-989b-1fefb31c178b None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:56.513483 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2305c8b8-ca2c-490a-989b-1fefb31c178b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:56.584023 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6da36-6059-4126-8795-bb53a95a0ed8 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:56.586927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5fe6da36-6059-4126-8795-bb53a95a0ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:56.592802 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1070/2149] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:56.601695 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80653822-a0bd-4420-a424-562284e4c1a0 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:56.602179 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80653822-a0bd-4420-a424-562284e4c1a0 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:56.602585 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80653822-a0bd-4420-a424-562284e4c1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:56.610386 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6da36-6059-4126-8795-bb53a95a0ed8 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:56.617149 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4553c1c-b5f7-4bfd-9c0b-4de0fb6df3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:56.619112 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4553c1c-b5f7-4bfd-9c0b-4de0fb6df3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:56.619652 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4553c1c-b5f7-4bfd-9c0b-4de0fb6df3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:56.620167 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4553c1c-b5f7-4bfd-9c0b-4de0fb6df3ba admin admin] PATH_INFO: `/v3/users/1523800740ee44c5a753f546f49be9ce` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:56.622694 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4553c1c-b5f7-4bfd-9c0b-4de0fb6df3ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=1523800740ee44c5a753f546f49be9ce)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:56.625442 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4553c1c-b5f7-4bfd-9c0b-4de0fb6df3ba admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:56.627895 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-80653822-a0bd-4420-a424-562284e4c1a0 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:56.629199 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-80653822-a0bd-4420-a424-562284e4c1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:56.640702 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1071/2150] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:43:56.645694 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80653822-a0bd-4420-a424-562284e4c1a0 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:56.657495 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80653822-a0bd-4420-a424-562284e4c1a0 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:56.664263 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b8e62-0ffa-4101-a840-5764e9aa52a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:56.665211 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b8e62-0ffa-4101-a840-5764e9aa52a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:56.665708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b8e62-0ffa-4101-a840-5764e9aa52a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:56.666194 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b8e62-0ffa-4101-a840-5764e9aa52a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:56.667242 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b8e62-0ffa-4101-a840-5764e9aa52a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:43:56.667626 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b8e62-0ffa-4101-a840-5764e9aa52a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:56.669307 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b8e62-0ffa-4101-a840-5764e9aa52a3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:56.684743 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1072/2151] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:43:56.689066 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b8e62-0ffa-4101-a840-5764e9aa52a3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:56.702648 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b4553c1c-b5f7-4bfd-9c0b-4de0fb6df3ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1523800740ee44c5a753f546f49be9ce'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:56.704480 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b8e62-0ffa-4101-a840-5764e9aa52a3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:56.716026 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9c702-03a0-47ff-8383-2518286a9dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:56.717077 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9c702-03a0-47ff-8383-2518286a9dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:56.717876 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9c702-03a0-47ff-8383-2518286a9dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:56.718389 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9c702-03a0-47ff-8383-2518286a9dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:56.719307 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9c702-03a0-47ff-8383-2518286a9dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:56.721709 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9c702-03a0-47ff-8383-2518286a9dd1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:56.724453 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b4553c1c-b5f7-4bfd-9c0b-4de0fb6df3ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1523800740ee44c5a753f546f49be9ce'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:56.736742 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b4553c1c-b5f7-4bfd-9c0b-4de0fb6df3ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1523800740ee44c5a753f546f49be9ce'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:56.748467 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b4553c1c-b5f7-4bfd-9c0b-4de0fb6df3ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1523800740ee44c5a753f546f49be9ce'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:56.749329 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b4553c1c-b5f7-4bfd-9c0b-4de0fb6df3ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1523800740ee44c5a753f546f49be9ce'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:56.753075 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1073/2152] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:43:56 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:43:56.756926 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1080/2153] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:43:56 2022] DELETE /identity/v3/users/1523800740ee44c5a753f546f49be9ce => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:43:56.757557 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9c702-03a0-47ff-8383-2518286a9dd1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:56.759711 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7df9c702-03a0-47ff-8383-2518286a9dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:56.762068 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93a84f-3f28-4d14-b4db-c04a616cd84d None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:56.762535 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93a84f-3f28-4d14-b4db-c04a616cd84d None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:56.763537 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93a84f-3f28-4d14-b4db-c04a616cd84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:56.782996 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-9c93a84f-3f28-4d14-b4db-c04a616cd84d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:56.784233 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-9c93a84f-3f28-4d14-b4db-c04a616cd84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:56.831086 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9c702-03a0-47ff-8383-2518286a9dd1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:56.845749 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1081/2154] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:56.855603 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93a84f-3f28-4d14-b4db-c04a616cd84d None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:56.857225 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-9c93a84f-3f28-4d14-b4db-c04a616cd84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:56.894911 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c81ea9-db05-4244-a327-8a277739ca06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:56.895782 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c81ea9-db05-4244-a327-8a277739ca06 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:56.896815 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c81ea9-db05-4244-a327-8a277739ca06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:56.897106 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c81ea9-db05-4244-a327-8a277739ca06 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:56.897966 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c81ea9-db05-4244-a327-8a277739ca06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:56.901264 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c81ea9-db05-4244-a327-8a277739ca06 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:56.926416 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93a84f-3f28-4d14-b4db-c04a616cd84d None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:56.927110 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1074/2155] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:43:56 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:43:56.930216 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074641b-d934-4912-855c-cd2e9a3e9938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:56.931614 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074641b-d934-4912-855c-cd2e9a3e9938 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:56.932615 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074641b-d934-4912-855c-cd2e9a3e9938 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:56.932731 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c81ea9-db05-4244-a327-8a277739ca06 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:56.932811 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074641b-d934-4912-855c-cd2e9a3e9938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:56.943533 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c81ea9-db05-4244-a327-8a277739ca06 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:56.944624 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074641b-d934-4912-855c-cd2e9a3e9938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:56.946806 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074641b-d934-4912-855c-cd2e9a3e9938 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:56.948622 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cc4df-a59d-4d1a-8817-0b46d63b0b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:56.949339 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cc4df-a59d-4d1a-8817-0b46d63b0b49 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:56.949701 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cc4df-a59d-4d1a-8817-0b46d63b0b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:56.950035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cc4df-a59d-4d1a-8817-0b46d63b0b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:56.950832 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0cc4df-a59d-4d1a-8817-0b46d63b0b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:56.952732 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0cc4df-a59d-4d1a-8817-0b46d63b0b49 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:56.957142 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1082/2156] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:43:56.962992 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1075/2157] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:43:56.966945 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074641b-d934-4912-855c-cd2e9a3e9938 service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:56.976629 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074641b-d934-4912-855c-cd2e9a3e9938 service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:56.982261 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01821414-3d21-4448-a087-dfa4a743e075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:56.983053 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01821414-3d21-4448-a087-dfa4a743e075 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:56.983698 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01821414-3d21-4448-a087-dfa4a743e075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:56.984039 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01821414-3d21-4448-a087-dfa4a743e075 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:56.984750 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01821414-3d21-4448-a087-dfa4a743e075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:56.986395 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01821414-3d21-4448-a087-dfa4a743e075 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:57.004252 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1083/2158] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:43:57.005976 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cc4df-a59d-4d1a-8817-0b46d63b0b49 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:57.018110 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cc4df-a59d-4d1a-8817-0b46d63b0b49 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:57.024025 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502d105-9a51-406a-bd8c-f941485c6481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:57.025204 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502d105-9a51-406a-bd8c-f941485c6481 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:57.025582 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502d105-9a51-406a-bd8c-f941485c6481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:57.025871 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502d105-9a51-406a-bd8c-f941485c6481 admin admin] PATH_INFO: `/v3/projects/08bc94fd80244144ae5883c54707e219/users/89bb4f5ad936444093f3115c65c441b1/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:57.044259 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502d105-9a51-406a-bd8c-f941485c6481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08bc94fd80244144ae5883c54707e219, user_id=89bb4f5ad936444093f3115c65c441b1, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:57.047662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502d105-9a51-406a-bd8c-f941485c6481 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:57.070463 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1076/2159] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:43:57 2022] PUT /identity/v3/projects/08bc94fd80244144ae5883c54707e219/users/89bb4f5ad936444093f3115c65c441b1/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:57.076367 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fdfec-5f48-4913-913a-44a72c48a5fc None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:57.076655 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fdfec-5f48-4913-913a-44a72c48a5fc None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:57.076964 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fdfec-5f48-4913-913a-44a72c48a5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:57.100375 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-d68fdfec-5f48-4913-913a-44a72c48a5fc None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:57.101741 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d68fdfec-5f48-4913-913a-44a72c48a5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:57.204461 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1084/2160] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:57.225992 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502d105-9a51-406a-bd8c-f941485c6481 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:57.230088 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5502d105-9a51-406a-bd8c-f941485c6481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:57.313453 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502d105-9a51-406a-bd8c-f941485c6481 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:57.318747 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77580e07-169f-4b2c-877b-64500039bd90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:57.319262 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77580e07-169f-4b2c-877b-64500039bd90 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:57.319546 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77580e07-169f-4b2c-877b-64500039bd90 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:57.319864 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77580e07-169f-4b2c-877b-64500039bd90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:57.338396 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77580e07-169f-4b2c-877b-64500039bd90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:57.339571 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77580e07-169f-4b2c-877b-64500039bd90 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:57.350396 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1077/2161] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:43:57.383225 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fdfec-5f48-4913-913a-44a72c48a5fc None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:57.385496 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d68fdfec-5f48-4913-913a-44a72c48a5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:57.400371 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fdfec-5f48-4913-913a-44a72c48a5fc None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:57.406563 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f5ed9-6f07-4132-8463-d30567f410e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:57.414500 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f5ed9-6f07-4132-8463-d30567f410e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:57.414909 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f5ed9-6f07-4132-8463-d30567f410e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:57.415867 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f5ed9-6f07-4132-8463-d30567f410e5 admin admin] PATH_INFO: `/v3/projects/e7290649118b432aa2413ab2b57cb0e2` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:57.417855 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f5ed9-6f07-4132-8463-d30567f410e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7290649118b432aa2413ab2b57cb0e2)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:57.419906 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f5ed9-6f07-4132-8463-d30567f410e5 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:57.489787 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5d8f5ed9-6f07-4132-8463-d30567f410e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7290649118b432aa2413ab2b57cb0e2', 'request_id': 'req-5d8f5ed9-6f07-4132-8463-d30567f410e5'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:57.497372 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5d8f5ed9-6f07-4132-8463-d30567f410e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7290649118b432aa2413ab2b57cb0e2', 'request_id': 'req-5d8f5ed9-6f07-4132-8463-d30567f410e5'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:57.505036 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5d8f5ed9-6f07-4132-8463-d30567f410e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7290649118b432aa2413ab2b57cb0e2', 'request_id': 'req-5d8f5ed9-6f07-4132-8463-d30567f410e5'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:57.518332 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5d8f5ed9-6f07-4132-8463-d30567f410e5 admin admin] The token cache is being invalidate because project e7290649118b432aa2413ab2b57cb0e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:43:57.518618 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5d8f5ed9-6f07-4132-8463-d30567f410e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:57.519257 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5d8f5ed9-6f07-4132-8463-d30567f410e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:43:57.521135 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1085/2162] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:43:57 2022] DELETE /identity/v3/projects/e7290649118b432aa2413ab2b57cb0e2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:57.528748 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53830c-48cc-4ab1-be4e-6289eb89173b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:57.529043 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53830c-48cc-4ab1-be4e-6289eb89173b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:57.529325 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53830c-48cc-4ab1-be4e-6289eb89173b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:57.550056 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-df53830c-48cc-4ab1-be4e-6289eb89173b None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:57.551487 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-df53830c-48cc-4ab1-be4e-6289eb89173b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:57.637176 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1078/2163] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:57.642356 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4c3aa-faa8-4af8-83ac-4db1eaf11553 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:57.642598 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4c3aa-faa8-4af8-83ac-4db1eaf11553 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:57.642865 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4c3aa-faa8-4af8-83ac-4db1eaf11553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:57.666668 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-73f4c3aa-faa8-4af8-83ac-4db1eaf11553 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:57.667943 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-73f4c3aa-faa8-4af8-83ac-4db1eaf11553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:57.677479 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1086/2164] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:43:57.682168 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53830c-48cc-4ab1-be4e-6289eb89173b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:57.692147 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53830c-48cc-4ab1-be4e-6289eb89173b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:57.697808 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb32ee2-dafd-4a32-bc42-6e056cbea9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:57.698534 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb32ee2-dafd-4a32-bc42-6e056cbea9ae admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:57.698822 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb32ee2-dafd-4a32-bc42-6e056cbea9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:57.699265 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb32ee2-dafd-4a32-bc42-6e056cbea9ae admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:57.700033 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb32ee2-dafd-4a32-bc42-6e056cbea9ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:43:57.700336 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb32ee2-dafd-4a32-bc42-6e056cbea9ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:57.702185 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb32ee2-dafd-4a32-bc42-6e056cbea9ae admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:57.714517 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1079/2165] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:43:57.718806 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4c3aa-faa8-4af8-83ac-4db1eaf11553 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:57.728988 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4c3aa-faa8-4af8-83ac-4db1eaf11553 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:57.735196 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb884fd-797a-4760-a491-cdc97825f1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:57.735909 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb884fd-797a-4760-a491-cdc97825f1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:57.736199 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb884fd-797a-4760-a491-cdc97825f1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:57.736476 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb884fd-797a-4760-a491-cdc97825f1e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:57.737206 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb884fd-797a-4760-a491-cdc97825f1e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:57.739105 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb884fd-797a-4760-a491-cdc97825f1e6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:57.771771 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1087/2166] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:43:57 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:43:57.772579 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb32ee2-dafd-4a32-bc42-6e056cbea9ae admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:57.783363 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb32ee2-dafd-4a32-bc42-6e056cbea9ae admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:57.845986 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad7b7f-96a5-4b92-819c-1b818b696bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:57.846706 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad7b7f-96a5-4b92-819c-1b818b696bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:57.846927 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad7b7f-96a5-4b92-819c-1b818b696bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:57.847219 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad7b7f-96a5-4b92-819c-1b818b696bd4 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:57.847956 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad7b7f-96a5-4b92-819c-1b818b696bd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:57.850031 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad7b7f-96a5-4b92-819c-1b818b696bd4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:57.879097 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb884fd-797a-4760-a491-cdc97825f1e6 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:57.887091 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1080/2167] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:43:57 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:43:57.890451 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb884fd-797a-4760-a491-cdc97825f1e6 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:57.896243 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6a907-cae1-437a-8ad2-18e74a3ed742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:57.896953 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6a907-cae1-437a-8ad2-18e74a3ed742 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:57.897230 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6a907-cae1-437a-8ad2-18e74a3ed742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:57.897566 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6a907-cae1-437a-8ad2-18e74a3ed742 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:57.898305 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6a907-cae1-437a-8ad2-18e74a3ed742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:57.900224 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6a907-cae1-437a-8ad2-18e74a3ed742 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:57.919782 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad7b7f-96a5-4b92-819c-1b818b696bd4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:57.920231 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1088/2168] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:43:57.931366 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad7b7f-96a5-4b92-819c-1b818b696bd4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:57.938000 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dd92e-88e4-455f-89c1-812fa7314593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:57.938722 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dd92e-88e4-455f-89c1-812fa7314593 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:57.939001 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dd92e-88e4-455f-89c1-812fa7314593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:57.939702 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dd92e-88e4-455f-89c1-812fa7314593 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:57.940103 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dd92e-88e4-455f-89c1-812fa7314593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:57.941784 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dd92e-88e4-455f-89c1-812fa7314593 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:57.959626 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6a907-cae1-437a-8ad2-18e74a3ed742 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:57.964510 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1081/2169] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:43:57.970946 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6a907-cae1-437a-8ad2-18e74a3ed742 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:58.000853 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf995b-4785-4f29-bb02-952977188d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:58.002007 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf995b-4785-4f29-bb02-952977188d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:58.002431 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf995b-4785-4f29-bb02-952977188d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:58.002847 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf995b-4785-4f29-bb02-952977188d39 admin admin] PATH_INFO: `/v3/projects/092e0caa62ac4b368d9fa68a2edcc9d7/users/fcc2e5dc40fb4e87ac5945c41310eb15/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:58.021323 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf995b-4785-4f29-bb02-952977188d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=092e0caa62ac4b368d9fa68a2edcc9d7, user_id=fcc2e5dc40fb4e87ac5945c41310eb15, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:58.025334 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf995b-4785-4f29-bb02-952977188d39 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:58.044631 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1089/2170] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:43:57 2022] PUT /identity/v3/projects/092e0caa62ac4b368d9fa68a2edcc9d7/users/fcc2e5dc40fb4e87ac5945c41310eb15/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:43:58.056628 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894eb7da-4fbb-401b-8904-6b69d9c5e61a None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:58.057477 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894eb7da-4fbb-401b-8904-6b69d9c5e61a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:58.057830 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894eb7da-4fbb-401b-8904-6b69d9c5e61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:58.089388 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-894eb7da-4fbb-401b-8904-6b69d9c5e61a None None] MFA Rules not processed for user `fcc2e5dc40fb4e87ac5945c41310eb15`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:43:58.092099 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-894eb7da-4fbb-401b-8904-6b69d9c5e61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:58.190381 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1082/2171] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:43:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:43:58.203032 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf995b-4785-4f29-bb02-952977188d39 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:43:58.204885 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-34cf995b-4785-4f29-bb02-952977188d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:43:58.270914 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf995b-4785-4f29-bb02-952977188d39 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:43:58.274767 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18de40-b39d-4170-89d0-43e86f535f1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:43:58.275424 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18de40-b39d-4170-89d0-43e86f535f1c service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:43:58.275710 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18de40-b39d-4170-89d0-43e86f535f1c service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:43:58.276026 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18de40-b39d-4170-89d0-43e86f535f1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:43:58.285862 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18de40-b39d-4170-89d0-43e86f535f1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:43:58.287417 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18de40-b39d-4170-89d0-43e86f535f1c service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:43:58.297979 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1090/2172] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:43:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:44:03.122054 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0c0d7-cc09-4845-bb59-da332e712956 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:03.122586 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0c0d7-cc09-4845-bb59-da332e712956 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:03.122586 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0c0d7-cc09-4845-bb59-da332e712956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:03.181093 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-08e0c0d7-cc09-4845-bb59-da332e712956 None None] MFA Rules not processed for user `89bb4f5ad936444093f3115c65c441b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:44:03.182678 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-08e0c0d7-cc09-4845-bb59-da332e712956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:44:03.288994 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1083/2173] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:44:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:44:03.294329 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18de40-b39d-4170-89d0-43e86f535f1c service cinder] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:44:03.296129 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5e18de40-b39d-4170-89d0-43e86f535f1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:44:03.409103 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18de40-b39d-4170-89d0-43e86f535f1c service cinder] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:44:03.413693 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee72b9-3214-4284-af3b-fe668e39e771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:44:03.414270 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee72b9-3214-4284-af3b-fe668e39e771 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:03.414549 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee72b9-3214-4284-af3b-fe668e39e771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:03.415427 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee72b9-3214-4284-af3b-fe668e39e771 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:03.416195 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee72b9-3214-4284-af3b-fe668e39e771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:44:03.418246 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee72b9-3214-4284-af3b-fe668e39e771 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:44:03.444273 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1091/2174] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:44:03 2022] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:44:03.448457 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0c0d7-cc09-4845-bb59-da332e712956 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:44:03.458920 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0c0d7-cc09-4845-bb59-da332e712956 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:44:03.514876 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329e31e-f093-4d0d-a3aa-be7912dd0918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:44:03.515542 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329e31e-f093-4d0d-a3aa-be7912dd0918 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:03.515895 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329e31e-f093-4d0d-a3aa-be7912dd0918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:03.516175 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329e31e-f093-4d0d-a3aa-be7912dd0918 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:03.517126 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329e31e-f093-4d0d-a3aa-be7912dd0918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:44:03.518858 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329e31e-f093-4d0d-a3aa-be7912dd0918 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:44:03.539065 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1084/2175] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:44:03 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:44:03.543962 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee72b9-3214-4284-af3b-fe668e39e771 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:44:03.554098 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee72b9-3214-4284-af3b-fe668e39e771 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:44:03.558935 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66913dab-f509-48f2-aa37-3c1f7f36277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:44:03.559580 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66913dab-f509-48f2-aa37-3c1f7f36277a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:03.559903 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66913dab-f509-48f2-aa37-3c1f7f36277a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:03.560184 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66913dab-f509-48f2-aa37-3c1f7f36277a admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:03.560953 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66913dab-f509-48f2-aa37-3c1f7f36277a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:44:03.562536 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66913dab-f509-48f2-aa37-3c1f7f36277a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:44:03.572216 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1092/2176] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:44:03.576208 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329e31e-f093-4d0d-a3aa-be7912dd0918 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:44:03.585828 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329e31e-f093-4d0d-a3aa-be7912dd0918 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:44:03.590919 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8002ed-fff2-41f0-a01f-4480858ed0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:44:03.591802 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8002ed-fff2-41f0-a01f-4480858ed0f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:03.592088 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8002ed-fff2-41f0-a01f-4480858ed0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:03.592362 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8002ed-fff2-41f0-a01f-4480858ed0f8 admin admin] PATH_INFO: `/v3/projects/6a212c4539cf48b19dc8c97b9373be6f/users/56e64690bf104eb88a94ac47a641c859/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:03.607061 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8002ed-fff2-41f0-a01f-4480858ed0f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a212c4539cf48b19dc8c97b9373be6f, user_id=56e64690bf104eb88a94ac47a641c859, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:44:03.609817 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8002ed-fff2-41f0-a01f-4480858ed0f8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:44:03.622912 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1085/2177] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:44:03 2022] PUT /identity/v3/projects/6a212c4539cf48b19dc8c97b9373be6f/users/56e64690bf104eb88a94ac47a641c859/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:44:03.626891 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66913dab-f509-48f2-aa37-3c1f7f36277a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:44:03.636926 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66913dab-f509-48f2-aa37-3c1f7f36277a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:44:03.693787 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b9170-8069-487e-8c2f-fd5a44568ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:44:03.694485 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b9170-8069-487e-8c2f-fd5a44568ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:03.694765 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b9170-8069-487e-8c2f-fd5a44568ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:03.695040 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b9170-8069-487e-8c2f-fd5a44568ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:03.695813 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b9170-8069-487e-8c2f-fd5a44568ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:44:03.698138 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b9170-8069-487e-8c2f-fd5a44568ef9 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:44:03.708186 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1093/2178] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:44:03.712949 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8002ed-fff2-41f0-a01f-4480858ed0f8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:44:03.722913 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8002ed-fff2-41f0-a01f-4480858ed0f8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:44:03.727505 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10649cc3-b187-406e-8a7c-3f2358af4978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:44:03.728368 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10649cc3-b187-406e-8a7c-3f2358af4978 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:03.728645 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10649cc3-b187-406e-8a7c-3f2358af4978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:03.728919 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10649cc3-b187-406e-8a7c-3f2358af4978 admin admin] PATH_INFO: `/v3/projects/6a212c4539cf48b19dc8c97b9373be6f/users/56e64690bf104eb88a94ac47a641c859/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:03.730860 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10649cc3-b187-406e-8a7c-3f2358af4978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a212c4539cf48b19dc8c97b9373be6f, user_id=56e64690bf104eb88a94ac47a641c859, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:44:03.733517 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10649cc3-b187-406e-8a7c-3f2358af4978 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:44:03.743742 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1086/2179] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:44:03 2022] PUT /identity/v3/projects/6a212c4539cf48b19dc8c97b9373be6f/users/56e64690bf104eb88a94ac47a641c859/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:44:09.031569 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b919d48-8de0-4f0b-8bbe-445ae17156bb None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:09.032111 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b919d48-8de0-4f0b-8bbe-445ae17156bb None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:09.032200 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b919d48-8de0-4f0b-8bbe-445ae17156bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:09.067993 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-8b919d48-8de0-4f0b-8bbe-445ae17156bb None None] MFA Rules not processed for user `56e64690bf104eb88a94ac47a641c859`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:44:09.069199 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-8b919d48-8de0-4f0b-8bbe-445ae17156bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:44:09.145185 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1094/2180] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:44:09 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:44:09.156566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10649cc3-b187-406e-8a7c-3f2358af4978 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:44:09.158383 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-10649cc3-b187-406e-8a7c-3f2358af4978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:44:09.252310 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10649cc3-b187-406e-8a7c-3f2358af4978 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:44:09.258337 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2068d5-76e4-41a1-9b6f-a817d3b7b03e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:44:09.259000 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2068d5-76e4-41a1-9b6f-a817d3b7b03e service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:09.259287 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2068d5-76e4-41a1-9b6f-a817d3b7b03e service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:09.259570 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2068d5-76e4-41a1-9b6f-a817d3b7b03e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:09.316164 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2068d5-76e4-41a1-9b6f-a817d3b7b03e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:44:09.317804 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2068d5-76e4-41a1-9b6f-a817d3b7b03e service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:44:09.326934 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1087/2181] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:44:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:44:10.750018 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465d809-39b1-46a7-b8ea-c1c783e73cb9 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:10.750573 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465d809-39b1-46a7-b8ea-c1c783e73cb9 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:10.750573 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465d809-39b1-46a7-b8ea-c1c783e73cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:10.769530 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-9465d809-39b1-46a7-b8ea-c1c783e73cb9 None None] MFA Rules not processed for user `89bb4f5ad936444093f3115c65c441b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:44:10.770808 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-9465d809-39b1-46a7-b8ea-c1c783e73cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:44:10.779241 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1095/2182] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:44:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:44:26.479209 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2068d5-76e4-41a1-9b6f-a817d3b7b03e service nova] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:44:26.538884 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2068d5-76e4-41a1-9b6f-a817d3b7b03e service nova] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:44:26.543892 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e0111-9398-4a30-a283-c92caf705a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:44:26.544815 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e0111-9398-4a30-a283-c92caf705a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:26.545097 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e0111-9398-4a30-a283-c92caf705a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:26.545373 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e0111-9398-4a30-a283-c92caf705a46 admin admin] PATH_INFO: `/v3/users/fcc2e5dc40fb4e87ac5945c41310eb15` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:26.546582 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e0111-9398-4a30-a283-c92caf705a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcc2e5dc40fb4e87ac5945c41310eb15)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:44:26.548628 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e0111-9398-4a30-a283-c92caf705a46 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:44:26.596709 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e87e0111-9398-4a30-a283-c92caf705a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcc2e5dc40fb4e87ac5945c41310eb15'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:44:26.603210 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e87e0111-9398-4a30-a283-c92caf705a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcc2e5dc40fb4e87ac5945c41310eb15'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:44:26.615745 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e87e0111-9398-4a30-a283-c92caf705a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcc2e5dc40fb4e87ac5945c41310eb15'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:44:26.623289 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e87e0111-9398-4a30-a283-c92caf705a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcc2e5dc40fb4e87ac5945c41310eb15'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:44:26.623928 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e87e0111-9398-4a30-a283-c92caf705a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcc2e5dc40fb4e87ac5945c41310eb15'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:44:26.630113 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1088/2183] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:44:26 2022] DELETE /identity/v3/users/fcc2e5dc40fb4e87ac5945c41310eb15 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:44:26.635083 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07eef5-e10d-41c4-b35f-57ac96aab8f4 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:26.635672 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07eef5-e10d-41c4-b35f-57ac96aab8f4 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:26.635672 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07eef5-e10d-41c4-b35f-57ac96aab8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:26.662755 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-5a07eef5-e10d-41c4-b35f-57ac96aab8f4 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:44:26.664046 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5a07eef5-e10d-41c4-b35f-57ac96aab8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:44:26.726691 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1096/2184] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:44:26.736812 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e0111-9398-4a30-a283-c92caf705a46 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:44:26.738284 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e87e0111-9398-4a30-a283-c92caf705a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:44:26.815394 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e0111-9398-4a30-a283-c92caf705a46 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:44:26.819105 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84d71f-8e11-4da9-9c60-db4ce4e01cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:44:26.819730 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84d71f-8e11-4da9-9c60-db4ce4e01cef service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:26.820035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84d71f-8e11-4da9-9c60-db4ce4e01cef service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:26.820304 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84d71f-8e11-4da9-9c60-db4ce4e01cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:26.829648 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84d71f-8e11-4da9-9c60-db4ce4e01cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:44:26.831055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84d71f-8e11-4da9-9c60-db4ce4e01cef service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:44:26.840717 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1089/2185] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:44:27.112424 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07eef5-e10d-41c4-b35f-57ac96aab8f4 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:44:27.113817 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5a07eef5-e10d-41c4-b35f-57ac96aab8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:44:27.126840 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07eef5-e10d-41c4-b35f-57ac96aab8f4 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:44:27.143676 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159ec03-6f74-46c7-b89b-1981017a4f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:44:27.144542 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159ec03-6f74-46c7-b89b-1981017a4f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:27.144890 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159ec03-6f74-46c7-b89b-1981017a4f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:27.145256 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159ec03-6f74-46c7-b89b-1981017a4f0a admin admin] PATH_INFO: `/v3/projects/092e0caa62ac4b368d9fa68a2edcc9d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:27.146537 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159ec03-6f74-46c7-b89b-1981017a4f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=092e0caa62ac4b368d9fa68a2edcc9d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:44:27.148568 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159ec03-6f74-46c7-b89b-1981017a4f0a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:44:27.209761 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-d159ec03-6f74-46c7-b89b-1981017a4f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '092e0caa62ac4b368d9fa68a2edcc9d7', 'request_id': 'req-d159ec03-6f74-46c7-b89b-1981017a4f0a'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:44:27.218155 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-d159ec03-6f74-46c7-b89b-1981017a4f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '092e0caa62ac4b368d9fa68a2edcc9d7', 'request_id': 'req-d159ec03-6f74-46c7-b89b-1981017a4f0a'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:44:27.224181 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-d159ec03-6f74-46c7-b89b-1981017a4f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '092e0caa62ac4b368d9fa68a2edcc9d7', 'request_id': 'req-d159ec03-6f74-46c7-b89b-1981017a4f0a'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:44:27.237940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-d159ec03-6f74-46c7-b89b-1981017a4f0a admin admin] The token cache is being invalidate because project 092e0caa62ac4b368d9fa68a2edcc9d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:44:27.238222 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-d159ec03-6f74-46c7-b89b-1981017a4f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:44:27.238830 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-d159ec03-6f74-46c7-b89b-1981017a4f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:44:27.240414 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1097/2186] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:44:27 2022] DELETE /identity/v3/projects/092e0caa62ac4b368d9fa68a2edcc9d7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:44:27.246155 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076c042-0f36-49dc-8630-f9b4af2c8b76 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:27.246447 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076c042-0f36-49dc-8630-f9b4af2c8b76 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:27.246758 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076c042-0f36-49dc-8630-f9b4af2c8b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:27.293801 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c076c042-0f36-49dc-8630-f9b4af2c8b76 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:44:27.295034 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c076c042-0f36-49dc-8630-f9b4af2c8b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:44:27.351040 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1090/2187] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:44:27.361474 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae320c5-4a9d-4157-8a80-2bff4934a018 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:27.361760 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae320c5-4a9d-4157-8a80-2bff4934a018 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:27.362099 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae320c5-4a9d-4157-8a80-2bff4934a018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:27.382290 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-7ae320c5-4a9d-4157-8a80-2bff4934a018 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:44:27.383526 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-7ae320c5-4a9d-4157-8a80-2bff4934a018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:44:27.392354 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1098/2188] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:44:27.396766 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076c042-0f36-49dc-8630-f9b4af2c8b76 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:44:27.406678 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076c042-0f36-49dc-8630-f9b4af2c8b76 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:44:27.411301 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded3a4e-9fa6-4c0c-9608-36af7a532882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:44:27.411983 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded3a4e-9fa6-4c0c-9608-36af7a532882 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:27.412264 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded3a4e-9fa6-4c0c-9608-36af7a532882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:27.412540 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded3a4e-9fa6-4c0c-9608-36af7a532882 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:27.413272 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded3a4e-9fa6-4c0c-9608-36af7a532882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:44:27.413579 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded3a4e-9fa6-4c0c-9608-36af7a532882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:44:27.415210 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded3a4e-9fa6-4c0c-9608-36af7a532882 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:44:27.426377 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1091/2189] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:44:27.430790 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae320c5-4a9d-4157-8a80-2bff4934a018 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:44:27.441242 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae320c5-4a9d-4157-8a80-2bff4934a018 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:44:27.446141 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9434f01-f9e8-4d75-a74b-6adf789dcc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:44:27.446789 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9434f01-f9e8-4d75-a74b-6adf789dcc7b admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:27.447071 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9434f01-f9e8-4d75-a74b-6adf789dcc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:27.447346 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9434f01-f9e8-4d75-a74b-6adf789dcc7b admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:27.448087 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9434f01-f9e8-4d75-a74b-6adf789dcc7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:44:27.450880 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9434f01-f9e8-4d75-a74b-6adf789dcc7b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:44:27.475504 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1099/2190] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:44:27 2022] POST /identity/v3/projects => generated 361 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:44:27.479914 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded3a4e-9fa6-4c0c-9608-36af7a532882 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:44:27.490212 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded3a4e-9fa6-4c0c-9608-36af7a532882 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:44:27.545614 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300a675-1451-4f04-8ad6-fd8b8dde29f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:44:27.546478 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300a675-1451-4f04-8ad6-fd8b8dde29f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:27.546768 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300a675-1451-4f04-8ad6-fd8b8dde29f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:27.547050 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300a675-1451-4f04-8ad6-fd8b8dde29f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:27.547780 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300a675-1451-4f04-8ad6-fd8b8dde29f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:44:27.549746 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300a675-1451-4f04-8ad6-fd8b8dde29f5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:44:27.569236 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1092/2191] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:44:27 2022] POST /identity/v3/users => generated 281 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:44:27.574239 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9434f01-f9e8-4d75-a74b-6adf789dcc7b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:44:27.584962 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9434f01-f9e8-4d75-a74b-6adf789dcc7b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:44:27.589718 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d763318-c859-4c4c-9980-08e5d4e24170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:44:27.590365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d763318-c859-4c4c-9980-08e5d4e24170 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:27.590648 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d763318-c859-4c4c-9980-08e5d4e24170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:27.590926 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d763318-c859-4c4c-9980-08e5d4e24170 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:27.591660 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d763318-c859-4c4c-9980-08e5d4e24170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:44:27.593265 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d763318-c859-4c4c-9980-08e5d4e24170 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:44:27.603412 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1100/2192] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:44:27.608284 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300a675-1451-4f04-8ad6-fd8b8dde29f5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:44:27.618845 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300a675-1451-4f04-8ad6-fd8b8dde29f5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:44:27.624289 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b05071-1e7c-4cdd-933a-703dfaea44d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:44:27.625004 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b05071-1e7c-4cdd-933a-703dfaea44d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:27.625294 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b05071-1e7c-4cdd-933a-703dfaea44d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:27.625574 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b05071-1e7c-4cdd-933a-703dfaea44d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:27.626321 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b05071-1e7c-4cdd-933a-703dfaea44d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:44:27.627952 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b05071-1e7c-4cdd-933a-703dfaea44d6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:44:27.638778 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1093/2193] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:44:27.643464 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d763318-c859-4c4c-9980-08e5d4e24170 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:44:27.659083 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d763318-c859-4c4c-9980-08e5d4e24170 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:44:27.662820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878c1a7-3de6-4795-b3f3-416f467b69c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:44:27.663696 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878c1a7-3de6-4795-b3f3-416f467b69c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:27.664192 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878c1a7-3de6-4795-b3f3-416f467b69c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:27.664472 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878c1a7-3de6-4795-b3f3-416f467b69c7 admin admin] PATH_INFO: `/v3/projects/5478c48675b34d7dbda6ccc8a70fbb84/users/53ace7e326e940118da8030481f3e147/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:27.679985 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878c1a7-3de6-4795-b3f3-416f467b69c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5478c48675b34d7dbda6ccc8a70fbb84, user_id=53ace7e326e940118da8030481f3e147, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:44:27.683251 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878c1a7-3de6-4795-b3f3-416f467b69c7 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:44:27.697144 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1101/2194] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:44:27 2022] PUT /identity/v3/projects/5478c48675b34d7dbda6ccc8a70fbb84/users/53ace7e326e940118da8030481f3e147/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:44:27.708218 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c95c6-9c6e-449c-b3c8-f041d8a51ca0 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:27.708497 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c95c6-9c6e-449c-b3c8-f041d8a51ca0 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:27.708779 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c95c6-9c6e-449c-b3c8-f041d8a51ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:27.740111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-4f5c95c6-9c6e-449c-b3c8-f041d8a51ca0 None None] MFA Rules not processed for user `53ace7e326e940118da8030481f3e147`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:44:27.741378 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4f5c95c6-9c6e-449c-b3c8-f041d8a51ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:44:27.806743 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1094/2195] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:44:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:44:27.819039 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878c1a7-3de6-4795-b3f3-416f467b69c7 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:44:27.820823 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-3878c1a7-3de6-4795-b3f3-416f467b69c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:44:27.875561 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878c1a7-3de6-4795-b3f3-416f467b69c7 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:44:27.879542 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d1181-8e1e-4464-baa1-9f474aa86e37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:44:27.880222 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d1181-8e1e-4464-baa1-9f474aa86e37 service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:27.880505 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d1181-8e1e-4464-baa1-9f474aa86e37 service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:27.880778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d1181-8e1e-4464-baa1-9f474aa86e37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:27.889169 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d1181-8e1e-4464-baa1-9f474aa86e37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:44:27.890742 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d1181-8e1e-4464-baa1-9f474aa86e37 service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:44:27.900015 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1102/2196] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:44:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:44:33.000073 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a07499-f139-4651-aa88-c8980e4d63bf None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:33.000609 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a07499-f139-4651-aa88-c8980e4d63bf None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:33.000705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a07499-f139-4651-aa88-c8980e4d63bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:33.023651 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-48a07499-f139-4651-aa88-c8980e4d63bf None None] MFA Rules not processed for user `a5eff85a200a4a599e0cefe8d681d72d`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:44:33.026695 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-48a07499-f139-4651-aa88-c8980e4d63bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:44:33.109575 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1095/2197] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:44:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:44:42.007058 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d1181-8e1e-4464-baa1-9f474aa86e37 service cinder] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:44:42.008470 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-922d1181-8e1e-4464-baa1-9f474aa86e37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:44:42.096785 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d1181-8e1e-4464-baa1-9f474aa86e37 service cinder] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:44:42.102204 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9846d7-6bdd-4bb1-a78d-5c439a893108 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c8f232fc83474b8731ee6c1eb321fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:44:42.102837 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9846d7-6bdd-4bb1-a78d-5c439a893108 service placement] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:44:42.103115 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9846d7-6bdd-4bb1-a78d-5c439a893108 service placement] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:44:42.103385 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9846d7-6bdd-4bb1-a78d-5c439a893108 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:44:42.105165 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-bc9846d7-6bdd-4bb1-a78d-5c439a893108 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:44:42.117474 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9846d7-6bdd-4bb1-a78d-5c439a893108 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:44:42.119029 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9846d7-6bdd-4bb1-a78d-5c439a893108 service placement] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:44:42.129543 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1103/2198] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:44:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:45:25.464599 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a76b3-74bf-43ad-9ec9-c8cb1b1f0e03 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:25.465141 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a76b3-74bf-43ad-9ec9-c8cb1b1f0e03 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:25.465141 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a76b3-74bf-43ad-9ec9-c8cb1b1f0e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:25.483331 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-7d6a76b3-74bf-43ad-9ec9-c8cb1b1f0e03 None None] MFA Rules not processed for user `a5eff85a200a4a599e0cefe8d681d72d`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:45:25.484705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7d6a76b3-74bf-43ad-9ec9-c8cb1b1f0e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:25.491984 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1096/2199] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:45:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:45:35.604035 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9846d7-6bdd-4bb1-a78d-5c439a893108 service placement] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:35.606394 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-bc9846d7-6bdd-4bb1-a78d-5c439a893108 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:35.674784 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9846d7-6bdd-4bb1-a78d-5c439a893108 service placement] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:35.679397 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5f0c9-8dc1-4e5f-99f5-2064a65d8504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:35.680292 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5f0c9-8dc1-4e5f-99f5-2064a65d8504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:35.680571 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5f0c9-8dc1-4e5f-99f5-2064a65d8504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:35.680848 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5f0c9-8dc1-4e5f-99f5-2064a65d8504 admin admin] PATH_INFO: `/v3/users/21e3f764b9f34256bc91f08bc220c7c1` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:35.682073 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5f0c9-8dc1-4e5f-99f5-2064a65d8504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e3f764b9f34256bc91f08bc220c7c1)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:35.684026 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5f0c9-8dc1-4e5f-99f5-2064a65d8504 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:35.733849 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-feb5f0c9-8dc1-4e5f-99f5-2064a65d8504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e3f764b9f34256bc91f08bc220c7c1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:35.746827 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-feb5f0c9-8dc1-4e5f-99f5-2064a65d8504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e3f764b9f34256bc91f08bc220c7c1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:35.753764 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-feb5f0c9-8dc1-4e5f-99f5-2064a65d8504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e3f764b9f34256bc91f08bc220c7c1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:35.761450 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-feb5f0c9-8dc1-4e5f-99f5-2064a65d8504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e3f764b9f34256bc91f08bc220c7c1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:35.762141 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-feb5f0c9-8dc1-4e5f-99f5-2064a65d8504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e3f764b9f34256bc91f08bc220c7c1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:35.768779 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1104/2200] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:45:35 2022] DELETE /identity/v3/users/21e3f764b9f34256bc91f08bc220c7c1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:45:35.947451 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a76b3-74bf-43ad-9ec9-c8cb1b1f0e03 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:35.961867 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a76b3-74bf-43ad-9ec9-c8cb1b1f0e03 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:36.036763 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980350bb-9283-47f4-8642-57a77e90cffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:36.038200 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980350bb-9283-47f4-8642-57a77e90cffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:36.038837 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980350bb-9283-47f4-8642-57a77e90cffa admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:36.039300 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980350bb-9283-47f4-8642-57a77e90cffa admin admin] PATH_INFO: `/v3/projects/637df1e7f2cb48c0b97d67658900335d` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:36.040771 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980350bb-9283-47f4-8642-57a77e90cffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=637df1e7f2cb48c0b97d67658900335d)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:36.043007 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980350bb-9283-47f4-8642-57a77e90cffa admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:36.091619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-980350bb-9283-47f4-8642-57a77e90cffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '637df1e7f2cb48c0b97d67658900335d', 'request_id': 'req-980350bb-9283-47f4-8642-57a77e90cffa'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:36.097845 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-980350bb-9283-47f4-8642-57a77e90cffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '637df1e7f2cb48c0b97d67658900335d', 'request_id': 'req-980350bb-9283-47f4-8642-57a77e90cffa'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:36.103150 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-980350bb-9283-47f4-8642-57a77e90cffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '637df1e7f2cb48c0b97d67658900335d', 'request_id': 'req-980350bb-9283-47f4-8642-57a77e90cffa'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:36.114916 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-980350bb-9283-47f4-8642-57a77e90cffa admin admin] The token cache is being invalidate because project 637df1e7f2cb48c0b97d67658900335d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:45:36.115230 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-980350bb-9283-47f4-8642-57a77e90cffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:36.116017 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-980350bb-9283-47f4-8642-57a77e90cffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:36.117780 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1097/2201] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:45:35 2022] DELETE /identity/v3/projects/637df1e7f2cb48c0b97d67658900335d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:45:36.123393 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14a0c8-a47b-48d0-a531-2f861cb5b7bc None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:36.123685 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14a0c8-a47b-48d0-a531-2f861cb5b7bc None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:36.124001 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14a0c8-a47b-48d0-a531-2f861cb5b7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:36.142070 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-6b14a0c8-a47b-48d0-a531-2f861cb5b7bc None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:45:36.143267 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-6b14a0c8-a47b-48d0-a531-2f861cb5b7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:36.200103 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1105/2202] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:45:36.207480 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345ac48-ef3a-4a8a-8200-3df8cc1ed72d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:36.207787 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345ac48-ef3a-4a8a-8200-3df8cc1ed72d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:36.208073 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345ac48-ef3a-4a8a-8200-3df8cc1ed72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:36.227090 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2345ac48-ef3a-4a8a-8200-3df8cc1ed72d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:45:36.228358 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2345ac48-ef3a-4a8a-8200-3df8cc1ed72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:36.236836 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1098/2203] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:45:36.240943 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14a0c8-a47b-48d0-a531-2f861cb5b7bc None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:36.250866 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14a0c8-a47b-48d0-a531-2f861cb5b7bc None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:36.255652 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f948f2-cbe2-40dc-9937-5a18fcf33ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:36.256320 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f948f2-cbe2-40dc-9937-5a18fcf33ddd admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:36.257259 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f948f2-cbe2-40dc-9937-5a18fcf33ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:36.257565 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f948f2-cbe2-40dc-9937-5a18fcf33ddd admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:36.258287 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f948f2-cbe2-40dc-9937-5a18fcf33ddd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:45:36.258591 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f948f2-cbe2-40dc-9937-5a18fcf33ddd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:36.260205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f948f2-cbe2-40dc-9937-5a18fcf33ddd admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:36.271662 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1106/2204] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:45:36.276777 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345ac48-ef3a-4a8a-8200-3df8cc1ed72d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:36.285863 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345ac48-ef3a-4a8a-8200-3df8cc1ed72d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:36.291474 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5a169-76ac-46a7-b3a0-34b5c92132ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:36.292146 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5a169-76ac-46a7-b3a0-34b5c92132ae admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:36.292427 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5a169-76ac-46a7-b3a0-34b5c92132ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:36.292701 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5a169-76ac-46a7-b3a0-34b5c92132ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:36.293453 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5a169-76ac-46a7-b3a0-34b5c92132ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:36.295351 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5a169-76ac-46a7-b3a0-34b5c92132ae admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:36.321488 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1099/2205] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:45:36 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:45:36.325595 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f948f2-cbe2-40dc-9937-5a18fcf33ddd admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:36.335769 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f948f2-cbe2-40dc-9937-5a18fcf33ddd admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:36.390072 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd602cc2-f699-4017-a077-01b41706aaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:36.390735 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd602cc2-f699-4017-a077-01b41706aaac admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:36.391017 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd602cc2-f699-4017-a077-01b41706aaac admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:36.391323 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd602cc2-f699-4017-a077-01b41706aaac admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:36.392183 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd602cc2-f699-4017-a077-01b41706aaac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:36.394092 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd602cc2-f699-4017-a077-01b41706aaac admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:36.415931 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1107/2206] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:45:36 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:45:36.420210 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5a169-76ac-46a7-b3a0-34b5c92132ae admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:36.430770 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5a169-76ac-46a7-b3a0-34b5c92132ae admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:36.435689 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9593dcf-a115-46e4-a884-bff62216aca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:36.438002 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9593dcf-a115-46e4-a884-bff62216aca5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:36.438514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9593dcf-a115-46e4-a884-bff62216aca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:36.438802 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9593dcf-a115-46e4-a884-bff62216aca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:36.439562 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9593dcf-a115-46e4-a884-bff62216aca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:36.441265 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9593dcf-a115-46e4-a884-bff62216aca5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:36.458004 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1100/2207] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:45:36.462801 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd602cc2-f699-4017-a077-01b41706aaac admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:36.472981 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd602cc2-f699-4017-a077-01b41706aaac admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:36.481154 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326ea9e-c3ee-4042-9088-2018e5b4eb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:36.481996 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326ea9e-c3ee-4042-9088-2018e5b4eb25 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:36.482274 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326ea9e-c3ee-4042-9088-2018e5b4eb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:36.482547 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326ea9e-c3ee-4042-9088-2018e5b4eb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:36.483321 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326ea9e-c3ee-4042-9088-2018e5b4eb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:36.484943 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326ea9e-c3ee-4042-9088-2018e5b4eb25 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:36.495436 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1108/2208] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:45:36.499690 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9593dcf-a115-46e4-a884-bff62216aca5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:36.509871 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9593dcf-a115-46e4-a884-bff62216aca5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:36.514557 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c645e-0a79-49e5-aba4-f486412eae03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:36.515419 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c645e-0a79-49e5-aba4-f486412eae03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:36.515702 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c645e-0a79-49e5-aba4-f486412eae03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:36.516018 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c645e-0a79-49e5-aba4-f486412eae03 admin admin] PATH_INFO: `/v3/projects/2b0f0c548e7342809138755617be63c3/users/046f9c25096d4aaba455a91e2c1a5f09/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:36.530975 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c645e-0a79-49e5-aba4-f486412eae03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b0f0c548e7342809138755617be63c3, user_id=046f9c25096d4aaba455a91e2c1a5f09, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:36.533948 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c645e-0a79-49e5-aba4-f486412eae03 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:36.547029 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1101/2209] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:45:36 2022] PUT /identity/v3/projects/2b0f0c548e7342809138755617be63c3/users/046f9c25096d4aaba455a91e2c1a5f09/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:45:36.557435 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fc169-4094-4f34-ab1d-7799f8aa9e7c None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:36.557720 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fc169-4094-4f34-ab1d-7799f8aa9e7c None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:36.557992 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fc169-4094-4f34-ab1d-7799f8aa9e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:36.585368 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-bf3fc169-4094-4f34-ab1d-7799f8aa9e7c None None] MFA Rules not processed for user `046f9c25096d4aaba455a91e2c1a5f09`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:45:36.586590 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-bf3fc169-4094-4f34-ab1d-7799f8aa9e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:36.649085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1109/2210] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:45:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:45:36.660610 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c645e-0a79-49e5-aba4-f486412eae03 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:36.662248 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-993c645e-0a79-49e5-aba4-f486412eae03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:36.757745 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c645e-0a79-49e5-aba4-f486412eae03 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:36.763047 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc043f8-3ad5-4adc-9717-f8c72243be85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:36.763674 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc043f8-3ad5-4adc-9717-f8c72243be85 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:36.764048 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc043f8-3ad5-4adc-9717-f8c72243be85 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:36.764326 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc043f8-3ad5-4adc-9717-f8c72243be85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:36.771778 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc043f8-3ad5-4adc-9717-f8c72243be85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:36.773930 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc043f8-3ad5-4adc-9717-f8c72243be85 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:36.782359 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1102/2211] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:45:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:45:36.963482 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fc169-4094-4f34-ab1d-7799f8aa9e7c None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:37.023150 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fc169-4094-4f34-ab1d-7799f8aa9e7c None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:37.027593 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccf8ea-aca4-4dec-abef-c11d17cab32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:37.028469 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccf8ea-aca4-4dec-abef-c11d17cab32b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:37.028751 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccf8ea-aca4-4dec-abef-c11d17cab32b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:37.029023 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccf8ea-aca4-4dec-abef-c11d17cab32b admin admin] PATH_INFO: `/v3/users/046f9c25096d4aaba455a91e2c1a5f09` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:37.030215 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccf8ea-aca4-4dec-abef-c11d17cab32b admin admin] RBAC: Authorizing `identity:delete_user(user_id=046f9c25096d4aaba455a91e2c1a5f09)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:37.032204 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccf8ea-aca4-4dec-abef-c11d17cab32b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:37.076968 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-89ccf8ea-aca4-4dec-abef-c11d17cab32b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '046f9c25096d4aaba455a91e2c1a5f09'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:37.088537 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-89ccf8ea-aca4-4dec-abef-c11d17cab32b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '046f9c25096d4aaba455a91e2c1a5f09'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:37.095148 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-89ccf8ea-aca4-4dec-abef-c11d17cab32b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '046f9c25096d4aaba455a91e2c1a5f09'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:37.102598 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-89ccf8ea-aca4-4dec-abef-c11d17cab32b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '046f9c25096d4aaba455a91e2c1a5f09'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:37.103347 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-89ccf8ea-aca4-4dec-abef-c11d17cab32b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '046f9c25096d4aaba455a91e2c1a5f09'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:37.109417 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1110/2212] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:45:36 2022] DELETE /identity/v3/users/046f9c25096d4aaba455a91e2c1a5f09 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:45:37.113842 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0efc91-0a57-47ce-96e9-baacd8e70530 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:37.114324 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0efc91-0a57-47ce-96e9-baacd8e70530 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:37.114430 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0efc91-0a57-47ce-96e9-baacd8e70530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:37.133700 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ab0efc91-0a57-47ce-96e9-baacd8e70530 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:45:37.135134 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ab0efc91-0a57-47ce-96e9-baacd8e70530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:37.195445 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1103/2213] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:45:37.202243 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccf8ea-aca4-4dec-abef-c11d17cab32b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:37.203612 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-89ccf8ea-aca4-4dec-abef-c11d17cab32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:37.259986 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccf8ea-aca4-4dec-abef-c11d17cab32b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:37.263857 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57d76c-456f-415f-bd8f-06c19a0a54a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:37.264502 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57d76c-456f-415f-bd8f-06c19a0a54a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:37.264810 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57d76c-456f-415f-bd8f-06c19a0a54a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:37.265084 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57d76c-456f-415f-bd8f-06c19a0a54a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:37.274954 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b57d76c-456f-415f-bd8f-06c19a0a54a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:37.276356 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b57d76c-456f-415f-bd8f-06c19a0a54a1 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:37.285619 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1111/2214] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:45:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:45:37.568543 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0efc91-0a57-47ce-96e9-baacd8e70530 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:37.570897 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ab0efc91-0a57-47ce-96e9-baacd8e70530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:37.594956 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0efc91-0a57-47ce-96e9-baacd8e70530 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:37.601424 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c915e-6df6-4329-84a6-8d36f644a6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:37.602292 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c915e-6df6-4329-84a6-8d36f644a6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:37.602749 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c915e-6df6-4329-84a6-8d36f644a6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:37.603200 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c915e-6df6-4329-84a6-8d36f644a6c9 admin admin] PATH_INFO: `/v3/projects/2b0f0c548e7342809138755617be63c3` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:37.604846 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c915e-6df6-4329-84a6-8d36f644a6c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b0f0c548e7342809138755617be63c3)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:37.608750 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c915e-6df6-4329-84a6-8d36f644a6c9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:37.664433 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-106c915e-6df6-4329-84a6-8d36f644a6c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b0f0c548e7342809138755617be63c3', 'request_id': 'req-106c915e-6df6-4329-84a6-8d36f644a6c9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:37.671165 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-106c915e-6df6-4329-84a6-8d36f644a6c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b0f0c548e7342809138755617be63c3', 'request_id': 'req-106c915e-6df6-4329-84a6-8d36f644a6c9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:37.690769 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-106c915e-6df6-4329-84a6-8d36f644a6c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b0f0c548e7342809138755617be63c3', 'request_id': 'req-106c915e-6df6-4329-84a6-8d36f644a6c9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:37.714154 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-106c915e-6df6-4329-84a6-8d36f644a6c9 admin admin] The token cache is being invalidate because project 2b0f0c548e7342809138755617be63c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:45:37.714451 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-106c915e-6df6-4329-84a6-8d36f644a6c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:37.715237 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-106c915e-6df6-4329-84a6-8d36f644a6c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:37.719886 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1104/2215] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:45:37 2022] DELETE /identity/v3/projects/2b0f0c548e7342809138755617be63c3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:45:37.722980 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ec984-aea4-42a5-abe7-5875b920c6a4 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:37.723440 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ec984-aea4-42a5-abe7-5875b920c6a4 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:37.723534 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ec984-aea4-42a5-abe7-5875b920c6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:37.745583 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-7e7ec984-aea4-42a5-abe7-5875b920c6a4 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:45:37.746807 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-7e7ec984-aea4-42a5-abe7-5875b920c6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:37.812713 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1112/2216] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:45:37.820782 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bef01-95c6-48e9-8784-dc4394e10adb None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:37.821073 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bef01-95c6-48e9-8784-dc4394e10adb None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:37.821353 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bef01-95c6-48e9-8784-dc4394e10adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:37.840031 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-de4bef01-95c6-48e9-8784-dc4394e10adb None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:45:37.841218 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-de4bef01-95c6-48e9-8784-dc4394e10adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:37.849212 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1105/2217] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:45:37.853824 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ec984-aea4-42a5-abe7-5875b920c6a4 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:37.863451 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ec984-aea4-42a5-abe7-5875b920c6a4 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:37.868874 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759aad61-e64c-4d50-a36c-95449491fe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:37.869526 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759aad61-e64c-4d50-a36c-95449491fe61 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:37.869808 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759aad61-e64c-4d50-a36c-95449491fe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:37.870079 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759aad61-e64c-4d50-a36c-95449491fe61 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:37.870822 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759aad61-e64c-4d50-a36c-95449491fe61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:45:37.871130 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759aad61-e64c-4d50-a36c-95449491fe61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:37.872736 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759aad61-e64c-4d50-a36c-95449491fe61 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:37.884658 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1113/2218] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:45:37.888738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bef01-95c6-48e9-8784-dc4394e10adb None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:37.898442 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bef01-95c6-48e9-8784-dc4394e10adb None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:37.903149 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aba1c7-fab6-4374-9f0a-45b4666ea361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:37.903821 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aba1c7-fab6-4374-9f0a-45b4666ea361 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:37.904106 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aba1c7-fab6-4374-9f0a-45b4666ea361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:37.904382 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aba1c7-fab6-4374-9f0a-45b4666ea361 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:37.905082 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aba1c7-fab6-4374-9f0a-45b4666ea361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:37.906967 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aba1c7-fab6-4374-9f0a-45b4666ea361 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:37.931776 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1106/2219] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:45:37 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:45:37.935858 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759aad61-e64c-4d50-a36c-95449491fe61 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:37.945689 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759aad61-e64c-4d50-a36c-95449491fe61 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:37.999633 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50082ec1-32a6-4dd0-9c75-95fc32d6e41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:38.000316 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50082ec1-32a6-4dd0-9c75-95fc32d6e41c admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:38.000599 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50082ec1-32a6-4dd0-9c75-95fc32d6e41c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:38.000875 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50082ec1-32a6-4dd0-9c75-95fc32d6e41c admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:38.001569 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50082ec1-32a6-4dd0-9c75-95fc32d6e41c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:38.003728 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50082ec1-32a6-4dd0-9c75-95fc32d6e41c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:38.024238 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1114/2220] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:45:37 2022] POST /identity/v3/users => generated 282 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:45:38.028316 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aba1c7-fab6-4374-9f0a-45b4666ea361 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:38.039350 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aba1c7-fab6-4374-9f0a-45b4666ea361 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:38.043998 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73e631-9d03-4fc7-9932-b9dafa9b3a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:38.044642 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73e631-9d03-4fc7-9932-b9dafa9b3a86 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:38.044934 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73e631-9d03-4fc7-9932-b9dafa9b3a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:38.045207 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73e631-9d03-4fc7-9932-b9dafa9b3a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:38.045931 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73e631-9d03-4fc7-9932-b9dafa9b3a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:38.047504 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73e631-9d03-4fc7-9932-b9dafa9b3a86 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:38.057760 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1107/2221] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:45:38.061594 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50082ec1-32a6-4dd0-9c75-95fc32d6e41c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:38.071436 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50082ec1-32a6-4dd0-9c75-95fc32d6e41c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:38.076052 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90896b59-7d62-46d8-aa9b-180785dfaa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:38.076686 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90896b59-7d62-46d8-aa9b-180785dfaa44 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:38.076965 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90896b59-7d62-46d8-aa9b-180785dfaa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:38.077236 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90896b59-7d62-46d8-aa9b-180785dfaa44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:38.077965 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90896b59-7d62-46d8-aa9b-180785dfaa44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:38.079520 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90896b59-7d62-46d8-aa9b-180785dfaa44 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:38.089691 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1115/2222] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:45:38.093683 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73e631-9d03-4fc7-9932-b9dafa9b3a86 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:38.104390 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73e631-9d03-4fc7-9932-b9dafa9b3a86 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:38.108979 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e1fdd-3035-498a-a2cb-558df950a8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:38.109818 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e1fdd-3035-498a-a2cb-558df950a8fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:38.110094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e1fdd-3035-498a-a2cb-558df950a8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:38.110367 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e1fdd-3035-498a-a2cb-558df950a8fd admin admin] PATH_INFO: `/v3/projects/99cb153ea6304d198fe52fc48526285d/users/0115f582d9614b6398ed8fe34954207f/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:38.124455 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e1fdd-3035-498a-a2cb-558df950a8fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=99cb153ea6304d198fe52fc48526285d, user_id=0115f582d9614b6398ed8fe34954207f, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:38.127157 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e1fdd-3035-498a-a2cb-558df950a8fd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:38.140389 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1108/2223] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:45:38 2022] PUT /identity/v3/projects/99cb153ea6304d198fe52fc48526285d/users/0115f582d9614b6398ed8fe34954207f/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:45:38.151411 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aedb82-40a5-4a00-8133-064755853ac8 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:38.151744 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aedb82-40a5-4a00-8133-064755853ac8 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:38.152054 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aedb82-40a5-4a00-8133-064755853ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:38.177860 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-a9aedb82-40a5-4a00-8133-064755853ac8 None None] MFA Rules not processed for user `0115f582d9614b6398ed8fe34954207f`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:45:38.179056 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a9aedb82-40a5-4a00-8133-064755853ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:38.240539 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1116/2224] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:45:38 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:45:38.245006 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e1fdd-3035-498a-a2cb-558df950a8fd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:38.316396 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e1fdd-3035-498a-a2cb-558df950a8fd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:38.324894 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2fd3b-116e-484f-aec4-badfa3db4d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:38.325553 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2fd3b-116e-484f-aec4-badfa3db4d7f admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:38.325837 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2fd3b-116e-484f-aec4-badfa3db4d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:38.326247 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2fd3b-116e-484f-aec4-badfa3db4d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:38.326962 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2fd3b-116e-484f-aec4-badfa3db4d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:38.328909 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2fd3b-116e-484f-aec4-badfa3db4d7f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:38.356294 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1109/2225] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:45:38 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:45:38.359969 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aedb82-40a5-4a00-8133-064755853ac8 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:38.371022 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aedb82-40a5-4a00-8133-064755853ac8 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:38.426241 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf46f6-6480-4399-9b2f-ca7b57ad706c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:38.426999 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf46f6-6480-4399-9b2f-ca7b57ad706c admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:38.427349 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf46f6-6480-4399-9b2f-ca7b57ad706c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:38.427692 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf46f6-6480-4399-9b2f-ca7b57ad706c admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:38.428622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf46f6-6480-4399-9b2f-ca7b57ad706c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:38.430606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf46f6-6480-4399-9b2f-ca7b57ad706c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:38.450085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1117/2226] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:45:38 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:45:38.453805 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2fd3b-116e-484f-aec4-badfa3db4d7f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:38.464593 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2fd3b-116e-484f-aec4-badfa3db4d7f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:38.469165 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27840123-4ec8-4539-b990-5fffa369a596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:38.469804 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27840123-4ec8-4539-b990-5fffa369a596 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:38.470080 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27840123-4ec8-4539-b990-5fffa369a596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:38.470349 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27840123-4ec8-4539-b990-5fffa369a596 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:38.471073 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27840123-4ec8-4539-b990-5fffa369a596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:38.472677 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27840123-4ec8-4539-b990-5fffa369a596 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:38.483122 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1110/2227] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:45:38.487060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf46f6-6480-4399-9b2f-ca7b57ad706c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:38.497367 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf46f6-6480-4399-9b2f-ca7b57ad706c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:38.502011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a8e9e-5720-427a-9a52-d9bf9a91c8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:38.502872 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a8e9e-5720-427a-9a52-d9bf9a91c8d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:38.503406 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a8e9e-5720-427a-9a52-d9bf9a91c8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:38.503687 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a8e9e-5720-427a-9a52-d9bf9a91c8d4 admin admin] PATH_INFO: `/v3/projects/f00bbd0e0d574c3aa83bfd4187b1f656/users/32308fb15ffb400e84be268f5256d523/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:38.518247 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a8e9e-5720-427a-9a52-d9bf9a91c8d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f00bbd0e0d574c3aa83bfd4187b1f656, user_id=32308fb15ffb400e84be268f5256d523, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:38.521100 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a8e9e-5720-427a-9a52-d9bf9a91c8d4 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:38.534077 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1118/2228] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:45:38 2022] PUT /identity/v3/projects/f00bbd0e0d574c3aa83bfd4187b1f656/users/32308fb15ffb400e84be268f5256d523/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:45:38.538152 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27840123-4ec8-4539-b990-5fffa369a596 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:38.548515 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27840123-4ec8-4539-b990-5fffa369a596 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:38.606281 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d27c62-e4b4-4afc-aaf1-61eacffa5d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:38.606934 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d27c62-e4b4-4afc-aaf1-61eacffa5d81 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:38.607214 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d27c62-e4b4-4afc-aaf1-61eacffa5d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:38.607490 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d27c62-e4b4-4afc-aaf1-61eacffa5d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:38.608263 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d27c62-e4b4-4afc-aaf1-61eacffa5d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:38.609845 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d27c62-e4b4-4afc-aaf1-61eacffa5d81 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:38.620367 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1111/2229] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:45:38.624552 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a8e9e-5720-427a-9a52-d9bf9a91c8d4 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:38.635598 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a8e9e-5720-427a-9a52-d9bf9a91c8d4 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:38.640234 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4838a-5477-45d8-ab55-cf1a459df1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:38.641089 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4838a-5477-45d8-ab55-cf1a459df1f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:38.641365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4838a-5477-45d8-ab55-cf1a459df1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:38.641663 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4838a-5477-45d8-ab55-cf1a459df1f6 admin admin] PATH_INFO: `/v3/projects/f00bbd0e0d574c3aa83bfd4187b1f656/users/32308fb15ffb400e84be268f5256d523/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:38.643612 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4838a-5477-45d8-ab55-cf1a459df1f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f00bbd0e0d574c3aa83bfd4187b1f656, user_id=32308fb15ffb400e84be268f5256d523, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:38.646239 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4838a-5477-45d8-ab55-cf1a459df1f6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:38.658432 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1119/2230] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:45:38 2022] PUT /identity/v3/projects/f00bbd0e0d574c3aa83bfd4187b1f656/users/32308fb15ffb400e84be268f5256d523/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:45:38.669844 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2819790-f1db-4610-bc3b-5d9c393f6d25 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:38.670128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2819790-f1db-4610-bc3b-5d9c393f6d25 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:38.670404 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2819790-f1db-4610-bc3b-5d9c393f6d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:38.698735 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d2819790-f1db-4610-bc3b-5d9c393f6d25 None None] MFA Rules not processed for user `32308fb15ffb400e84be268f5256d523`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:45:38.699946 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d2819790-f1db-4610-bc3b-5d9c393f6d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:38.776007 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1112/2231] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:45:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:45:38.790882 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4838a-5477-45d8-ab55-cf1a459df1f6 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:38.792869 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-6bc4838a-5477-45d8-ab55-cf1a459df1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:38.876435 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4838a-5477-45d8-ab55-cf1a459df1f6 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:38.883536 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210bedf-3dcb-45b6-967c-1feee7359755 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:38.884664 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210bedf-3dcb-45b6-967c-1feee7359755 service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:38.885155 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210bedf-3dcb-45b6-967c-1feee7359755 service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:38.885641 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210bedf-3dcb-45b6-967c-1feee7359755 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:38.898315 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210bedf-3dcb-45b6-967c-1feee7359755 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:38.898563 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210bedf-3dcb-45b6-967c-1feee7359755 service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:38.910265 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1120/2232] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:45:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:45:38.996985 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2819790-f1db-4610-bc3b-5d9c393f6d25 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:38.998398 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d2819790-f1db-4610-bc3b-5d9c393f6d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:39.010857 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2819790-f1db-4610-bc3b-5d9c393f6d25 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:39.014461 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3f28e-9bc3-4769-99a1-6188faf24062 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:39.015097 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3f28e-9bc3-4769-99a1-6188faf24062 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:39.015381 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3f28e-9bc3-4769-99a1-6188faf24062 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:39.015658 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3f28e-9bc3-4769-99a1-6188faf24062 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:39.071816 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3f28e-9bc3-4769-99a1-6188faf24062 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:39.073240 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3f28e-9bc3-4769-99a1-6188faf24062 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:39.081959 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1113/2233] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:45:38 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:45:39.609548 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210bedf-3dcb-45b6-967c-1feee7359755 service cinder] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:39.610927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-b210bedf-3dcb-45b6-967c-1feee7359755 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:39.675914 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210bedf-3dcb-45b6-967c-1feee7359755 service cinder] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:39.681352 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19aecbc-f753-481f-8e8d-99ce9e174b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:39.682207 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19aecbc-f753-481f-8e8d-99ce9e174b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:39.682511 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19aecbc-f753-481f-8e8d-99ce9e174b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:39.682782 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19aecbc-f753-481f-8e8d-99ce9e174b99 admin admin] PATH_INFO: `/v3/users/53ace7e326e940118da8030481f3e147` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:39.684030 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19aecbc-f753-481f-8e8d-99ce9e174b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53ace7e326e940118da8030481f3e147)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:39.685927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19aecbc-f753-481f-8e8d-99ce9e174b99 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:39.730157 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b19aecbc-f753-481f-8e8d-99ce9e174b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53ace7e326e940118da8030481f3e147'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:39.741259 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b19aecbc-f753-481f-8e8d-99ce9e174b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53ace7e326e940118da8030481f3e147'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:39.748447 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b19aecbc-f753-481f-8e8d-99ce9e174b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53ace7e326e940118da8030481f3e147'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:39.755652 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b19aecbc-f753-481f-8e8d-99ce9e174b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53ace7e326e940118da8030481f3e147'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:39.756294 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b19aecbc-f753-481f-8e8d-99ce9e174b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53ace7e326e940118da8030481f3e147'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:39.762221 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1121/2234] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:45:39 2022] DELETE /identity/v3/users/53ace7e326e940118da8030481f3e147 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:45:39.766960 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00673451-50f4-4857-a007-53bf858bb24e None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:39.767453 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00673451-50f4-4857-a007-53bf858bb24e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:39.767547 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00673451-50f4-4857-a007-53bf858bb24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:39.784409 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-00673451-50f4-4857-a007-53bf858bb24e None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:45:39.785597 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-00673451-50f4-4857-a007-53bf858bb24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:39.841105 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1114/2235] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:45:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:45:39.850586 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19aecbc-f753-481f-8e8d-99ce9e174b99 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:39.852659 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-b19aecbc-f753-481f-8e8d-99ce9e174b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:39.907024 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19aecbc-f753-481f-8e8d-99ce9e174b99 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:39.910678 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed588d-2959-4f99-8275-91c5b4b9672b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:39.911311 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed588d-2959-4f99-8275-91c5b4b9672b service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:39.911593 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed588d-2959-4f99-8275-91c5b4b9672b service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:39.911901 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed588d-2959-4f99-8275-91c5b4b9672b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:39.921508 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed588d-2959-4f99-8275-91c5b4b9672b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:39.922985 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed588d-2959-4f99-8275-91c5b4b9672b service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:39.933038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1122/2236] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:45:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:45:40.229398 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00673451-50f4-4857-a007-53bf858bb24e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:40.231333 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-00673451-50f4-4857-a007-53bf858bb24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:40.251065 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00673451-50f4-4857-a007-53bf858bb24e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:40.257224 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0108f5-4feb-4d1e-972f-bf6060702e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:40.259273 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0108f5-4feb-4d1e-972f-bf6060702e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:40.259536 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0108f5-4feb-4d1e-972f-bf6060702e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:40.259741 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0108f5-4feb-4d1e-972f-bf6060702e2f admin admin] PATH_INFO: `/v3/projects/5478c48675b34d7dbda6ccc8a70fbb84` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:40.261018 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0108f5-4feb-4d1e-972f-bf6060702e2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5478c48675b34d7dbda6ccc8a70fbb84)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:40.263383 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0108f5-4feb-4d1e-972f-bf6060702e2f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:40.315038 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-de0108f5-4feb-4d1e-972f-bf6060702e2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5478c48675b34d7dbda6ccc8a70fbb84', 'request_id': 'req-de0108f5-4feb-4d1e-972f-bf6060702e2f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:40.322061 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-de0108f5-4feb-4d1e-972f-bf6060702e2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5478c48675b34d7dbda6ccc8a70fbb84', 'request_id': 'req-de0108f5-4feb-4d1e-972f-bf6060702e2f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:40.327869 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-de0108f5-4feb-4d1e-972f-bf6060702e2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5478c48675b34d7dbda6ccc8a70fbb84', 'request_id': 'req-de0108f5-4feb-4d1e-972f-bf6060702e2f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:40.341223 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-de0108f5-4feb-4d1e-972f-bf6060702e2f admin admin] The token cache is being invalidate because project 5478c48675b34d7dbda6ccc8a70fbb84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:45:40.341518 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-de0108f5-4feb-4d1e-972f-bf6060702e2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:40.342152 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-de0108f5-4feb-4d1e-972f-bf6060702e2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:40.344180 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1115/2237] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:45:40 2022] DELETE /identity/v3/projects/5478c48675b34d7dbda6ccc8a70fbb84 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:45:40.350142 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4841bb-7d00-4221-89b6-0eb79d581231 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:40.350449 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4841bb-7d00-4221-89b6-0eb79d581231 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:40.350726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4841bb-7d00-4221-89b6-0eb79d581231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:40.368940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-4c4841bb-7d00-4221-89b6-0eb79d581231 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:45:40.370223 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-4c4841bb-7d00-4221-89b6-0eb79d581231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:40.432692 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1123/2238] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:45:40.441638 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f997bb-f5ae-43be-88b7-8b9854b442a2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:40.441933 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f997bb-f5ae-43be-88b7-8b9854b442a2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:40.442222 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f997bb-f5ae-43be-88b7-8b9854b442a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:40.460241 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f0f997bb-f5ae-43be-88b7-8b9854b442a2 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:45:40.461624 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f0f997bb-f5ae-43be-88b7-8b9854b442a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:40.470374 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1116/2239] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:45:40.475273 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4841bb-7d00-4221-89b6-0eb79d581231 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:40.485511 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4841bb-7d00-4221-89b6-0eb79d581231 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:40.490468 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b20a21-d867-46fa-9ae4-b443a1b51c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:40.491129 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b20a21-d867-46fa-9ae4-b443a1b51c7b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:40.491445 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b20a21-d867-46fa-9ae4-b443a1b51c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:40.491726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b20a21-d867-46fa-9ae4-b443a1b51c7b admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:40.493197 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b20a21-d867-46fa-9ae4-b443a1b51c7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:45:40.493452 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b20a21-d867-46fa-9ae4-b443a1b51c7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:40.495054 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b20a21-d867-46fa-9ae4-b443a1b51c7b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:40.507442 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1124/2240] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:45:40.514204 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f997bb-f5ae-43be-88b7-8b9854b442a2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:40.522593 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f997bb-f5ae-43be-88b7-8b9854b442a2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:40.534286 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecfb84-da96-4cab-ad10-1e2594e33f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:40.535392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecfb84-da96-4cab-ad10-1e2594e33f9f admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:40.535392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecfb84-da96-4cab-ad10-1e2594e33f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:40.535642 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecfb84-da96-4cab-ad10-1e2594e33f9f admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:40.536239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecfb84-da96-4cab-ad10-1e2594e33f9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:40.538512 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecfb84-da96-4cab-ad10-1e2594e33f9f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:40.569362 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1117/2241] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:45:40 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:45:40.573978 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b20a21-d867-46fa-9ae4-b443a1b51c7b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:40.584291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b20a21-d867-46fa-9ae4-b443a1b51c7b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:40.646200 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d53330-f503-49d4-b134-4290d40073b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:40.646853 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d53330-f503-49d4-b134-4290d40073b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:40.647137 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d53330-f503-49d4-b134-4290d40073b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:40.647409 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d53330-f503-49d4-b134-4290d40073b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:40.648157 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d53330-f503-49d4-b134-4290d40073b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:40.650203 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d53330-f503-49d4-b134-4290d40073b0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:40.672965 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1125/2242] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:45:40 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:45:40.677118 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecfb84-da96-4cab-ad10-1e2594e33f9f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:40.688093 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecfb84-da96-4cab-ad10-1e2594e33f9f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:40.693432 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85127726-4a3a-4a8a-aa2b-adefecf839f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:40.694104 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85127726-4a3a-4a8a-aa2b-adefecf839f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:40.694389 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85127726-4a3a-4a8a-aa2b-adefecf839f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:40.694662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85127726-4a3a-4a8a-aa2b-adefecf839f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:40.696179 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85127726-4a3a-4a8a-aa2b-adefecf839f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:40.697893 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85127726-4a3a-4a8a-aa2b-adefecf839f3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:40.708512 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1118/2243] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:45:40.713623 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d53330-f503-49d4-b134-4290d40073b0 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:40.723842 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d53330-f503-49d4-b134-4290d40073b0 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:40.729483 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6e3f2-7af1-4aa2-8208-f05b99dd9223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:40.730179 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6e3f2-7af1-4aa2-8208-f05b99dd9223 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:40.730462 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6e3f2-7af1-4aa2-8208-f05b99dd9223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:40.730794 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6e3f2-7af1-4aa2-8208-f05b99dd9223 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:40.731618 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6e3f2-7af1-4aa2-8208-f05b99dd9223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:40.733361 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6e3f2-7af1-4aa2-8208-f05b99dd9223 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:40.744290 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1126/2244] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:45:40.748325 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85127726-4a3a-4a8a-aa2b-adefecf839f3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:40.758504 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85127726-4a3a-4a8a-aa2b-adefecf839f3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:40.763267 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0e748-b332-489a-b95f-53e8781fc841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:40.764176 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0e748-b332-489a-b95f-53e8781fc841 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:40.764460 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0e748-b332-489a-b95f-53e8781fc841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:40.764744 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0e748-b332-489a-b95f-53e8781fc841 admin admin] PATH_INFO: `/v3/projects/321ffdb95b0c469f8f93745e48564322/users/2f4361775773418fac45f36f2a4c7703/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:40.788633 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0e748-b332-489a-b95f-53e8781fc841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=321ffdb95b0c469f8f93745e48564322, user_id=2f4361775773418fac45f36f2a4c7703, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:40.788633 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0e748-b332-489a-b95f-53e8781fc841 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:40.798644 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1119/2245] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:45:40 2022] PUT /identity/v3/projects/321ffdb95b0c469f8f93745e48564322/users/2f4361775773418fac45f36f2a4c7703/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:45:40.809897 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f59c8-5b6c-4620-bbb5-079b1962e50f None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:40.810183 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f59c8-5b6c-4620-bbb5-079b1962e50f None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:40.810459 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f59c8-5b6c-4620-bbb5-079b1962e50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:40.837196 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-7e8f59c8-5b6c-4620-bbb5-079b1962e50f None None] MFA Rules not processed for user `2f4361775773418fac45f36f2a4c7703`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:45:40.838398 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-7e8f59c8-5b6c-4620-bbb5-079b1962e50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:40.901020 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1127/2246] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:45:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:45:40.911605 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0e748-b332-489a-b95f-53e8781fc841 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:40.913387 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-22b0e748-b332-489a-b95f-53e8781fc841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:40.972093 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0e748-b332-489a-b95f-53e8781fc841 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:40.975872 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd2783-4751-45ef-8a86-c102c0832196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:40.977239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd2783-4751-45ef-8a86-c102c0832196 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:40.977537 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd2783-4751-45ef-8a86-c102c0832196 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:40.977811 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd2783-4751-45ef-8a86-c102c0832196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:40.987352 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd2783-4751-45ef-8a86-c102c0832196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:40.989133 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd2783-4751-45ef-8a86-c102c0832196 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:40.999740 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1120/2247] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:45:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:45:42.212197 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f59c8-5b6c-4620-bbb5-079b1962e50f None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:42.214485 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-7e8f59c8-5b6c-4620-bbb5-079b1962e50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:42.278837 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f59c8-5b6c-4620-bbb5-079b1962e50f None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:42.282761 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ff4dd-0865-4f46-a907-242d63f192f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:42.283427 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ff4dd-0865-4f46-a907-242d63f192f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:42.283710 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ff4dd-0865-4f46-a907-242d63f192f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:42.284021 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ff4dd-0865-4f46-a907-242d63f192f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:42.285824 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-ce1ff4dd-0865-4f46-a907-242d63f192f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:42.352263 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ff4dd-0865-4f46-a907-242d63f192f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:42.353694 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ff4dd-0865-4f46-a907-242d63f192f7 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:42.365140 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1128/2248] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:45:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:45:52.517220 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd2783-4751-45ef-8a86-c102c0832196 service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:52.518735 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-11bd2783-4751-45ef-8a86-c102c0832196 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:52.601132 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd2783-4751-45ef-8a86-c102c0832196 service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:52.612184 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dcdfd-77ff-4edc-a500-35e7824da3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:52.613762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dcdfd-77ff-4edc-a500-35e7824da3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:52.614057 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dcdfd-77ff-4edc-a500-35e7824da3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:52.614486 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dcdfd-77ff-4edc-a500-35e7824da3c6 admin admin] PATH_INFO: `/v3/users/0115f582d9614b6398ed8fe34954207f` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:52.615966 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8dcdfd-77ff-4edc-a500-35e7824da3c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0115f582d9614b6398ed8fe34954207f)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:52.617963 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8dcdfd-77ff-4edc-a500-35e7824da3c6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:52.703394 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3b8dcdfd-77ff-4edc-a500-35e7824da3c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0115f582d9614b6398ed8fe34954207f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:52.712827 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3b8dcdfd-77ff-4edc-a500-35e7824da3c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0115f582d9614b6398ed8fe34954207f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:52.725770 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3b8dcdfd-77ff-4edc-a500-35e7824da3c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0115f582d9614b6398ed8fe34954207f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:52.734136 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3b8dcdfd-77ff-4edc-a500-35e7824da3c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0115f582d9614b6398ed8fe34954207f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:52.734917 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3b8dcdfd-77ff-4edc-a500-35e7824da3c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0115f582d9614b6398ed8fe34954207f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:52.745885 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1121/2249] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:45:52 2022] DELETE /identity/v3/users/0115f582d9614b6398ed8fe34954207f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:45:52.747393 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e44f23-84f1-462d-bb22-f3314bc86bbc None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:52.747975 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e44f23-84f1-462d-bb22-f3314bc86bbc None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:52.748074 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e44f23-84f1-462d-bb22-f3314bc86bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:52.768540 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-46e44f23-84f1-462d-bb22-f3314bc86bbc None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:45:52.769944 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-46e44f23-84f1-462d-bb22-f3314bc86bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:52.857237 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dcdfd-77ff-4edc-a500-35e7824da3c6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:52.858681 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3b8dcdfd-77ff-4edc-a500-35e7824da3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:52.862816 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1129/2250] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:45:52.933921 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dcdfd-77ff-4edc-a500-35e7824da3c6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:52.937739 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91767ebc-b1d8-48ee-b086-5f2853b066cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:52.938386 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91767ebc-b1d8-48ee-b086-5f2853b066cb service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:52.938670 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91767ebc-b1d8-48ee-b086-5f2853b066cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:52.938949 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91767ebc-b1d8-48ee-b086-5f2853b066cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:52.949126 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91767ebc-b1d8-48ee-b086-5f2853b066cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:52.950569 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91767ebc-b1d8-48ee-b086-5f2853b066cb service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:52.960045 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1122/2251] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:45:53.255500 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e44f23-84f1-462d-bb22-f3314bc86bbc None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:53.257077 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-46e44f23-84f1-462d-bb22-f3314bc86bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:53.270329 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e44f23-84f1-462d-bb22-f3314bc86bbc None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:53.277577 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fafe6-70e5-4d58-9054-da86bf1081d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:53.278685 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fafe6-70e5-4d58-9054-da86bf1081d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:53.280115 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fafe6-70e5-4d58-9054-da86bf1081d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:53.280236 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fafe6-70e5-4d58-9054-da86bf1081d5 admin admin] PATH_INFO: `/v3/projects/99cb153ea6304d198fe52fc48526285d` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:53.281409 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fafe6-70e5-4d58-9054-da86bf1081d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99cb153ea6304d198fe52fc48526285d)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:53.283554 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fafe6-70e5-4d58-9054-da86bf1081d5 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:53.331862 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-743fafe6-70e5-4d58-9054-da86bf1081d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99cb153ea6304d198fe52fc48526285d', 'request_id': 'req-743fafe6-70e5-4d58-9054-da86bf1081d5'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:53.338792 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-743fafe6-70e5-4d58-9054-da86bf1081d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99cb153ea6304d198fe52fc48526285d', 'request_id': 'req-743fafe6-70e5-4d58-9054-da86bf1081d5'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:53.345331 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-743fafe6-70e5-4d58-9054-da86bf1081d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99cb153ea6304d198fe52fc48526285d', 'request_id': 'req-743fafe6-70e5-4d58-9054-da86bf1081d5'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:53.358066 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-743fafe6-70e5-4d58-9054-da86bf1081d5 admin admin] The token cache is being invalidate because project 99cb153ea6304d198fe52fc48526285d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:45:53.358362 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-743fafe6-70e5-4d58-9054-da86bf1081d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:53.358997 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-743fafe6-70e5-4d58-9054-da86bf1081d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:53.360560 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1130/2252] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:45:53 2022] DELETE /identity/v3/projects/99cb153ea6304d198fe52fc48526285d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:45:53.364388 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91767ebc-b1d8-48ee-b086-5f2853b066cb service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:53.374406 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91767ebc-b1d8-48ee-b086-5f2853b066cb service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:53.429768 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171a876-c640-495f-be7a-3c55c6163e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:53.430644 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171a876-c640-495f-be7a-3c55c6163e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:53.430928 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171a876-c640-495f-be7a-3c55c6163e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:53.431208 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171a876-c640-495f-be7a-3c55c6163e2b admin admin] PATH_INFO: `/v3/users/32308fb15ffb400e84be268f5256d523` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:53.432401 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171a876-c640-495f-be7a-3c55c6163e2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=32308fb15ffb400e84be268f5256d523)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:53.434309 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171a876-c640-495f-be7a-3c55c6163e2b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:53.478084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b171a876-c640-495f-be7a-3c55c6163e2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32308fb15ffb400e84be268f5256d523'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:53.484565 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b171a876-c640-495f-be7a-3c55c6163e2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32308fb15ffb400e84be268f5256d523'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:53.496186 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b171a876-c640-495f-be7a-3c55c6163e2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32308fb15ffb400e84be268f5256d523'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:53.504353 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b171a876-c640-495f-be7a-3c55c6163e2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32308fb15ffb400e84be268f5256d523'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:53.504980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b171a876-c640-495f-be7a-3c55c6163e2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32308fb15ffb400e84be268f5256d523'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:53.511489 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1123/2253] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:45:53 2022] DELETE /identity/v3/users/32308fb15ffb400e84be268f5256d523 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:45:53.788056 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fafe6-70e5-4d58-9054-da86bf1081d5 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:53.789804 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-743fafe6-70e5-4d58-9054-da86bf1081d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:53.805294 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fafe6-70e5-4d58-9054-da86bf1081d5 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:53.880078 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a7b2f-82d7-483e-99cc-6a945c678709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:53.880931 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a7b2f-82d7-483e-99cc-6a945c678709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:53.881209 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a7b2f-82d7-483e-99cc-6a945c678709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:53.881482 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a7b2f-82d7-483e-99cc-6a945c678709 admin admin] PATH_INFO: `/v3/projects/f00bbd0e0d574c3aa83bfd4187b1f656` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:53.883411 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a7b2f-82d7-483e-99cc-6a945c678709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f00bbd0e0d574c3aa83bfd4187b1f656)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:53.886693 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a7b2f-82d7-483e-99cc-6a945c678709 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:53.948286 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-d49a7b2f-82d7-483e-99cc-6a945c678709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f00bbd0e0d574c3aa83bfd4187b1f656', 'request_id': 'req-d49a7b2f-82d7-483e-99cc-6a945c678709'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:53.954797 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-d49a7b2f-82d7-483e-99cc-6a945c678709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f00bbd0e0d574c3aa83bfd4187b1f656', 'request_id': 'req-d49a7b2f-82d7-483e-99cc-6a945c678709'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:53.960254 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-d49a7b2f-82d7-483e-99cc-6a945c678709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f00bbd0e0d574c3aa83bfd4187b1f656', 'request_id': 'req-d49a7b2f-82d7-483e-99cc-6a945c678709'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:53.974604 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-d49a7b2f-82d7-483e-99cc-6a945c678709 admin admin] The token cache is being invalidate because project f00bbd0e0d574c3aa83bfd4187b1f656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:45:53.974961 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-d49a7b2f-82d7-483e-99cc-6a945c678709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:53.975791 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-d49a7b2f-82d7-483e-99cc-6a945c678709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:45:53.982325 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1131/2254] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:45:53 2022] DELETE /identity/v3/projects/f00bbd0e0d574c3aa83bfd4187b1f656 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:45:53.985032 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b0c14-093a-475e-b29f-79ea06427ed6 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:53.985597 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b0c14-093a-475e-b29f-79ea06427ed6 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:53.986102 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b0c14-093a-475e-b29f-79ea06427ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:54.014512 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-331b0c14-093a-475e-b29f-79ea06427ed6 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:45:54.016033 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-331b0c14-093a-475e-b29f-79ea06427ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:54.081955 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1124/2255] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:45:54.091986 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395f41a-b370-4792-af67-90bdba8184d4 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:54.092581 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395f41a-b370-4792-af67-90bdba8184d4 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:54.093097 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395f41a-b370-4792-af67-90bdba8184d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:54.115112 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-a395f41a-b370-4792-af67-90bdba8184d4 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:45:54.116423 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a395f41a-b370-4792-af67-90bdba8184d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:54.133066 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1132/2256] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:45:54.137783 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b0c14-093a-475e-b29f-79ea06427ed6 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:54.148566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b0c14-093a-475e-b29f-79ea06427ed6 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:54.153906 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0731940-a8ac-4370-8627-e1a9bbd0c337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:54.154549 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0731940-a8ac-4370-8627-e1a9bbd0c337 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:54.154827 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0731940-a8ac-4370-8627-e1a9bbd0c337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:54.155098 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0731940-a8ac-4370-8627-e1a9bbd0c337 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:54.155859 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0731940-a8ac-4370-8627-e1a9bbd0c337 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:45:54.158748 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0731940-a8ac-4370-8627-e1a9bbd0c337 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:54.158748 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0731940-a8ac-4370-8627-e1a9bbd0c337 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:54.170433 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1125/2257] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:45:54.175296 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395f41a-b370-4792-af67-90bdba8184d4 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:54.186158 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395f41a-b370-4792-af67-90bdba8184d4 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:54.191376 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fc27e-a988-41e6-80ed-766f8d8074ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:54.192088 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fc27e-a988-41e6-80ed-766f8d8074ed admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:54.192384 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fc27e-a988-41e6-80ed-766f8d8074ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:54.192658 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fc27e-a988-41e6-80ed-766f8d8074ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:54.193372 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fc27e-a988-41e6-80ed-766f8d8074ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:54.195264 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fc27e-a988-41e6-80ed-766f8d8074ed admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:54.224162 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1133/2258] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:45:54 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:45:54.229545 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0731940-a8ac-4370-8627-e1a9bbd0c337 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:54.239530 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0731940-a8ac-4370-8627-e1a9bbd0c337 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:54.303457 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e6880-a159-4efe-aca8-6cd060b4df58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:54.304147 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e6880-a159-4efe-aca8-6cd060b4df58 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:54.304445 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e6880-a159-4efe-aca8-6cd060b4df58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:54.304702 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e6880-a159-4efe-aca8-6cd060b4df58 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:54.305406 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e6880-a159-4efe-aca8-6cd060b4df58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:54.307962 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e6880-a159-4efe-aca8-6cd060b4df58 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:54.331891 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1126/2259] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:45:54 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:45:54.335686 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fc27e-a988-41e6-80ed-766f8d8074ed admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:54.347175 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fc27e-a988-41e6-80ed-766f8d8074ed admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:54.351785 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853b527-a6d5-4167-a4e7-aa46b0d671dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:54.352467 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853b527-a6d5-4167-a4e7-aa46b0d671dd admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:54.352933 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853b527-a6d5-4167-a4e7-aa46b0d671dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:54.353235 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853b527-a6d5-4167-a4e7-aa46b0d671dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:54.353970 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853b527-a6d5-4167-a4e7-aa46b0d671dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:54.355550 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853b527-a6d5-4167-a4e7-aa46b0d671dd admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:54.369041 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1134/2260] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:45:54.373230 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e6880-a159-4efe-aca8-6cd060b4df58 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:54.385705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e6880-a159-4efe-aca8-6cd060b4df58 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:54.391592 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936a07f-f959-413c-b5b5-e735c69f8e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:54.392285 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936a07f-f959-413c-b5b5-e735c69f8e51 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:54.392570 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936a07f-f959-413c-b5b5-e735c69f8e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:54.392849 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936a07f-f959-413c-b5b5-e735c69f8e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:54.395008 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936a07f-f959-413c-b5b5-e735c69f8e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:54.398329 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936a07f-f959-413c-b5b5-e735c69f8e51 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:54.409275 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1127/2261] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:45:54.413879 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853b527-a6d5-4167-a4e7-aa46b0d671dd admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:54.427195 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853b527-a6d5-4167-a4e7-aa46b0d671dd admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:54.432991 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415e309-2c59-4018-9050-48f246e27608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:54.434145 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415e309-2c59-4018-9050-48f246e27608 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:54.434429 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415e309-2c59-4018-9050-48f246e27608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:54.434707 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415e309-2c59-4018-9050-48f246e27608 admin admin] PATH_INFO: `/v3/projects/cfee34ae1a1b4c838596f5919f6bdfda/users/9918cf42c2f04f5da7847fd1f11b68a5/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:54.454063 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415e309-2c59-4018-9050-48f246e27608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfee34ae1a1b4c838596f5919f6bdfda, user_id=9918cf42c2f04f5da7847fd1f11b68a5, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:54.456811 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415e309-2c59-4018-9050-48f246e27608 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:54.471091 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1135/2262] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:45:54 2022] PUT /identity/v3/projects/cfee34ae1a1b4c838596f5919f6bdfda/users/9918cf42c2f04f5da7847fd1f11b68a5/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:45:54.482986 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ec1b-4991-45fe-9c6c-f7503d0e7300 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:54.483364 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ec1b-4991-45fe-9c6c-f7503d0e7300 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:54.483646 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ec1b-4991-45fe-9c6c-f7503d0e7300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:54.512746 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-0474ec1b-4991-45fe-9c6c-f7503d0e7300 None None] MFA Rules not processed for user `9918cf42c2f04f5da7847fd1f11b68a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:45:54.514018 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0474ec1b-4991-45fe-9c6c-f7503d0e7300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:54.578266 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1128/2263] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:45:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:45:54.582780 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415e309-2c59-4018-9050-48f246e27608 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:54.643018 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415e309-2c59-4018-9050-48f246e27608 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:54.647685 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28609d-af6f-4216-acdc-8a6fdc224f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:54.648363 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28609d-af6f-4216-acdc-8a6fdc224f3f admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:54.648648 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28609d-af6f-4216-acdc-8a6fdc224f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:54.648927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28609d-af6f-4216-acdc-8a6fdc224f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:54.649738 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28609d-af6f-4216-acdc-8a6fdc224f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:54.651973 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28609d-af6f-4216-acdc-8a6fdc224f3f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:54.684150 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1136/2264] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:45:54 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:45:54.685424 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474ec1b-4991-45fe-9c6c-f7503d0e7300 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:54.696371 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474ec1b-4991-45fe-9c6c-f7503d0e7300 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:54.757469 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9955bb-ff44-4d63-84e1-45f117211f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:54.758122 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9955bb-ff44-4d63-84e1-45f117211f5e admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:54.758417 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9955bb-ff44-4d63-84e1-45f117211f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:54.758991 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9955bb-ff44-4d63-84e1-45f117211f5e admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:54.759699 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9955bb-ff44-4d63-84e1-45f117211f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:54.761640 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9955bb-ff44-4d63-84e1-45f117211f5e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:54.786267 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1129/2265] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:45:54 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:45:54.787585 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28609d-af6f-4216-acdc-8a6fdc224f3f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:54.798731 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28609d-af6f-4216-acdc-8a6fdc224f3f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:54.803891 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10160dd-4c6c-4a44-ae95-1ffc1640d088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:54.804554 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10160dd-4c6c-4a44-ae95-1ffc1640d088 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:54.804836 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10160dd-4c6c-4a44-ae95-1ffc1640d088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:54.805112 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10160dd-4c6c-4a44-ae95-1ffc1640d088 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:54.806433 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10160dd-4c6c-4a44-ae95-1ffc1640d088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:54.808043 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10160dd-4c6c-4a44-ae95-1ffc1640d088 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:54.819018 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1137/2266] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:45:54.823577 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9955bb-ff44-4d63-84e1-45f117211f5e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:54.834212 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9955bb-ff44-4d63-84e1-45f117211f5e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:54.840223 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987076c9-4cad-49b6-9e76-c8e77268c99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:54.841000 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987076c9-4cad-49b6-9e76-c8e77268c99b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:54.841396 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987076c9-4cad-49b6-9e76-c8e77268c99b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:54.841758 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987076c9-4cad-49b6-9e76-c8e77268c99b admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:54.842505 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987076c9-4cad-49b6-9e76-c8e77268c99b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:54.844179 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987076c9-4cad-49b6-9e76-c8e77268c99b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:54.857371 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1130/2267] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:45:54.861990 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10160dd-4c6c-4a44-ae95-1ffc1640d088 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:54.873004 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10160dd-4c6c-4a44-ae95-1ffc1640d088 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:54.877720 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156529e6-5f43-4c8f-acaa-bfccee8c8129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:54.878849 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156529e6-5f43-4c8f-acaa-bfccee8c8129 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:54.879114 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156529e6-5f43-4c8f-acaa-bfccee8c8129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:54.879387 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156529e6-5f43-4c8f-acaa-bfccee8c8129 admin admin] PATH_INFO: `/v3/projects/7791215142d045cb9a0b59d2630feb3b/users/ae263872039c448299569b644b258bfd/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:54.893585 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156529e6-5f43-4c8f-acaa-bfccee8c8129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7791215142d045cb9a0b59d2630feb3b, user_id=ae263872039c448299569b644b258bfd, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:54.896210 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156529e6-5f43-4c8f-acaa-bfccee8c8129 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:54.909404 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1138/2268] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:45:54 2022] PUT /identity/v3/projects/7791215142d045cb9a0b59d2630feb3b/users/ae263872039c448299569b644b258bfd/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:45:54.921500 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5e89c-95a0-4c42-a923-ac7fc9aca7ce None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:54.921863 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5e89c-95a0-4c42-a923-ac7fc9aca7ce None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:54.922552 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5e89c-95a0-4c42-a923-ac7fc9aca7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:54.949517 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-81a5e89c-95a0-4c42-a923-ac7fc9aca7ce None None] MFA Rules not processed for user `ae263872039c448299569b644b258bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:45:54.950723 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-81a5e89c-95a0-4c42-a923-ac7fc9aca7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:55.012010 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1131/2269] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:45:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:45:55.016377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156529e6-5f43-4c8f-acaa-bfccee8c8129 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:55.075996 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156529e6-5f43-4c8f-acaa-bfccee8c8129 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:55.080694 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea54d4c-a17f-41c0-ac3b-119727c5dc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:55.081339 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea54d4c-a17f-41c0-ac3b-119727c5dc2a admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:55.081624 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea54d4c-a17f-41c0-ac3b-119727c5dc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:55.081903 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea54d4c-a17f-41c0-ac3b-119727c5dc2a admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:55.082605 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea54d4c-a17f-41c0-ac3b-119727c5dc2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:55.084536 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea54d4c-a17f-41c0-ac3b-119727c5dc2a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:55.109542 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1139/2270] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:45:55 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:45:55.113649 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5e89c-95a0-4c42-a923-ac7fc9aca7ce None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:55.124632 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5e89c-95a0-4c42-a923-ac7fc9aca7ce None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:55.179593 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cc4d0-05e9-407a-b505-96e2caee3955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:55.180207 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cc4d0-05e9-407a-b505-96e2caee3955 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:55.180493 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cc4d0-05e9-407a-b505-96e2caee3955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:55.181300 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cc4d0-05e9-407a-b505-96e2caee3955 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:55.181993 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511cc4d0-05e9-407a-b505-96e2caee3955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:55.183959 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511cc4d0-05e9-407a-b505-96e2caee3955 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:55.203606 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1132/2271] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:45:55 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:45:55.207519 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea54d4c-a17f-41c0-ac3b-119727c5dc2a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:55.219104 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea54d4c-a17f-41c0-ac3b-119727c5dc2a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:55.223779 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825ab07-47d6-4ea8-b1bb-6dc1f980e163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:55.224456 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825ab07-47d6-4ea8-b1bb-6dc1f980e163 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:55.224735 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825ab07-47d6-4ea8-b1bb-6dc1f980e163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:55.225025 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825ab07-47d6-4ea8-b1bb-6dc1f980e163 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:55.225745 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825ab07-47d6-4ea8-b1bb-6dc1f980e163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:55.227376 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825ab07-47d6-4ea8-b1bb-6dc1f980e163 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:55.238538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1140/2272] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:45:55.242739 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cc4d0-05e9-407a-b505-96e2caee3955 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:55.255148 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cc4d0-05e9-407a-b505-96e2caee3955 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:55.257741 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca7184-19b5-43c5-bfb5-5990574abcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:55.258673 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca7184-19b5-43c5-bfb5-5990574abcf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:55.259144 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca7184-19b5-43c5-bfb5-5990574abcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:55.259427 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca7184-19b5-43c5-bfb5-5990574abcf3 admin admin] PATH_INFO: `/v3/projects/ba844e1e5c894feea61caffa2e319976/users/57a618f928b4435289b13369ae927b31/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:55.273874 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca7184-19b5-43c5-bfb5-5990574abcf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba844e1e5c894feea61caffa2e319976, user_id=57a618f928b4435289b13369ae927b31, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:55.277048 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca7184-19b5-43c5-bfb5-5990574abcf3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:55.289212 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1133/2273] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:45:55 2022] PUT /identity/v3/projects/ba844e1e5c894feea61caffa2e319976/users/57a618f928b4435289b13369ae927b31/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:45:55.293222 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825ab07-47d6-4ea8-b1bb-6dc1f980e163 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:55.303219 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825ab07-47d6-4ea8-b1bb-6dc1f980e163 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:55.358975 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02763fd3-defa-4633-9270-a6f507f1ed88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:55.359633 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02763fd3-defa-4633-9270-a6f507f1ed88 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:55.359976 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02763fd3-defa-4633-9270-a6f507f1ed88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:55.360252 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02763fd3-defa-4633-9270-a6f507f1ed88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:55.360987 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02763fd3-defa-4633-9270-a6f507f1ed88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:55.362597 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02763fd3-defa-4633-9270-a6f507f1ed88 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:55.372750 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1141/2274] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:45:55.377023 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca7184-19b5-43c5-bfb5-5990574abcf3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:55.387620 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca7184-19b5-43c5-bfb5-5990574abcf3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:55.392289 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2087724-e613-49f3-96ff-2dd3fe89abd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:55.393154 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2087724-e613-49f3-96ff-2dd3fe89abd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:55.393437 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2087724-e613-49f3-96ff-2dd3fe89abd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:55.393716 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2087724-e613-49f3-96ff-2dd3fe89abd7 admin admin] PATH_INFO: `/v3/projects/ba844e1e5c894feea61caffa2e319976/users/57a618f928b4435289b13369ae927b31/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:55.395689 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2087724-e613-49f3-96ff-2dd3fe89abd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba844e1e5c894feea61caffa2e319976, user_id=57a618f928b4435289b13369ae927b31, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:55.398338 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2087724-e613-49f3-96ff-2dd3fe89abd7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:55.408748 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1134/2275] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:45:55 2022] PUT /identity/v3/projects/ba844e1e5c894feea61caffa2e319976/users/57a618f928b4435289b13369ae927b31/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:45:55.419426 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf7fc2-7ec8-47df-9bdd-06a7bd99299e None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:55.419718 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf7fc2-7ec8-47df-9bdd-06a7bd99299e None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:55.420031 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf7fc2-7ec8-47df-9bdd-06a7bd99299e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:55.445778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-d9bf7fc2-7ec8-47df-9bdd-06a7bd99299e None None] MFA Rules not processed for user `57a618f928b4435289b13369ae927b31`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:45:55.447088 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d9bf7fc2-7ec8-47df-9bdd-06a7bd99299e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:55.512532 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1142/2276] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:45:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:45:55.523037 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2087724-e613-49f3-96ff-2dd3fe89abd7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:55.524909 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c2087724-e613-49f3-96ff-2dd3fe89abd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:45:55.579420 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2087724-e613-49f3-96ff-2dd3fe89abd7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:55.583035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cabed-dd0f-4253-b43a-00580519ceeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:55.583662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cabed-dd0f-4253-b43a-00580519ceeb service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:55.583969 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cabed-dd0f-4253-b43a-00580519ceeb service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:55.584242 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cabed-dd0f-4253-b43a-00580519ceeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:55.593192 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cabed-dd0f-4253-b43a-00580519ceeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:55.594616 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cabed-dd0f-4253-b43a-00580519ceeb service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:55.604156 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1135/2277] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:45:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:45:56.073555 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf7fc2-7ec8-47df-9bdd-06a7bd99299e None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:45:56.083790 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf7fc2-7ec8-47df-9bdd-06a7bd99299e None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:45:56.088013 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549aa400-055d-4909-ae4e-7557c0771556 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:45:56.089120 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549aa400-055d-4909-ae4e-7557c0771556 service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:45:56.089576 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549aa400-055d-4909-ae4e-7557c0771556 service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:45:56.089855 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549aa400-055d-4909-ae4e-7557c0771556 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:45:56.146912 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549aa400-055d-4909-ae4e-7557c0771556 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:45:56.148396 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549aa400-055d-4909-ae4e-7557c0771556 service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:45:56.158179 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1143/2278] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:45:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:46:05.590003 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f861c4-2801-40ff-95b8-9bffb38fbed5 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:05.590487 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f861c4-2801-40ff-95b8-9bffb38fbed5 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:05.590581 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f861c4-2801-40ff-95b8-9bffb38fbed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:05.609155 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-60f861c4-2801-40ff-95b8-9bffb38fbed5 None None] MFA Rules not processed for user `2a7421e6184e497eb23bf9f87957322c`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:05.610359 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-60f861c4-2801-40ff-95b8-9bffb38fbed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:05.664699 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1136/2279] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:08.008401 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549aa400-055d-4909-ae4e-7557c0771556 service cinder] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:08.010453 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-549aa400-055d-4909-ae4e-7557c0771556 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:08.078648 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549aa400-055d-4909-ae4e-7557c0771556 service cinder] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:08.083926 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11a79b-3423-4cef-9a6b-d7fd07763ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:08.084871 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11a79b-3423-4cef-9a6b-d7fd07763ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:08.085329 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11a79b-3423-4cef-9a6b-d7fd07763ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:08.085613 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11a79b-3423-4cef-9a6b-d7fd07763ff3 admin admin] PATH_INFO: `/v3/users/2f4361775773418fac45f36f2a4c7703` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:08.086843 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11a79b-3423-4cef-9a6b-d7fd07763ff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f4361775773418fac45f36f2a4c7703)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:08.088930 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11a79b-3423-4cef-9a6b-d7fd07763ff3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:08.151814 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-de11a79b-3423-4cef-9a6b-d7fd07763ff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f4361775773418fac45f36f2a4c7703'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:08.167128 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-de11a79b-3423-4cef-9a6b-d7fd07763ff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f4361775773418fac45f36f2a4c7703'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:08.174287 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-de11a79b-3423-4cef-9a6b-d7fd07763ff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f4361775773418fac45f36f2a4c7703'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:08.182670 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-de11a79b-3423-4cef-9a6b-d7fd07763ff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f4361775773418fac45f36f2a4c7703'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:08.183462 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-de11a79b-3423-4cef-9a6b-d7fd07763ff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f4361775773418fac45f36f2a4c7703'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:08.189820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1144/2280] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:46:08 2022] DELETE /identity/v3/users/2f4361775773418fac45f36f2a4c7703 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:08.194420 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff515721-8fe9-42cb-8066-a767fe694453 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:08.194899 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff515721-8fe9-42cb-8066-a767fe694453 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:08.195035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff515721-8fe9-42cb-8066-a767fe694453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:08.214178 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ff515721-8fe9-42cb-8066-a767fe694453 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:08.215387 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ff515721-8fe9-42cb-8066-a767fe694453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:08.292011 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1137/2281] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:08.302532 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11a79b-3423-4cef-9a6b-d7fd07763ff3 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:08.304945 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-de11a79b-3423-4cef-9a6b-d7fd07763ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:08.378554 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11a79b-3423-4cef-9a6b-d7fd07763ff3 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:08.382653 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bbc70-6d57-4094-8ba7-d53b2b8d140d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:08.385008 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bbc70-6d57-4094-8ba7-d53b2b8d140d service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:08.385587 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bbc70-6d57-4094-8ba7-d53b2b8d140d service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:08.385587 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bbc70-6d57-4094-8ba7-d53b2b8d140d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:08.396792 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5bbc70-6d57-4094-8ba7-d53b2b8d140d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:08.398321 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5bbc70-6d57-4094-8ba7-d53b2b8d140d service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:08.410952 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1145/2282] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:46:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:46:08.700700 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff515721-8fe9-42cb-8066-a767fe694453 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:08.702428 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ff515721-8fe9-42cb-8066-a767fe694453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:08.717231 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff515721-8fe9-42cb-8066-a767fe694453 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:08.722208 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a20ca0-b642-4868-8f0d-81e18badc77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:08.723149 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a20ca0-b642-4868-8f0d-81e18badc77f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:08.723492 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a20ca0-b642-4868-8f0d-81e18badc77f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:08.723864 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a20ca0-b642-4868-8f0d-81e18badc77f admin admin] PATH_INFO: `/v3/projects/321ffdb95b0c469f8f93745e48564322` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:08.727142 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a20ca0-b642-4868-8f0d-81e18badc77f admin admin] RBAC: Authorizing `identity:delete_project(project_id=321ffdb95b0c469f8f93745e48564322)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:08.730521 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a20ca0-b642-4868-8f0d-81e18badc77f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:08.798457 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c1a20ca0-b642-4868-8f0d-81e18badc77f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '321ffdb95b0c469f8f93745e48564322', 'request_id': 'req-c1a20ca0-b642-4868-8f0d-81e18badc77f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:08.804867 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c1a20ca0-b642-4868-8f0d-81e18badc77f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '321ffdb95b0c469f8f93745e48564322', 'request_id': 'req-c1a20ca0-b642-4868-8f0d-81e18badc77f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:08.813487 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c1a20ca0-b642-4868-8f0d-81e18badc77f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '321ffdb95b0c469f8f93745e48564322', 'request_id': 'req-c1a20ca0-b642-4868-8f0d-81e18badc77f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:08.828760 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c1a20ca0-b642-4868-8f0d-81e18badc77f admin admin] The token cache is being invalidate because project 321ffdb95b0c469f8f93745e48564322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:46:08.829189 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c1a20ca0-b642-4868-8f0d-81e18badc77f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:08.829947 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c1a20ca0-b642-4868-8f0d-81e18badc77f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:08.831631 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1138/2283] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:46:08 2022] DELETE /identity/v3/projects/321ffdb95b0c469f8f93745e48564322 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:08.838762 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd7584-56b2-4017-b7fb-1821545f30ee None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:08.839245 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd7584-56b2-4017-b7fb-1821545f30ee None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:08.839590 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd7584-56b2-4017-b7fb-1821545f30ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:08.857957 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-0abd7584-56b2-4017-b7fb-1821545f30ee None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:08.859311 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-0abd7584-56b2-4017-b7fb-1821545f30ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:08.921553 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1146/2284] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:08.928811 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8167c-94a8-4c89-9b1c-d9cfa7ff8dc5 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:08.929097 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8167c-94a8-4c89-9b1c-d9cfa7ff8dc5 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:08.929372 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8167c-94a8-4c89-9b1c-d9cfa7ff8dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:08.948808 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-01f8167c-94a8-4c89-9b1c-d9cfa7ff8dc5 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:08.950009 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-01f8167c-94a8-4c89-9b1c-d9cfa7ff8dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:08.958583 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1139/2285] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:08.962550 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd7584-56b2-4017-b7fb-1821545f30ee None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:08.972618 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd7584-56b2-4017-b7fb-1821545f30ee None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:08.977424 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec987b4-a60d-4ed5-8942-124014fa8a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:08.978657 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec987b4-a60d-4ed5-8942-124014fa8a47 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:08.979015 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec987b4-a60d-4ed5-8942-124014fa8a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:08.979377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec987b4-a60d-4ed5-8942-124014fa8a47 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:08.980406 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec987b4-a60d-4ed5-8942-124014fa8a47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:46:08.980813 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec987b4-a60d-4ed5-8942-124014fa8a47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:08.982400 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec987b4-a60d-4ed5-8942-124014fa8a47 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:08.995378 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1147/2286] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:46:08.999028 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8167c-94a8-4c89-9b1c-d9cfa7ff8dc5 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:09.008450 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8167c-94a8-4c89-9b1c-d9cfa7ff8dc5 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:09.014029 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2572d3-9152-4e00-8463-62b12ad3c399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:09.014684 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2572d3-9152-4e00-8463-62b12ad3c399 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:09.014964 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2572d3-9152-4e00-8463-62b12ad3c399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:09.015234 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2572d3-9152-4e00-8463-62b12ad3c399 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:09.016052 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2572d3-9152-4e00-8463-62b12ad3c399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:09.017935 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2572d3-9152-4e00-8463-62b12ad3c399 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:09.048313 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1140/2287] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:46:08 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:46:09.049445 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec987b4-a60d-4ed5-8942-124014fa8a47 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:09.059979 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec987b4-a60d-4ed5-8942-124014fa8a47 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:09.114207 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8d47c-4cbe-40a6-8a65-341f8c39470f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:09.114861 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8d47c-4cbe-40a6-8a65-341f8c39470f admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:09.115138 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8d47c-4cbe-40a6-8a65-341f8c39470f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:09.115407 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8d47c-4cbe-40a6-8a65-341f8c39470f admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:09.116146 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8d47c-4cbe-40a6-8a65-341f8c39470f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:09.118046 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8d47c-4cbe-40a6-8a65-341f8c39470f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:09.139922 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1148/2288] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:46:09 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:46:09.144559 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2572d3-9152-4e00-8463-62b12ad3c399 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:09.156065 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2572d3-9152-4e00-8463-62b12ad3c399 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:09.160909 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0bcfc-7efa-4582-89a8-b40c971531f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:09.161562 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0bcfc-7efa-4582-89a8-b40c971531f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:09.161849 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0bcfc-7efa-4582-89a8-b40c971531f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:09.162128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0bcfc-7efa-4582-89a8-b40c971531f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:09.162866 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0bcfc-7efa-4582-89a8-b40c971531f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:09.164514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0bcfc-7efa-4582-89a8-b40c971531f8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:09.178554 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1141/2289] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:46:09.180962 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8d47c-4cbe-40a6-8a65-341f8c39470f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:09.193051 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8d47c-4cbe-40a6-8a65-341f8c39470f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:09.198800 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d1dd9-4de8-4a0d-895a-8605f803fa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:09.199487 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d1dd9-4de8-4a0d-895a-8605f803fa77 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:09.199807 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d1dd9-4de8-4a0d-895a-8605f803fa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:09.200081 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d1dd9-4de8-4a0d-895a-8605f803fa77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:09.200830 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d1dd9-4de8-4a0d-895a-8605f803fa77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:09.202413 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d1dd9-4de8-4a0d-895a-8605f803fa77 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:09.217292 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1149/2290] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:46:09.218622 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0bcfc-7efa-4582-89a8-b40c971531f8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:09.230957 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0bcfc-7efa-4582-89a8-b40c971531f8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:09.236038 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1222d-7203-4aa7-97df-62f922b47a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:09.236967 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1222d-7203-4aa7-97df-62f922b47a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:09.237245 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1222d-7203-4aa7-97df-62f922b47a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:09.237515 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1222d-7203-4aa7-97df-62f922b47a4c admin admin] PATH_INFO: `/v3/projects/6cd968a946ad4d3d9281c64f94d2eb09/users/2b8d57b4da614728a52f90e2d7e6ed84/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:09.252003 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1222d-7203-4aa7-97df-62f922b47a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd968a946ad4d3d9281c64f94d2eb09, user_id=2b8d57b4da614728a52f90e2d7e6ed84, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:09.254893 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1222d-7203-4aa7-97df-62f922b47a4c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:09.268319 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1142/2291] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:46:09 2022] PUT /identity/v3/projects/6cd968a946ad4d3d9281c64f94d2eb09/users/2b8d57b4da614728a52f90e2d7e6ed84/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:09.273417 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f9b86-b377-4d08-8693-fe31ece6de27 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:09.273734 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f9b86-b377-4d08-8693-fe31ece6de27 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:09.274043 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f9b86-b377-4d08-8693-fe31ece6de27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:09.293329 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-5e8f9b86-b377-4d08-8693-fe31ece6de27 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:09.294536 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5e8f9b86-b377-4d08-8693-fe31ece6de27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:09.353184 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1150/2292] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:09.363348 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1222d-7203-4aa7-97df-62f922b47a4c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:09.365206 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1bf1222d-7203-4aa7-97df-62f922b47a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:09.441427 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1222d-7203-4aa7-97df-62f922b47a4c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:09.445748 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65922f77-9cb2-41fd-bcb1-8b57cb756baa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:09.446423 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65922f77-9cb2-41fd-bcb1-8b57cb756baa service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:09.447423 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65922f77-9cb2-41fd-bcb1-8b57cb756baa service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:09.447706 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65922f77-9cb2-41fd-bcb1-8b57cb756baa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:09.458207 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65922f77-9cb2-41fd-bcb1-8b57cb756baa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:09.459649 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65922f77-9cb2-41fd-bcb1-8b57cb756baa service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:09.470352 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1143/2293] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:46:09.608887 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f9b86-b377-4d08-8693-fe31ece6de27 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:09.610457 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5e8f9b86-b377-4d08-8693-fe31ece6de27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:09.686579 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f9b86-b377-4d08-8693-fe31ece6de27 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:09.690263 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9625fa0-740a-4b1c-afcb-ed981743b039 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:09.690908 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9625fa0-740a-4b1c-afcb-ed981743b039 service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:09.691189 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9625fa0-740a-4b1c-afcb-ed981743b039 service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:09.691471 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9625fa0-740a-4b1c-afcb-ed981743b039 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:09.694179 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-f9625fa0-740a-4b1c-afcb-ed981743b039 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:09.764202 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9625fa0-740a-4b1c-afcb-ed981743b039 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:09.765803 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9625fa0-740a-4b1c-afcb-ed981743b039 service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:09.776401 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1151/2294] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:46:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:46:12.128169 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65922f77-9cb2-41fd-bcb1-8b57cb756baa service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:12.130055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-65922f77-9cb2-41fd-bcb1-8b57cb756baa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:12.143271 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65922f77-9cb2-41fd-bcb1-8b57cb756baa service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:12.149422 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c58ae7-d2e4-44db-b0a3-3a42d619bbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:12.150667 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c58ae7-d2e4-44db-b0a3-3a42d619bbf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:12.151136 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c58ae7-d2e4-44db-b0a3-3a42d619bbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:12.151575 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c58ae7-d2e4-44db-b0a3-3a42d619bbf1 admin admin] PATH_INFO: `/v3/users/9918cf42c2f04f5da7847fd1f11b68a5` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:12.153827 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c58ae7-d2e4-44db-b0a3-3a42d619bbf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9918cf42c2f04f5da7847fd1f11b68a5)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:12.157023 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c58ae7-d2e4-44db-b0a3-3a42d619bbf1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:12.234261 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-98c58ae7-d2e4-44db-b0a3-3a42d619bbf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9918cf42c2f04f5da7847fd1f11b68a5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:12.245468 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-98c58ae7-d2e4-44db-b0a3-3a42d619bbf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9918cf42c2f04f5da7847fd1f11b68a5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:12.257532 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-98c58ae7-d2e4-44db-b0a3-3a42d619bbf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9918cf42c2f04f5da7847fd1f11b68a5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:12.269714 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-98c58ae7-d2e4-44db-b0a3-3a42d619bbf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9918cf42c2f04f5da7847fd1f11b68a5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:12.270534 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-98c58ae7-d2e4-44db-b0a3-3a42d619bbf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9918cf42c2f04f5da7847fd1f11b68a5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:12.277730 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1144/2295] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:46:12 2022] DELETE /identity/v3/users/9918cf42c2f04f5da7847fd1f11b68a5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:12.282251 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1567673-1713-485c-ac17-7d61fa752624 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:12.282738 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1567673-1713-485c-ac17-7d61fa752624 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:12.283056 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1567673-1713-485c-ac17-7d61fa752624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:12.304393 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-a1567673-1713-485c-ac17-7d61fa752624 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:12.308363 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a1567673-1713-485c-ac17-7d61fa752624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:12.401353 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c58ae7-d2e4-44db-b0a3-3a42d619bbf1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:12.401800 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1152/2296] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:12.403380 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-98c58ae7-d2e4-44db-b0a3-3a42d619bbf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:12.476720 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c58ae7-d2e4-44db-b0a3-3a42d619bbf1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:12.487974 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfad67-45f9-496f-add9-43047d252c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:12.489165 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfad67-45f9-496f-add9-43047d252c2a service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:12.489165 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfad67-45f9-496f-add9-43047d252c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:12.491845 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfad67-45f9-496f-add9-43047d252c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:12.515715 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfad67-45f9-496f-add9-43047d252c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:12.517242 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfad67-45f9-496f-add9-43047d252c2a service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:12.528989 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1145/2297] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:46:13.040474 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1567673-1713-485c-ac17-7d61fa752624 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:13.042063 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a1567673-1713-485c-ac17-7d61fa752624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:13.055788 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1567673-1713-485c-ac17-7d61fa752624 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:13.067037 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b5526-6662-4631-9829-9eb2281e3648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:13.067954 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b5526-6662-4631-9829-9eb2281e3648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:13.068238 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b5526-6662-4631-9829-9eb2281e3648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:13.068509 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b5526-6662-4631-9829-9eb2281e3648 admin admin] PATH_INFO: `/v3/projects/cfee34ae1a1b4c838596f5919f6bdfda` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:13.072443 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b5526-6662-4631-9829-9eb2281e3648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfee34ae1a1b4c838596f5919f6bdfda)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:13.074880 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b5526-6662-4631-9829-9eb2281e3648 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:13.136032 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-9a0b5526-6662-4631-9829-9eb2281e3648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfee34ae1a1b4c838596f5919f6bdfda', 'request_id': 'req-9a0b5526-6662-4631-9829-9eb2281e3648'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:13.143146 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-9a0b5526-6662-4631-9829-9eb2281e3648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfee34ae1a1b4c838596f5919f6bdfda', 'request_id': 'req-9a0b5526-6662-4631-9829-9eb2281e3648'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:13.148676 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-9a0b5526-6662-4631-9829-9eb2281e3648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfee34ae1a1b4c838596f5919f6bdfda', 'request_id': 'req-9a0b5526-6662-4631-9829-9eb2281e3648'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:13.167346 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-9a0b5526-6662-4631-9829-9eb2281e3648 admin admin] The token cache is being invalidate because project cfee34ae1a1b4c838596f5919f6bdfda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:46:13.167779 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-9a0b5526-6662-4631-9829-9eb2281e3648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:13.168513 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-9a0b5526-6662-4631-9829-9eb2281e3648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:13.170129 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1153/2298] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:46:13 2022] DELETE /identity/v3/projects/cfee34ae1a1b4c838596f5919f6bdfda => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:13.174617 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfad67-45f9-496f-add9-43047d252c2a service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:13.188177 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfad67-45f9-496f-add9-43047d252c2a service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:13.261594 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17cad5-d890-4967-9c27-1939f0871fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:13.262841 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17cad5-d890-4967-9c27-1939f0871fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:13.263224 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17cad5-d890-4967-9c27-1939f0871fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:13.263716 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17cad5-d890-4967-9c27-1939f0871fc0 admin admin] PATH_INFO: `/v3/users/ae263872039c448299569b644b258bfd` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:13.269631 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17cad5-d890-4967-9c27-1939f0871fc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae263872039c448299569b644b258bfd)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:13.271861 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17cad5-d890-4967-9c27-1939f0871fc0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:13.354426 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5d17cad5-d890-4967-9c27-1939f0871fc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae263872039c448299569b644b258bfd'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:13.363092 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5d17cad5-d890-4967-9c27-1939f0871fc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae263872039c448299569b644b258bfd'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:13.381580 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5d17cad5-d890-4967-9c27-1939f0871fc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae263872039c448299569b644b258bfd'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:13.394074 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5d17cad5-d890-4967-9c27-1939f0871fc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae263872039c448299569b644b258bfd'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:13.395275 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5d17cad5-d890-4967-9c27-1939f0871fc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae263872039c448299569b644b258bfd'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:13.410335 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1146/2299] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:46:13 2022] DELETE /identity/v3/users/ae263872039c448299569b644b258bfd => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:46:13.852019 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b5526-6662-4631-9829-9eb2281e3648 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:13.856756 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-9a0b5526-6662-4631-9829-9eb2281e3648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:13.877369 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b5526-6662-4631-9829-9eb2281e3648 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:13.961940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72124844-a770-4cbf-bc67-3e016ec3b181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:13.963600 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72124844-a770-4cbf-bc67-3e016ec3b181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:13.964112 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72124844-a770-4cbf-bc67-3e016ec3b181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:13.965199 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72124844-a770-4cbf-bc67-3e016ec3b181 admin admin] PATH_INFO: `/v3/projects/7791215142d045cb9a0b59d2630feb3b` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:13.967828 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72124844-a770-4cbf-bc67-3e016ec3b181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7791215142d045cb9a0b59d2630feb3b)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:13.970823 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72124844-a770-4cbf-bc67-3e016ec3b181 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:14.053694 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-72124844-a770-4cbf-bc67-3e016ec3b181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7791215142d045cb9a0b59d2630feb3b', 'request_id': 'req-72124844-a770-4cbf-bc67-3e016ec3b181'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:14.062631 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-72124844-a770-4cbf-bc67-3e016ec3b181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7791215142d045cb9a0b59d2630feb3b', 'request_id': 'req-72124844-a770-4cbf-bc67-3e016ec3b181'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:14.070919 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-72124844-a770-4cbf-bc67-3e016ec3b181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7791215142d045cb9a0b59d2630feb3b', 'request_id': 'req-72124844-a770-4cbf-bc67-3e016ec3b181'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:14.093300 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-72124844-a770-4cbf-bc67-3e016ec3b181 admin admin] The token cache is being invalidate because project 7791215142d045cb9a0b59d2630feb3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:46:14.094045 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-72124844-a770-4cbf-bc67-3e016ec3b181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:14.094997 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-72124844-a770-4cbf-bc67-3e016ec3b181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:14.101493 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1154/2300] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:46:13 2022] DELETE /identity/v3/projects/7791215142d045cb9a0b59d2630feb3b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:14.101740 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17cad5-d890-4967-9c27-1939f0871fc0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:14.106029 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5d17cad5-d890-4967-9c27-1939f0871fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:14.123989 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17cad5-d890-4967-9c27-1939f0871fc0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:14.235626 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26470f-ce6b-4585-b458-3426909f97fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:14.237222 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26470f-ce6b-4585-b458-3426909f97fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:14.237662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26470f-ce6b-4585-b458-3426909f97fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:14.238087 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26470f-ce6b-4585-b458-3426909f97fe admin admin] PATH_INFO: `/v3/users/57a618f928b4435289b13369ae927b31` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:14.243176 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26470f-ce6b-4585-b458-3426909f97fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a618f928b4435289b13369ae927b31)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:14.248400 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26470f-ce6b-4585-b458-3426909f97fe admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:14.318306 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1e26470f-ce6b-4585-b458-3426909f97fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a618f928b4435289b13369ae927b31'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:14.328340 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1e26470f-ce6b-4585-b458-3426909f97fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a618f928b4435289b13369ae927b31'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:14.342640 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1e26470f-ce6b-4585-b458-3426909f97fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a618f928b4435289b13369ae927b31'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:14.352708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1e26470f-ce6b-4585-b458-3426909f97fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a618f928b4435289b13369ae927b31'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:14.354706 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1e26470f-ce6b-4585-b458-3426909f97fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a618f928b4435289b13369ae927b31'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:14.369754 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1147/2301] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:46:14 2022] DELETE /identity/v3/users/57a618f928b4435289b13369ae927b31 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:14.371348 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530db87a-1f2c-4319-b05e-e0a88d6df5f5 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:14.371680 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530db87a-1f2c-4319-b05e-e0a88d6df5f5 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:14.372060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530db87a-1f2c-4319-b05e-e0a88d6df5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:14.414264 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-530db87a-1f2c-4319-b05e-e0a88d6df5f5 None None] MFA Rules not processed for user `2b8d57b4da614728a52f90e2d7e6ed84`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:14.415716 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-530db87a-1f2c-4319-b05e-e0a88d6df5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:14.498777 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1155/2302] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:14.503737 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26470f-ce6b-4585-b458-3426909f97fe admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:14.505290 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1e26470f-ce6b-4585-b458-3426909f97fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:14.618272 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26470f-ce6b-4585-b458-3426909f97fe admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:14.624473 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78614438-65c3-4c74-b838-f71e41e171a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:14.625284 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78614438-65c3-4c74-b838-f71e41e171a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:14.625635 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78614438-65c3-4c74-b838-f71e41e171a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:14.625980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78614438-65c3-4c74-b838-f71e41e171a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:14.627893 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78614438-65c3-4c74-b838-f71e41e171a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:14.629633 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78614438-65c3-4c74-b838-f71e41e171a0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:14.663796 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1148/2303] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:46:14 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:46:14.666136 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530db87a-1f2c-4319-b05e-e0a88d6df5f5 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:14.677948 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530db87a-1f2c-4319-b05e-e0a88d6df5f5 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:14.687184 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78614438-65c3-4c74-b838-f71e41e171a0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:14.692056 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-78614438-65c3-4c74-b838-f71e41e171a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:14.785885 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba7336-a604-415f-826e-b18ea957cbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:14.786585 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba7336-a604-415f-826e-b18ea957cbcb admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:14.786851 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba7336-a604-415f-826e-b18ea957cbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:14.787121 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba7336-a604-415f-826e-b18ea957cbcb admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:14.787871 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba7336-a604-415f-826e-b18ea957cbcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:14.789904 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba7336-a604-415f-826e-b18ea957cbcb admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:14.819254 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78614438-65c3-4c74-b838-f71e41e171a0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:14.834530 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0cf80-0efe-424e-997f-9cf5b6e80f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:14.835842 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0cf80-0efe-424e-997f-9cf5b6e80f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:14.836296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0cf80-0efe-424e-997f-9cf5b6e80f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:14.836571 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0cf80-0efe-424e-997f-9cf5b6e80f92 admin admin] PATH_INFO: `/v3/projects/ba844e1e5c894feea61caffa2e319976` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:14.838445 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0cf80-0efe-424e-997f-9cf5b6e80f92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba844e1e5c894feea61caffa2e319976)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:14.840597 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0cf80-0efe-424e-997f-9cf5b6e80f92 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:14.869362 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1156/2304] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:46:14 2022] POST /identity/v3/users => generated 299 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:46:14.877391 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba7336-a604-415f-826e-b18ea957cbcb admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:14.906356 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba7336-a604-415f-826e-b18ea957cbcb admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:14.918174 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-55a0cf80-0efe-424e-997f-9cf5b6e80f92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba844e1e5c894feea61caffa2e319976', 'request_id': 'req-55a0cf80-0efe-424e-997f-9cf5b6e80f92'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:14.928722 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-55a0cf80-0efe-424e-997f-9cf5b6e80f92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba844e1e5c894feea61caffa2e319976', 'request_id': 'req-55a0cf80-0efe-424e-997f-9cf5b6e80f92'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:14.935459 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-55a0cf80-0efe-424e-997f-9cf5b6e80f92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba844e1e5c894feea61caffa2e319976', 'request_id': 'req-55a0cf80-0efe-424e-997f-9cf5b6e80f92'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:14.953309 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-55a0cf80-0efe-424e-997f-9cf5b6e80f92 admin admin] The token cache is being invalidate because project ba844e1e5c894feea61caffa2e319976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:46:14.953624 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-55a0cf80-0efe-424e-997f-9cf5b6e80f92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:14.956413 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-55a0cf80-0efe-424e-997f-9cf5b6e80f92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:14.958527 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1149/2305] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:46:14 2022] DELETE /identity/v3/projects/ba844e1e5c894feea61caffa2e319976 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:46:14.965221 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244344d3-338b-45bd-918f-04e940151d66 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:14.965503 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244344d3-338b-45bd-918f-04e940151d66 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:14.965839 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244344d3-338b-45bd-918f-04e940151d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:15.028973 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-244344d3-338b-45bd-918f-04e940151d66 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:15.030217 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-244344d3-338b-45bd-918f-04e940151d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:15.037550 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b32c4-ba00-45f2-9760-5671e4950fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:15.039142 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b32c4-ba00-45f2-9760-5671e4950fca admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:15.039895 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b32c4-ba00-45f2-9760-5671e4950fca admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:15.041537 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b32c4-ba00-45f2-9760-5671e4950fca admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:15.043158 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b32c4-ba00-45f2-9760-5671e4950fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:15.045840 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b32c4-ba00-45f2-9760-5671e4950fca admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:15.063279 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1150/2306] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:46:15.073695 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88445ee-78d4-4b9d-9cc8-1fae9e67f257 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:15.073922 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88445ee-78d4-4b9d-9cc8-1fae9e67f257 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:15.074206 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88445ee-78d4-4b9d-9cc8-1fae9e67f257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:15.077816 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1157/2307] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:46:15.081961 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b32c4-ba00-45f2-9760-5671e4950fca admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:15.090093 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d46b32c4-ba00-45f2-9760-5671e4950fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:15.110656 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b32c4-ba00-45f2-9760-5671e4950fca admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:15.120957 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-a88445ee-78d4-4b9d-9cc8-1fae9e67f257 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:15.126547 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a88445ee-78d4-4b9d-9cc8-1fae9e67f257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:15.132813 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34999e-9cd7-4cab-bbd5-d31792e3954f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:15.133713 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34999e-9cd7-4cab-bbd5-d31792e3954f admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:15.134669 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34999e-9cd7-4cab-bbd5-d31792e3954f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:15.135112 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34999e-9cd7-4cab-bbd5-d31792e3954f admin admin] PATH_INFO: `/v3/projects/559f06f01fa44382a6a56bf847e5d610/users/6eff71083f94443680361135a6f5f601/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:15.153458 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34999e-9cd7-4cab-bbd5-d31792e3954f admin admin] RBAC: Authorizing `identity:create_grant(project_id=559f06f01fa44382a6a56bf847e5d610, user_id=6eff71083f94443680361135a6f5f601, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:15.157021 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34999e-9cd7-4cab-bbd5-d31792e3954f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:15.158552 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1151/2308] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:46:15.162932 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88445ee-78d4-4b9d-9cc8-1fae9e67f257 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:15.195699 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1158/2309] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:46:15 2022] PUT /identity/v3/projects/559f06f01fa44382a6a56bf847e5d610/users/6eff71083f94443680361135a6f5f601/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:15.196307 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88445ee-78d4-4b9d-9cc8-1fae9e67f257 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:15.207177 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34999e-9cd7-4cab-bbd5-d31792e3954f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:15.356580 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34999e-9cd7-4cab-bbd5-d31792e3954f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:15.362003 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83ad2f-d09d-4813-8ef1-ad4534ed5045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:15.363123 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83ad2f-d09d-4813-8ef1-ad4534ed5045 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:15.364203 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83ad2f-d09d-4813-8ef1-ad4534ed5045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:15.364494 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83ad2f-d09d-4813-8ef1-ad4534ed5045 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:15.367801 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83ad2f-d09d-4813-8ef1-ad4534ed5045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:15.367801 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83ad2f-d09d-4813-8ef1-ad4534ed5045 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:15.377974 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff773d1-2c26-411d-9396-f9dcedb33858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:15.378732 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff773d1-2c26-411d-9396-f9dcedb33858 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:15.379015 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff773d1-2c26-411d-9396-f9dcedb33858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:15.379297 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff773d1-2c26-411d-9396-f9dcedb33858 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:15.383220 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff773d1-2c26-411d-9396-f9dcedb33858 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:46:15.383608 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff773d1-2c26-411d-9396-f9dcedb33858 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:15.385470 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff773d1-2c26-411d-9396-f9dcedb33858 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:15.401141 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1159/2310] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:46:15.403319 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83ad2f-d09d-4813-8ef1-ad4534ed5045 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:15.416751 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83ad2f-d09d-4813-8ef1-ad4534ed5045 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:15.421237 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1152/2311] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:46:15.422213 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff773d1-2c26-411d-9396-f9dcedb33858 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:15.434879 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7e53d-b7bc-444f-8aae-d636d3fb799c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:15.446551 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7e53d-b7bc-444f-8aae-d636d3fb799c admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:15.447272 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7e53d-b7bc-444f-8aae-d636d3fb799c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:15.447565 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7e53d-b7bc-444f-8aae-d636d3fb799c admin admin] PATH_INFO: `/v3/projects/559f06f01fa44382a6a56bf847e5d610/users/6eff71083f94443680361135a6f5f601/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:15.454104 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7e53d-b7bc-444f-8aae-d636d3fb799c admin admin] RBAC: Authorizing `identity:create_grant(project_id=559f06f01fa44382a6a56bf847e5d610, user_id=6eff71083f94443680361135a6f5f601, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:15.454324 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff773d1-2c26-411d-9396-f9dcedb33858 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:15.461975 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7e53d-b7bc-444f-8aae-d636d3fb799c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:15.464051 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2745b-e9cf-488b-85ea-3f9635e3fdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:15.464712 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2745b-e9cf-488b-85ea-3f9635e3fdd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:15.464989 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2745b-e9cf-488b-85ea-3f9635e3fdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:15.465378 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2745b-e9cf-488b-85ea-3f9635e3fdd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:15.466279 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2745b-e9cf-488b-85ea-3f9635e3fdd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:15.468379 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2745b-e9cf-488b-85ea-3f9635e3fdd0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:15.499642 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1160/2312] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:46:15 2022] PUT /identity/v3/projects/559f06f01fa44382a6a56bf847e5d610/users/6eff71083f94443680361135a6f5f601/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:46:15.524652 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1153/2313] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:46:15 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:46:15.529268 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7e53d-b7bc-444f-8aae-d636d3fb799c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:15.644230 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7e53d-b7bc-444f-8aae-d636d3fb799c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:15.747805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1590e5-044d-406e-b024-b5ef3e18af96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:15.748572 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1590e5-044d-406e-b024-b5ef3e18af96 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:15.748927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1590e5-044d-406e-b024-b5ef3e18af96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:15.749294 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1590e5-044d-406e-b024-b5ef3e18af96 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:15.750083 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1590e5-044d-406e-b024-b5ef3e18af96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:15.752127 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1590e5-044d-406e-b024-b5ef3e18af96 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:15.780359 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1161/2314] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:46:15 2022] POST /identity/v3/users => generated 290 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:46:15.785055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2745b-e9cf-488b-85ea-3f9635e3fdd0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:15.798664 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2745b-e9cf-488b-85ea-3f9635e3fdd0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:15.808514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed53d80-ab93-4990-968d-99212310a371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:15.810591 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed53d80-ab93-4990-968d-99212310a371 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:15.811069 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed53d80-ab93-4990-968d-99212310a371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:15.811429 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed53d80-ab93-4990-968d-99212310a371 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:15.812566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed53d80-ab93-4990-968d-99212310a371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:15.817425 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed53d80-ab93-4990-968d-99212310a371 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:15.832938 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1154/2315] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:46:15.836924 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1590e5-044d-406e-b024-b5ef3e18af96 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:15.861754 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1590e5-044d-406e-b024-b5ef3e18af96 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:15.869464 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24978421-0797-464d-8b1f-5369cc7210a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:15.870561 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24978421-0797-464d-8b1f-5369cc7210a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:15.870982 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24978421-0797-464d-8b1f-5369cc7210a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:15.871349 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24978421-0797-464d-8b1f-5369cc7210a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:15.872202 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24978421-0797-464d-8b1f-5369cc7210a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:15.873947 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24978421-0797-464d-8b1f-5369cc7210a3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:15.892135 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed53d80-ab93-4990-968d-99212310a371 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:15.897468 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1162/2316] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:46:15.903682 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed53d80-ab93-4990-968d-99212310a371 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:15.908640 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d49a7-2ef8-4ea7-b2ee-b0b41a447d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:15.909613 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d49a7-2ef8-4ea7-b2ee-b0b41a447d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:15.909902 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d49a7-2ef8-4ea7-b2ee-b0b41a447d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:15.910175 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d49a7-2ef8-4ea7-b2ee-b0b41a447d6b admin admin] PATH_INFO: `/v3/projects/ea8588de9d3d413ba2f65634958f764c/users/8687ac982818479c855ac05292bf05c6/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:15.931629 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d49a7-2ef8-4ea7-b2ee-b0b41a447d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8588de9d3d413ba2f65634958f764c, user_id=8687ac982818479c855ac05292bf05c6, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:15.935056 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d49a7-2ef8-4ea7-b2ee-b0b41a447d6b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:15.954569 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1155/2317] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:46:15 2022] PUT /identity/v3/projects/ea8588de9d3d413ba2f65634958f764c/users/8687ac982818479c855ac05292bf05c6/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:15.966248 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8c340-1e50-42f6-8038-c86e7bd2f2b7 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:15.967126 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8c340-1e50-42f6-8038-c86e7bd2f2b7 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:15.967298 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8c340-1e50-42f6-8038-c86e7bd2f2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:16.033565 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-dab8c340-1e50-42f6-8038-c86e7bd2f2b7 None None] MFA Rules not processed for user `8687ac982818479c855ac05292bf05c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:16.034899 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-dab8c340-1e50-42f6-8038-c86e7bd2f2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:16.140671 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1163/2318] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:16.145023 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d49a7-2ef8-4ea7-b2ee-b0b41a447d6b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:16.235968 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d49a7-2ef8-4ea7-b2ee-b0b41a447d6b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:16.257630 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0b26e-1aeb-49e3-9122-ddacddf89f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:16.258312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0b26e-1aeb-49e3-9122-ddacddf89f12 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:16.258603 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0b26e-1aeb-49e3-9122-ddacddf89f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:16.258879 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0b26e-1aeb-49e3-9122-ddacddf89f12 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:16.260196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0b26e-1aeb-49e3-9122-ddacddf89f12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:16.270366 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0b26e-1aeb-49e3-9122-ddacddf89f12 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:16.372742 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1156/2319] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:46:16 2022] POST /identity/v3/projects => generated 377 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:46:16.376843 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8c340-1e50-42f6-8038-c86e7bd2f2b7 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:16.397601 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8c340-1e50-42f6-8038-c86e7bd2f2b7 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:16.517196 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470ebab-b23f-4ab5-a703-1a7b999d1fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:16.518126 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470ebab-b23f-4ab5-a703-1a7b999d1fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:16.518582 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470ebab-b23f-4ab5-a703-1a7b999d1fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:16.519050 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470ebab-b23f-4ab5-a703-1a7b999d1fa9 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:16.520146 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470ebab-b23f-4ab5-a703-1a7b999d1fa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:16.523530 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470ebab-b23f-4ab5-a703-1a7b999d1fa9 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:16.553123 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1164/2320] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:46:16 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:46:16.557315 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0b26e-1aeb-49e3-9122-ddacddf89f12 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:16.568267 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0b26e-1aeb-49e3-9122-ddacddf89f12 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:16.576675 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1fefc-dca1-4fda-9630-a0b6259fd5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:16.577353 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1fefc-dca1-4fda-9630-a0b6259fd5ea admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:16.577638 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1fefc-dca1-4fda-9630-a0b6259fd5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:16.577915 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1fefc-dca1-4fda-9630-a0b6259fd5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:16.578883 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1fefc-dca1-4fda-9630-a0b6259fd5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:16.580766 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1fefc-dca1-4fda-9630-a0b6259fd5ea admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:16.594499 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1157/2321] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:46:16.598541 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470ebab-b23f-4ab5-a703-1a7b999d1fa9 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:16.609731 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470ebab-b23f-4ab5-a703-1a7b999d1fa9 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:16.616276 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9357daa-0593-4029-971b-5c3928444fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:16.616948 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9357daa-0593-4029-971b-5c3928444fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:16.617369 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9357daa-0593-4029-971b-5c3928444fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:16.617653 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9357daa-0593-4029-971b-5c3928444fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:16.618529 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9357daa-0593-4029-971b-5c3928444fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:16.620186 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9357daa-0593-4029-971b-5c3928444fc2 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:16.633652 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1165/2322] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:46:16.638684 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1fefc-dca1-4fda-9630-a0b6259fd5ea admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:16.649363 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1fefc-dca1-4fda-9630-a0b6259fd5ea admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:16.656584 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215be942-5fca-43d7-a5d2-5a30a62161c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:16.659414 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215be942-5fca-43d7-a5d2-5a30a62161c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:16.659977 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215be942-5fca-43d7-a5d2-5a30a62161c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:16.660539 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215be942-5fca-43d7-a5d2-5a30a62161c3 admin admin] PATH_INFO: `/v3/projects/71d755ba637745c1915dfb706b1da6bd/users/89d47d5ec6a8492bbef78393ccc35dc3/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:16.679331 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215be942-5fca-43d7-a5d2-5a30a62161c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d755ba637745c1915dfb706b1da6bd, user_id=89d47d5ec6a8492bbef78393ccc35dc3, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:16.683067 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215be942-5fca-43d7-a5d2-5a30a62161c3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:16.708419 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1158/2323] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:46:16 2022] PUT /identity/v3/projects/71d755ba637745c1915dfb706b1da6bd/users/89d47d5ec6a8492bbef78393ccc35dc3/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:16.719110 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ff38c-0984-4ba4-aa2e-f85ae3202037 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:16.719458 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ff38c-0984-4ba4-aa2e-f85ae3202037 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:16.719668 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ff38c-0984-4ba4-aa2e-f85ae3202037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:16.750237 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-a68ff38c-0984-4ba4-aa2e-f85ae3202037 None None] MFA Rules not processed for user `89d47d5ec6a8492bbef78393ccc35dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:16.751481 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a68ff38c-0984-4ba4-aa2e-f85ae3202037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:16.851652 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1166/2324] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:16.856168 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215be942-5fca-43d7-a5d2-5a30a62161c3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:16.961966 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215be942-5fca-43d7-a5d2-5a30a62161c3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:16.969035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767ff2d-0e03-414e-abe3-1e9e19a2f3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:16.970077 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767ff2d-0e03-414e-abe3-1e9e19a2f3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:16.970568 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767ff2d-0e03-414e-abe3-1e9e19a2f3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:16.971064 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767ff2d-0e03-414e-abe3-1e9e19a2f3a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:16.972140 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767ff2d-0e03-414e-abe3-1e9e19a2f3a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:16.974411 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767ff2d-0e03-414e-abe3-1e9e19a2f3a9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:17.024383 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1159/2325] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:46:16 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:46:17.029262 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ff38c-0984-4ba4-aa2e-f85ae3202037 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:17.044794 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ff38c-0984-4ba4-aa2e-f85ae3202037 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:17.152828 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d60f25-6d5b-4cde-a585-036c5efe5313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:17.153911 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d60f25-6d5b-4cde-a585-036c5efe5313 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:17.154434 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d60f25-6d5b-4cde-a585-036c5efe5313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:17.154982 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d60f25-6d5b-4cde-a585-036c5efe5313 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:17.156170 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d60f25-6d5b-4cde-a585-036c5efe5313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:17.158748 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d60f25-6d5b-4cde-a585-036c5efe5313 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:17.197995 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1167/2326] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:46:17 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:46:17.200457 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767ff2d-0e03-414e-abe3-1e9e19a2f3a9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:17.214319 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767ff2d-0e03-414e-abe3-1e9e19a2f3a9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:17.232774 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5711f32-331f-46e3-8217-14e3709ba39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:17.233921 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5711f32-331f-46e3-8217-14e3709ba39b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:17.234412 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5711f32-331f-46e3-8217-14e3709ba39b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:17.234693 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5711f32-331f-46e3-8217-14e3709ba39b admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:17.235450 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5711f32-331f-46e3-8217-14e3709ba39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:17.240535 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5711f32-331f-46e3-8217-14e3709ba39b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:17.256366 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1160/2327] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:46:17.260266 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d60f25-6d5b-4cde-a585-036c5efe5313 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:17.279591 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d60f25-6d5b-4cde-a585-036c5efe5313 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:17.287848 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7beb98f-a10f-4ec4-a3dc-cb2a9feb6aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:17.289026 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7beb98f-a10f-4ec4-a3dc-cb2a9feb6aff admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:17.289467 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7beb98f-a10f-4ec4-a3dc-cb2a9feb6aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:17.289913 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7beb98f-a10f-4ec4-a3dc-cb2a9feb6aff admin admin] PATH_INFO: `/v3/projects/b1fae342a79f4247b1b19fa399a2cbe7/users/6235c9d4422144c39ca5d3f307b909e5/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:17.327256 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7beb98f-a10f-4ec4-a3dc-cb2a9feb6aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1fae342a79f4247b1b19fa399a2cbe7, user_id=6235c9d4422144c39ca5d3f307b909e5, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:17.330217 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7beb98f-a10f-4ec4-a3dc-cb2a9feb6aff admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:17.353997 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1168/2328] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:46:17 2022] PUT /identity/v3/projects/b1fae342a79f4247b1b19fa399a2cbe7/users/6235c9d4422144c39ca5d3f307b909e5/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:46:17.359736 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5711f32-331f-46e3-8217-14e3709ba39b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:17.373282 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5711f32-331f-46e3-8217-14e3709ba39b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:17.455637 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b149f-d3e8-4e99-80a3-57436f8cba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:17.456690 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b149f-d3e8-4e99-80a3-57436f8cba7c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:17.456972 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b149f-d3e8-4e99-80a3-57436f8cba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:17.457256 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b149f-d3e8-4e99-80a3-57436f8cba7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:17.458685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b149f-d3e8-4e99-80a3-57436f8cba7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:17.460772 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b149f-d3e8-4e99-80a3-57436f8cba7c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:17.481901 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1161/2329] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:46:17.487835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7beb98f-a10f-4ec4-a3dc-cb2a9feb6aff admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:17.510009 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7beb98f-a10f-4ec4-a3dc-cb2a9feb6aff admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:17.515387 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b970d-3779-4ecc-a3fd-2f330c1aebd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:17.516304 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b970d-3779-4ecc-a3fd-2f330c1aebd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:17.516582 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b970d-3779-4ecc-a3fd-2f330c1aebd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:17.516854 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b970d-3779-4ecc-a3fd-2f330c1aebd4 admin admin] PATH_INFO: `/v3/projects/b1fae342a79f4247b1b19fa399a2cbe7/users/6235c9d4422144c39ca5d3f307b909e5/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:17.519124 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b970d-3779-4ecc-a3fd-2f330c1aebd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1fae342a79f4247b1b19fa399a2cbe7, user_id=6235c9d4422144c39ca5d3f307b909e5, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:17.523163 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b970d-3779-4ecc-a3fd-2f330c1aebd4 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:17.548522 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1169/2330] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:46:17 2022] PUT /identity/v3/projects/b1fae342a79f4247b1b19fa399a2cbe7/users/6235c9d4422144c39ca5d3f307b909e5/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:17.560179 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc791e-1c5a-414a-b950-2168b041c235 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:17.560662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc791e-1c5a-414a-b950-2168b041c235 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:17.560945 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc791e-1c5a-414a-b950-2168b041c235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:17.611453 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-92dc791e-1c5a-414a-b950-2168b041c235 None None] MFA Rules not processed for user `6235c9d4422144c39ca5d3f307b909e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:17.612752 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-92dc791e-1c5a-414a-b950-2168b041c235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:17.739289 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1162/2331] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:17.751354 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b970d-3779-4ecc-a3fd-2f330c1aebd4 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:17.753971 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-241b970d-3779-4ecc-a3fd-2f330c1aebd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:17.903480 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b970d-3779-4ecc-a3fd-2f330c1aebd4 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:17.907622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16773e-661b-47bb-bb78-3c73597e76da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:17.908343 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16773e-661b-47bb-bb78-3c73597e76da service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:17.909486 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16773e-661b-47bb-bb78-3c73597e76da service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:17.909831 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16773e-661b-47bb-bb78-3c73597e76da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:17.942066 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16773e-661b-47bb-bb78-3c73597e76da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:17.943969 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16773e-661b-47bb-bb78-3c73597e76da service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:18.001249 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1170/2332] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:46:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:46:18.106200 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc791e-1c5a-414a-b950-2168b041c235 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:18.107923 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-92dc791e-1c5a-414a-b950-2168b041c235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:18.134570 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc791e-1c5a-414a-b950-2168b041c235 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:18.139524 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa8cc9-b8a9-43e3-957c-399b32d33590 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:18.140424 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa8cc9-b8a9-43e3-957c-399b32d33590 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:18.140707 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa8cc9-b8a9-43e3-957c-399b32d33590 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:18.140986 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa8cc9-b8a9-43e3-957c-399b32d33590 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:18.221331 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa8cc9-b8a9-43e3-957c-399b32d33590 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:18.222944 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa8cc9-b8a9-43e3-957c-399b32d33590 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:18.241709 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1163/2333] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:46:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:46:21.816181 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16773e-661b-47bb-bb78-3c73597e76da service cinder] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:21.914325 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16773e-661b-47bb-bb78-3c73597e76da service cinder] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:21.922539 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0de8e-8534-47da-b622-9fa6f1cc8971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:21.923785 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0de8e-8534-47da-b622-9fa6f1cc8971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:21.924278 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0de8e-8534-47da-b622-9fa6f1cc8971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:21.924639 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0de8e-8534-47da-b622-9fa6f1cc8971 admin admin] PATH_INFO: `/v3/users/8687ac982818479c855ac05292bf05c6` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:21.927276 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0de8e-8534-47da-b622-9fa6f1cc8971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8687ac982818479c855ac05292bf05c6)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:21.929539 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0de8e-8534-47da-b622-9fa6f1cc8971 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:22.013219 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fcc0de8e-8534-47da-b622-9fa6f1cc8971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8687ac982818479c855ac05292bf05c6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:22.028149 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fcc0de8e-8534-47da-b622-9fa6f1cc8971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8687ac982818479c855ac05292bf05c6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:22.036351 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fcc0de8e-8534-47da-b622-9fa6f1cc8971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8687ac982818479c855ac05292bf05c6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:22.045974 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fcc0de8e-8534-47da-b622-9fa6f1cc8971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8687ac982818479c855ac05292bf05c6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:22.046849 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fcc0de8e-8534-47da-b622-9fa6f1cc8971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8687ac982818479c855ac05292bf05c6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:22.058724 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1171/2334] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:46:21 2022] DELETE /identity/v3/users/8687ac982818479c855ac05292bf05c6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:46:22.060502 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4bfb9-f89e-4304-8e0e-a906f012db46 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:22.060999 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4bfb9-f89e-4304-8e0e-a906f012db46 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:22.061093 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4bfb9-f89e-4304-8e0e-a906f012db46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:22.104652 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-4ce4bfb9-f89e-4304-8e0e-a906f012db46 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:22.105977 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4ce4bfb9-f89e-4304-8e0e-a906f012db46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:22.197200 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1164/2335] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:22.203520 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0de8e-8534-47da-b622-9fa6f1cc8971 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:22.205454 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-fcc0de8e-8534-47da-b622-9fa6f1cc8971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:22.222725 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92d3ef-fa82-42a8-8778-5b77970e58c1 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:22.223689 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92d3ef-fa82-42a8-8778-5b77970e58c1 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:22.224016 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92d3ef-fa82-42a8-8778-5b77970e58c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:22.292234 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-3d92d3ef-fa82-42a8-8778-5b77970e58c1 None None] MFA Rules not processed for user `6eff71083f94443680361135a6f5f601`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:22.293743 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3d92d3ef-fa82-42a8-8778-5b77970e58c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:22.298133 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0de8e-8534-47da-b622-9fa6f1cc8971 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:22.302341 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778fc59-55de-45bf-9af6-bf99251b782e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:22.303166 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778fc59-55de-45bf-9af6-bf99251b782e service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:22.304176 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778fc59-55de-45bf-9af6-bf99251b782e service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:22.304537 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778fc59-55de-45bf-9af6-bf99251b782e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:22.334320 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778fc59-55de-45bf-9af6-bf99251b782e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:22.336479 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778fc59-55de-45bf-9af6-bf99251b782e service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:22.376706 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1172/2336] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:46:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:46:22.431982 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1165/2337] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:22.440311 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778fc59-55de-45bf-9af6-bf99251b782e service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:22.442532 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d778fc59-55de-45bf-9af6-bf99251b782e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:22.565679 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778fc59-55de-45bf-9af6-bf99251b782e service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:22.571181 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48296249-4cab-404f-b536-af9f86ee5aa9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10453496872a45a9867fc6a13a13de49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:22.572001 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48296249-4cab-404f-b536-af9f86ee5aa9 service glance] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:22.572284 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48296249-4cab-404f-b536-af9f86ee5aa9 service glance] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:22.572560 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48296249-4cab-404f-b536-af9f86ee5aa9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:22.574949 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-48296249-4cab-404f-b536-af9f86ee5aa9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:22.733516 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48296249-4cab-404f-b536-af9f86ee5aa9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:22.735106 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48296249-4cab-404f-b536-af9f86ee5aa9 service glance] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:22.766350 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1173/2338] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:46:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:46:22.925796 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09751438-c35d-4e70-a281-78b6affd07cc None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:22.926205 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09751438-c35d-4e70-a281-78b6affd07cc None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:22.926545 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09751438-c35d-4e70-a281-78b6affd07cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:22.948696 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48296249-4cab-404f-b536-af9f86ee5aa9 service glance] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:22.950205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-48296249-4cab-404f-b536-af9f86ee5aa9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:22.965496 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48296249-4cab-404f-b536-af9f86ee5aa9 service glance] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:22.971336 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3e6cc-8427-4665-b085-4ccab91165f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:22.972521 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3e6cc-8427-4665-b085-4ccab91165f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:22.973593 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3e6cc-8427-4665-b085-4ccab91165f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:22.974080 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3e6cc-8427-4665-b085-4ccab91165f1 admin admin] PATH_INFO: `/v3/projects/ea8588de9d3d413ba2f65634958f764c` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:22.976245 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3e6cc-8427-4665-b085-4ccab91165f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea8588de9d3d413ba2f65634958f764c)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:22.978992 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3e6cc-8427-4665-b085-4ccab91165f1 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:23.035971 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-09751438-c35d-4e70-a281-78b6affd07cc None None] MFA Rules not processed for user `9761863f36284bd4be1ce29c86b631cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:23.037198 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-09751438-c35d-4e70-a281-78b6affd07cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:23.039028 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fcb3e6cc-8427-4665-b085-4ccab91165f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea8588de9d3d413ba2f65634958f764c', 'request_id': 'req-fcb3e6cc-8427-4665-b085-4ccab91165f1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:23.046586 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fcb3e6cc-8427-4665-b085-4ccab91165f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea8588de9d3d413ba2f65634958f764c', 'request_id': 'req-fcb3e6cc-8427-4665-b085-4ccab91165f1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:23.057118 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fcb3e6cc-8427-4665-b085-4ccab91165f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea8588de9d3d413ba2f65634958f764c', 'request_id': 'req-fcb3e6cc-8427-4665-b085-4ccab91165f1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:23.074218 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fcb3e6cc-8427-4665-b085-4ccab91165f1 admin admin] The token cache is being invalidate because project ea8588de9d3d413ba2f65634958f764c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:46:23.074529 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fcb3e6cc-8427-4665-b085-4ccab91165f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:23.076644 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-fcb3e6cc-8427-4665-b085-4ccab91165f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:23.078155 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1174/2339] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:46:22 2022] DELETE /identity/v3/projects/ea8588de9d3d413ba2f65634958f764c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:23.082726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3e6cc-8427-4665-b085-4ccab91165f1 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:23.084195 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-fcb3e6cc-8427-4665-b085-4ccab91165f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:23.110716 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1166/2340] 10.222.0.35 () {58 vars in 1009 bytes} [Tue Feb 8 16:46:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:23.160500 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3e6cc-8427-4665-b085-4ccab91165f1 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:23.165997 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320c31a-e987-4423-9d4d-d3b0496b9bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:23.166863 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320c31a-e987-4423-9d4d-d3b0496b9bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:23.167200 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320c31a-e987-4423-9d4d-d3b0496b9bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:23.167480 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320c31a-e987-4423-9d4d-d3b0496b9bb2 admin admin] PATH_INFO: `/v3/users/89d47d5ec6a8492bbef78393ccc35dc3` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:23.168090 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09751438-c35d-4e70-a281-78b6affd07cc None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:23.168810 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320c31a-e987-4423-9d4d-d3b0496b9bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89d47d5ec6a8492bbef78393ccc35dc3)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:23.169634 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-09751438-c35d-4e70-a281-78b6affd07cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:23.170738 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320c31a-e987-4423-9d4d-d3b0496b9bb2 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:23.250721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a320c31a-e987-4423-9d4d-d3b0496b9bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89d47d5ec6a8492bbef78393ccc35dc3'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:23.280916 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a320c31a-e987-4423-9d4d-d3b0496b9bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89d47d5ec6a8492bbef78393ccc35dc3'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:23.291025 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a320c31a-e987-4423-9d4d-d3b0496b9bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89d47d5ec6a8492bbef78393ccc35dc3'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:23.300525 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a320c31a-e987-4423-9d4d-d3b0496b9bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89d47d5ec6a8492bbef78393ccc35dc3'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:23.301208 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a320c31a-e987-4423-9d4d-d3b0496b9bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89d47d5ec6a8492bbef78393ccc35dc3'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:23.308167 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09751438-c35d-4e70-a281-78b6affd07cc None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:23.313090 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1175/2341] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:46:23 2022] DELETE /identity/v3/users/89d47d5ec6a8492bbef78393ccc35dc3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:46:23.314130 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f1bc2-9799-4df4-85fe-d000a59ef891 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00fd3c05cd8e4167946a1f567df2cc6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:23.314785 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f1bc2-9799-4df4-85fe-d000a59ef891 service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:23.315065 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f1bc2-9799-4df4-85fe-d000a59ef891 service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:23.315345 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f1bc2-9799-4df4-85fe-d000a59ef891 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:23.322072 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-602f1bc2-9799-4df4-85fe-d000a59ef891 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:23.334231 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f1bc2-9799-4df4-85fe-d000a59ef891 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:23.335870 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f1bc2-9799-4df4-85fe-d000a59ef891 service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:23.347848 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1167/2342] 10.222.0.35 () {60 vars in 1384 bytes} [Tue Feb 8 16:46:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 08 16:46:23.863976 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320c31a-e987-4423-9d4d-d3b0496b9bb2 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:23.865851 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a320c31a-e987-4423-9d4d-d3b0496b9bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:24.065995 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320c31a-e987-4423-9d4d-d3b0496b9bb2 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:24.077691 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30503c02-ec85-4d3f-aeef-ac760c2e6ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:24.078689 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30503c02-ec85-4d3f-aeef-ac760c2e6ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:24.079118 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30503c02-ec85-4d3f-aeef-ac760c2e6ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:24.079407 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30503c02-ec85-4d3f-aeef-ac760c2e6ad6 admin admin] PATH_INFO: `/v3/projects/71d755ba637745c1915dfb706b1da6bd` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:24.083816 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30503c02-ec85-4d3f-aeef-ac760c2e6ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d755ba637745c1915dfb706b1da6bd)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:24.089764 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30503c02-ec85-4d3f-aeef-ac760c2e6ad6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:24.213719 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-30503c02-ec85-4d3f-aeef-ac760c2e6ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d755ba637745c1915dfb706b1da6bd', 'request_id': 'req-30503c02-ec85-4d3f-aeef-ac760c2e6ad6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:24.228318 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-30503c02-ec85-4d3f-aeef-ac760c2e6ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d755ba637745c1915dfb706b1da6bd', 'request_id': 'req-30503c02-ec85-4d3f-aeef-ac760c2e6ad6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:24.235451 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-30503c02-ec85-4d3f-aeef-ac760c2e6ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d755ba637745c1915dfb706b1da6bd', 'request_id': 'req-30503c02-ec85-4d3f-aeef-ac760c2e6ad6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:24.268752 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-30503c02-ec85-4d3f-aeef-ac760c2e6ad6 admin admin] The token cache is being invalidate because project 71d755ba637745c1915dfb706b1da6bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:46:24.270042 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-30503c02-ec85-4d3f-aeef-ac760c2e6ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:24.272499 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-30503c02-ec85-4d3f-aeef-ac760c2e6ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:24.278511 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1176/2343] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:46:23 2022] DELETE /identity/v3/projects/71d755ba637745c1915dfb706b1da6bd => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:24.285402 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f1bc2-9799-4df4-85fe-d000a59ef891 service swift] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:24.310960 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f1bc2-9799-4df4-85fe-d000a59ef891 service swift] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:24.431680 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e2f8c-6150-4aa6-ad5a-b01517b920bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:24.432905 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e2f8c-6150-4aa6-ad5a-b01517b920bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:24.433418 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e2f8c-6150-4aa6-ad5a-b01517b920bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:24.434008 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e2f8c-6150-4aa6-ad5a-b01517b920bf admin admin] PATH_INFO: `/v3/users/6235c9d4422144c39ca5d3f307b909e5` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:24.436514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e2f8c-6150-4aa6-ad5a-b01517b920bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6235c9d4422144c39ca5d3f307b909e5)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:24.439378 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e2f8c-6150-4aa6-ad5a-b01517b920bf admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:24.523078 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-135e2f8c-6150-4aa6-ad5a-b01517b920bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6235c9d4422144c39ca5d3f307b909e5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:24.531661 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-135e2f8c-6150-4aa6-ad5a-b01517b920bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6235c9d4422144c39ca5d3f307b909e5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:24.546847 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-135e2f8c-6150-4aa6-ad5a-b01517b920bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6235c9d4422144c39ca5d3f307b909e5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:24.556599 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-135e2f8c-6150-4aa6-ad5a-b01517b920bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6235c9d4422144c39ca5d3f307b909e5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:24.557460 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-135e2f8c-6150-4aa6-ad5a-b01517b920bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6235c9d4422144c39ca5d3f307b909e5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:24.565644 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1168/2344] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:46:24 2022] DELETE /identity/v3/users/6235c9d4422144c39ca5d3f307b909e5 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:24.977383 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30503c02-ec85-4d3f-aeef-ac760c2e6ad6 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:24.979521 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-30503c02-ec85-4d3f-aeef-ac760c2e6ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:24.994480 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30503c02-ec85-4d3f-aeef-ac760c2e6ad6 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:25.063018 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542931a-4040-4d1e-ae15-33ba5f4c4db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:25.064005 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542931a-4040-4d1e-ae15-33ba5f4c4db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:25.064378 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542931a-4040-4d1e-ae15-33ba5f4c4db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:25.064816 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542931a-4040-4d1e-ae15-33ba5f4c4db6 admin admin] PATH_INFO: `/v3/projects/b1fae342a79f4247b1b19fa399a2cbe7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:25.066133 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542931a-4040-4d1e-ae15-33ba5f4c4db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1fae342a79f4247b1b19fa399a2cbe7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:25.068450 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542931a-4040-4d1e-ae15-33ba5f4c4db6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:25.131797 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-9542931a-4040-4d1e-ae15-33ba5f4c4db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1fae342a79f4247b1b19fa399a2cbe7', 'request_id': 'req-9542931a-4040-4d1e-ae15-33ba5f4c4db6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:25.142405 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-9542931a-4040-4d1e-ae15-33ba5f4c4db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1fae342a79f4247b1b19fa399a2cbe7', 'request_id': 'req-9542931a-4040-4d1e-ae15-33ba5f4c4db6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:25.147918 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-9542931a-4040-4d1e-ae15-33ba5f4c4db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1fae342a79f4247b1b19fa399a2cbe7', 'request_id': 'req-9542931a-4040-4d1e-ae15-33ba5f4c4db6'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:25.176741 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-9542931a-4040-4d1e-ae15-33ba5f4c4db6 admin admin] The token cache is being invalidate because project b1fae342a79f4247b1b19fa399a2cbe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:46:25.177725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-9542931a-4040-4d1e-ae15-33ba5f4c4db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:25.178388 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-9542931a-4040-4d1e-ae15-33ba5f4c4db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:25.182091 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1177/2345] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:46:24 2022] DELETE /identity/v3/projects/b1fae342a79f4247b1b19fa399a2cbe7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:25.189314 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e411ee-fe5f-418d-8634-a101a89fbb88 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:25.189604 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e411ee-fe5f-418d-8634-a101a89fbb88 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:25.189911 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e411ee-fe5f-418d-8634-a101a89fbb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:25.228623 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-77e411ee-fe5f-418d-8634-a101a89fbb88 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:25.230001 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-77e411ee-fe5f-418d-8634-a101a89fbb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:25.302971 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1169/2346] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:25.311016 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c2aff-8c76-443f-aacb-82c4105d4a16 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:25.311298 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c2aff-8c76-443f-aacb-82c4105d4a16 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:25.311571 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c2aff-8c76-443f-aacb-82c4105d4a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:25.336119 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-198c2aff-8c76-443f-aacb-82c4105d4a16 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:25.338484 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-198c2aff-8c76-443f-aacb-82c4105d4a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:25.351941 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1178/2347] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:25.354213 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e411ee-fe5f-418d-8634-a101a89fbb88 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:25.364921 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e411ee-fe5f-418d-8634-a101a89fbb88 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:25.373608 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92650472-81c4-4803-b078-412602aacf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:25.374573 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92650472-81c4-4803-b078-412602aacf2a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:25.375432 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92650472-81c4-4803-b078-412602aacf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:25.375432 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92650472-81c4-4803-b078-412602aacf2a admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:25.376108 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92650472-81c4-4803-b078-412602aacf2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:46:25.376455 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92650472-81c4-4803-b078-412602aacf2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:25.378281 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92650472-81c4-4803-b078-412602aacf2a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:25.400332 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1170/2348] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:46:25.404726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c2aff-8c76-443f-aacb-82c4105d4a16 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:25.416251 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c2aff-8c76-443f-aacb-82c4105d4a16 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:25.422020 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd378f4-7652-447a-bb3c-8906c99eeeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:25.422903 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd378f4-7652-447a-bb3c-8906c99eeeba admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:25.423384 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd378f4-7652-447a-bb3c-8906c99eeeba admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:25.423850 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd378f4-7652-447a-bb3c-8906c99eeeba admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:25.424792 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd378f4-7652-447a-bb3c-8906c99eeeba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:25.427214 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd378f4-7652-447a-bb3c-8906c99eeeba admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:25.471321 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92650472-81c4-4803-b078-412602aacf2a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:25.479593 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1179/2349] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:46:25 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:46:25.487403 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92650472-81c4-4803-b078-412602aacf2a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:25.638846 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a17ef5-31dc-4da1-9550-558a52d63aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:25.639946 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a17ef5-31dc-4da1-9550-558a52d63aae admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:25.640385 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a17ef5-31dc-4da1-9550-558a52d63aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:25.640821 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a17ef5-31dc-4da1-9550-558a52d63aae admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:25.641702 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a17ef5-31dc-4da1-9550-558a52d63aae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:25.643798 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a17ef5-31dc-4da1-9550-558a52d63aae admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:25.677480 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1171/2350] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:46:25 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:46:25.681627 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd378f4-7652-447a-bb3c-8906c99eeeba admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:25.694377 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd378f4-7652-447a-bb3c-8906c99eeeba admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:25.703790 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa302df4-e30c-40ab-8e95-6e3b1182c1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:25.705301 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa302df4-e30c-40ab-8e95-6e3b1182c1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:25.705850 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa302df4-e30c-40ab-8e95-6e3b1182c1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:25.706865 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa302df4-e30c-40ab-8e95-6e3b1182c1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:25.707917 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa302df4-e30c-40ab-8e95-6e3b1182c1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:25.711169 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa302df4-e30c-40ab-8e95-6e3b1182c1e3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:25.728263 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1180/2351] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:46:25.732962 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a17ef5-31dc-4da1-9550-558a52d63aae admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:25.746552 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a17ef5-31dc-4da1-9550-558a52d63aae admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:25.771515 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e337e-9326-4ac9-aa02-ac1e7f873ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:25.772359 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e337e-9326-4ac9-aa02-ac1e7f873ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:25.772753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e337e-9326-4ac9-aa02-ac1e7f873ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:25.773159 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e337e-9326-4ac9-aa02-ac1e7f873ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:25.774002 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e337e-9326-4ac9-aa02-ac1e7f873ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:25.776779 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e337e-9326-4ac9-aa02-ac1e7f873ac5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:25.800991 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1172/2352] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:46:25.804521 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa302df4-e30c-40ab-8e95-6e3b1182c1e3 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:25.825052 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa302df4-e30c-40ab-8e95-6e3b1182c1e3 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:25.830565 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f8f26-d3b6-4c13-bc44-526f0d7d7a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:25.831449 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f8f26-d3b6-4c13-bc44-526f0d7d7a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:25.831737 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f8f26-d3b6-4c13-bc44-526f0d7d7a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:25.832181 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f8f26-d3b6-4c13-bc44-526f0d7d7a90 admin admin] PATH_INFO: `/v3/projects/3e41eeab9e32437da369e1330e392b75/users/76484f72884a4545bec2a13d4b3a85f9/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:25.875347 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f8f26-d3b6-4c13-bc44-526f0d7d7a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e41eeab9e32437da369e1330e392b75, user_id=76484f72884a4545bec2a13d4b3a85f9, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:25.878694 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f8f26-d3b6-4c13-bc44-526f0d7d7a90 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:25.924721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1181/2353] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:46:25 2022] PUT /identity/v3/projects/3e41eeab9e32437da369e1330e392b75/users/76484f72884a4545bec2a13d4b3a85f9/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:25.927876 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efdbf0-0a40-41f0-9f52-e0f01c58c861 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:25.928226 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efdbf0-0a40-41f0-9f52-e0f01c58c861 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:25.928735 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efdbf0-0a40-41f0-9f52-e0f01c58c861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:25.964871 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-78efdbf0-0a40-41f0-9f52-e0f01c58c861 None None] MFA Rules not processed for user `76484f72884a4545bec2a13d4b3a85f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:25.967239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-78efdbf0-0a40-41f0-9f52-e0f01c58c861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:26.056871 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1173/2354] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:26.061306 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f8f26-d3b6-4c13-bc44-526f0d7d7a90 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:26.126804 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f8f26-d3b6-4c13-bc44-526f0d7d7a90 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:26.132063 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11199f0-7b85-4775-bd16-b8a119e96dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:26.132721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11199f0-7b85-4775-bd16-b8a119e96dbc admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:26.133010 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11199f0-7b85-4775-bd16-b8a119e96dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:26.133287 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11199f0-7b85-4775-bd16-b8a119e96dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:26.134707 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11199f0-7b85-4775-bd16-b8a119e96dbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:26.136679 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11199f0-7b85-4775-bd16-b8a119e96dbc admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:26.170443 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1182/2355] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:46:26 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:46:26.174234 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efdbf0-0a40-41f0-9f52-e0f01c58c861 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:26.190744 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efdbf0-0a40-41f0-9f52-e0f01c58c861 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:26.271400 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c24171-6e9e-4d23-bef8-ebc48cc5b1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:26.272363 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c24171-6e9e-4d23-bef8-ebc48cc5b1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:26.272650 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c24171-6e9e-4d23-bef8-ebc48cc5b1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:26.272994 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c24171-6e9e-4d23-bef8-ebc48cc5b1c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:26.273871 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c24171-6e9e-4d23-bef8-ebc48cc5b1c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:26.276655 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c24171-6e9e-4d23-bef8-ebc48cc5b1c4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:26.312928 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11199f0-7b85-4775-bd16-b8a119e96dbc admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:26.322006 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1174/2356] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:46:26 2022] POST /identity/v3/users => generated 297 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:46:26.329174 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11199f0-7b85-4775-bd16-b8a119e96dbc admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:26.334832 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86990ba-8dc6-4975-bca9-2963f02bcd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:26.335606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86990ba-8dc6-4975-bca9-2963f02bcd58 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:26.335946 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86990ba-8dc6-4975-bca9-2963f02bcd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:26.336212 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86990ba-8dc6-4975-bca9-2963f02bcd58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:26.338527 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86990ba-8dc6-4975-bca9-2963f02bcd58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:26.340357 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86990ba-8dc6-4975-bca9-2963f02bcd58 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:26.369530 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1183/2357] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:46:26.370196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c24171-6e9e-4d23-bef8-ebc48cc5b1c4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:26.381201 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c24171-6e9e-4d23-bef8-ebc48cc5b1c4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:26.390094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcde1f9-417c-4d6e-a700-2658e6b25fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:26.391530 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcde1f9-417c-4d6e-a700-2658e6b25fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:26.392089 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcde1f9-417c-4d6e-a700-2658e6b25fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:26.392467 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcde1f9-417c-4d6e-a700-2658e6b25fb5 admin admin] PATH_INFO: `/v3/projects/6e5d7f73fb20456a93628def8163a250/users/619bf0d3ad7f4224bd1a10dbea323c9f/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:26.417561 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcde1f9-417c-4d6e-a700-2658e6b25fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5d7f73fb20456a93628def8163a250, user_id=619bf0d3ad7f4224bd1a10dbea323c9f, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:26.421386 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcde1f9-417c-4d6e-a700-2658e6b25fb5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:26.464776 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1175/2358] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:46:26 2022] PUT /identity/v3/projects/6e5d7f73fb20456a93628def8163a250/users/619bf0d3ad7f4224bd1a10dbea323c9f/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:46:26.475898 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86990ba-8dc6-4975-bca9-2963f02bcd58 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:26.486935 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86990ba-8dc6-4975-bca9-2963f02bcd58 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:26.575996 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f94c4e-aedc-4151-bf3f-83abe5f9522f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:26.576665 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f94c4e-aedc-4151-bf3f-83abe5f9522f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:26.576947 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f94c4e-aedc-4151-bf3f-83abe5f9522f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:26.577224 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f94c4e-aedc-4151-bf3f-83abe5f9522f admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:26.577970 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f94c4e-aedc-4151-bf3f-83abe5f9522f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:26.579580 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f94c4e-aedc-4151-bf3f-83abe5f9522f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:26.591556 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1184/2359] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:46:26.595100 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcde1f9-417c-4d6e-a700-2658e6b25fb5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:26.610172 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcde1f9-417c-4d6e-a700-2658e6b25fb5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:26.620368 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39c69a-bdb6-41da-a41f-7a683851f0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:26.625714 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39c69a-bdb6-41da-a41f-7a683851f0ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:26.626215 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39c69a-bdb6-41da-a41f-7a683851f0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:26.626664 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39c69a-bdb6-41da-a41f-7a683851f0ec admin admin] PATH_INFO: `/v3/projects/6e5d7f73fb20456a93628def8163a250/users/619bf0d3ad7f4224bd1a10dbea323c9f/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:26.629507 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39c69a-bdb6-41da-a41f-7a683851f0ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5d7f73fb20456a93628def8163a250, user_id=619bf0d3ad7f4224bd1a10dbea323c9f, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:26.635840 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39c69a-bdb6-41da-a41f-7a683851f0ec admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:26.661921 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1176/2360] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:46:26 2022] PUT /identity/v3/projects/6e5d7f73fb20456a93628def8163a250/users/619bf0d3ad7f4224bd1a10dbea323c9f/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:26.666866 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449958c0-ceec-4356-9ca6-8672f0278529 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:26.667177 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449958c0-ceec-4356-9ca6-8672f0278529 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:26.669156 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449958c0-ceec-4356-9ca6-8672f0278529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:26.702491 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-449958c0-ceec-4356-9ca6-8672f0278529 None None] MFA Rules not processed for user `619bf0d3ad7f4224bd1a10dbea323c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:26.703857 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-449958c0-ceec-4356-9ca6-8672f0278529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:26.815607 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1185/2361] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:26.830432 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39c69a-bdb6-41da-a41f-7a683851f0ec admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:26.832363 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-bb39c69a-bdb6-41da-a41f-7a683851f0ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:26.961670 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39c69a-bdb6-41da-a41f-7a683851f0ec admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:26.970639 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cedad-0fc8-4d1a-8229-bc21a454ba2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:26.971304 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cedad-0fc8-4d1a-8229-bc21a454ba2b service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:26.971590 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cedad-0fc8-4d1a-8229-bc21a454ba2b service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:26.971891 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cedad-0fc8-4d1a-8229-bc21a454ba2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:26.983203 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41cedad-0fc8-4d1a-8229-bc21a454ba2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:26.985295 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41cedad-0fc8-4d1a-8229-bc21a454ba2b service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:26.998713 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1177/2362] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:46:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:46:27.099486 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449958c0-ceec-4356-9ca6-8672f0278529 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:27.110220 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449958c0-ceec-4356-9ca6-8672f0278529 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:27.114006 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3353c62-17ed-4642-938f-514cd2b5af6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:27.114763 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3353c62-17ed-4642-938f-514cd2b5af6b service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:27.115155 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3353c62-17ed-4642-938f-514cd2b5af6b service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:27.115532 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3353c62-17ed-4642-938f-514cd2b5af6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:27.209172 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3353c62-17ed-4642-938f-514cd2b5af6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:27.211608 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3353c62-17ed-4642-938f-514cd2b5af6b service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:27.247971 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1186/2363] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:46:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:46:27.745820 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cedad-0fc8-4d1a-8229-bc21a454ba2b service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:27.876656 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cedad-0fc8-4d1a-8229-bc21a454ba2b service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:27.882772 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855920d6-0ab9-47d4-9b17-4220f324fbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:27.885615 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855920d6-0ab9-47d4-9b17-4220f324fbb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:27.886017 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855920d6-0ab9-47d4-9b17-4220f324fbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:27.886400 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855920d6-0ab9-47d4-9b17-4220f324fbb1 admin admin] PATH_INFO: `/v3/users/76484f72884a4545bec2a13d4b3a85f9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:27.887845 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855920d6-0ab9-47d4-9b17-4220f324fbb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76484f72884a4545bec2a13d4b3a85f9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:27.891377 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855920d6-0ab9-47d4-9b17-4220f324fbb1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:28.000617 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-855920d6-0ab9-47d4-9b17-4220f324fbb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76484f72884a4545bec2a13d4b3a85f9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:28.010244 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-855920d6-0ab9-47d4-9b17-4220f324fbb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76484f72884a4545bec2a13d4b3a85f9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:28.032987 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-855920d6-0ab9-47d4-9b17-4220f324fbb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76484f72884a4545bec2a13d4b3a85f9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:28.056905 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-855920d6-0ab9-47d4-9b17-4220f324fbb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76484f72884a4545bec2a13d4b3a85f9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:28.058183 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-855920d6-0ab9-47d4-9b17-4220f324fbb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76484f72884a4545bec2a13d4b3a85f9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:28.074252 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1178/2364] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:46:27 2022] DELETE /identity/v3/users/76484f72884a4545bec2a13d4b3a85f9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:28.076135 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a3161-9944-493d-9c89-68c153d99b88 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:28.076309 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a3161-9944-493d-9c89-68c153d99b88 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:28.076615 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a3161-9944-493d-9c89-68c153d99b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:28.109588 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-9f2a3161-9944-493d-9c89-68c153d99b88 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:28.114364 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-9f2a3161-9944-493d-9c89-68c153d99b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:28.304577 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1187/2365] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:28.315568 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855920d6-0ab9-47d4-9b17-4220f324fbb1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:28.317034 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-855920d6-0ab9-47d4-9b17-4220f324fbb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:28.468589 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855920d6-0ab9-47d4-9b17-4220f324fbb1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:28.481166 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb1d2a-5026-4baf-9545-e0710aff7f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:28.481927 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb1d2a-5026-4baf-9545-e0710aff7f08 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:28.482098 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb1d2a-5026-4baf-9545-e0710aff7f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:28.482367 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb1d2a-5026-4baf-9545-e0710aff7f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:28.503206 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb1d2a-5026-4baf-9545-e0710aff7f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:28.505230 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb1d2a-5026-4baf-9545-e0710aff7f08 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:28.518358 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1179/2366] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:46:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:46:29.070056 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a3161-9944-493d-9c89-68c153d99b88 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:29.072465 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-9f2a3161-9944-493d-9c89-68c153d99b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:29.100288 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a3161-9944-493d-9c89-68c153d99b88 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:29.116187 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effac748-97a7-40e1-8f79-eac2fda46f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:29.117054 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effac748-97a7-40e1-8f79-eac2fda46f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:29.117332 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effac748-97a7-40e1-8f79-eac2fda46f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:29.117601 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effac748-97a7-40e1-8f79-eac2fda46f73 admin admin] PATH_INFO: `/v3/projects/3e41eeab9e32437da369e1330e392b75` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:29.119666 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effac748-97a7-40e1-8f79-eac2fda46f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e41eeab9e32437da369e1330e392b75)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:29.129365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effac748-97a7-40e1-8f79-eac2fda46f73 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:29.233977 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-effac748-97a7-40e1-8f79-eac2fda46f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e41eeab9e32437da369e1330e392b75', 'request_id': 'req-effac748-97a7-40e1-8f79-eac2fda46f73'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:29.243221 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-effac748-97a7-40e1-8f79-eac2fda46f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e41eeab9e32437da369e1330e392b75', 'request_id': 'req-effac748-97a7-40e1-8f79-eac2fda46f73'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:29.280021 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-effac748-97a7-40e1-8f79-eac2fda46f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e41eeab9e32437da369e1330e392b75', 'request_id': 'req-effac748-97a7-40e1-8f79-eac2fda46f73'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:29.322567 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-effac748-97a7-40e1-8f79-eac2fda46f73 admin admin] The token cache is being invalidate because project 3e41eeab9e32437da369e1330e392b75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:46:29.323308 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-effac748-97a7-40e1-8f79-eac2fda46f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:29.324106 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-effac748-97a7-40e1-8f79-eac2fda46f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:29.328079 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1188/2367] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:46:29 2022] DELETE /identity/v3/projects/3e41eeab9e32437da369e1330e392b75 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:29.332095 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb1d2a-5026-4baf-9545-e0710aff7f08 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:29.344188 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb1d2a-5026-4baf-9545-e0710aff7f08 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:29.481794 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efb65c-3d59-45ba-a327-79cf2fce57f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:29.482782 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efb65c-3d59-45ba-a327-79cf2fce57f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:29.483069 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efb65c-3d59-45ba-a327-79cf2fce57f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:29.483348 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efb65c-3d59-45ba-a327-79cf2fce57f4 admin admin] PATH_INFO: `/v3/users/619bf0d3ad7f4224bd1a10dbea323c9f` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:29.489423 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efb65c-3d59-45ba-a327-79cf2fce57f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=619bf0d3ad7f4224bd1a10dbea323c9f)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:29.515150 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efb65c-3d59-45ba-a327-79cf2fce57f4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:29.692309 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d5efb65c-3d59-45ba-a327-79cf2fce57f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '619bf0d3ad7f4224bd1a10dbea323c9f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:29.721168 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d5efb65c-3d59-45ba-a327-79cf2fce57f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '619bf0d3ad7f4224bd1a10dbea323c9f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:29.751546 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d5efb65c-3d59-45ba-a327-79cf2fce57f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '619bf0d3ad7f4224bd1a10dbea323c9f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:29.772048 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d5efb65c-3d59-45ba-a327-79cf2fce57f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '619bf0d3ad7f4224bd1a10dbea323c9f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:29.772727 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d5efb65c-3d59-45ba-a327-79cf2fce57f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '619bf0d3ad7f4224bd1a10dbea323c9f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:29.785132 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1180/2368] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:46:29 2022] DELETE /identity/v3/users/619bf0d3ad7f4224bd1a10dbea323c9f => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:29.835528 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70987bd5-f15e-457e-94c5-6e336afdf39d None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:29.835848 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70987bd5-f15e-457e-94c5-6e336afdf39d None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:29.836132 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70987bd5-f15e-457e-94c5-6e336afdf39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:29.888138 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-70987bd5-f15e-457e-94c5-6e336afdf39d None None] MFA Rules not processed for user `9761863f36284bd4be1ce29c86b631cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:29.890000 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-70987bd5-f15e-457e-94c5-6e336afdf39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:29.987102 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1189/2369] 10.222.0.35 () {58 vars in 1009 bytes} [Tue Feb 8 16:46:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:30.012409 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efb65c-3d59-45ba-a327-79cf2fce57f4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:30.014458 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d5efb65c-3d59-45ba-a327-79cf2fce57f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:30.239588 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efb65c-3d59-45ba-a327-79cf2fce57f4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:30.265250 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba48df-1174-4621-9704-ecba1f4ddd7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00fd3c05cd8e4167946a1f567df2cc6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:30.265814 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba48df-1174-4621-9704-ecba1f4ddd7c service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:30.266105 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba48df-1174-4621-9704-ecba1f4ddd7c service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:30.266372 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba48df-1174-4621-9704-ecba1f4ddd7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:30.319138 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba48df-1174-4621-9704-ecba1f4ddd7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:30.321058 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba48df-1174-4621-9704-ecba1f4ddd7c service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:30.326912 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70987bd5-f15e-457e-94c5-6e336afdf39d None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:30.328563 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-70987bd5-f15e-457e-94c5-6e336afdf39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:30.345079 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1181/2370] 10.222.0.35 () {60 vars in 1384 bytes} [Tue Feb 8 16:46:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:46:30.522562 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70987bd5-f15e-457e-94c5-6e336afdf39d None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:30.535238 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4ac50-3073-4d98-88e1-7122fd6927e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:30.536650 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4ac50-3073-4d98-88e1-7122fd6927e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:30.537823 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4ac50-3073-4d98-88e1-7122fd6927e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:30.538557 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4ac50-3073-4d98-88e1-7122fd6927e9 admin admin] PATH_INFO: `/v3/projects/6e5d7f73fb20456a93628def8163a250` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:30.542735 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4ac50-3073-4d98-88e1-7122fd6927e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e5d7f73fb20456a93628def8163a250)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:30.547266 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4ac50-3073-4d98-88e1-7122fd6927e9 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:30.706218 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b4d4ac50-3073-4d98-88e1-7122fd6927e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5d7f73fb20456a93628def8163a250', 'request_id': 'req-b4d4ac50-3073-4d98-88e1-7122fd6927e9'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:30.723858 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b4d4ac50-3073-4d98-88e1-7122fd6927e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5d7f73fb20456a93628def8163a250', 'request_id': 'req-b4d4ac50-3073-4d98-88e1-7122fd6927e9'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:30.736762 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b4d4ac50-3073-4d98-88e1-7122fd6927e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5d7f73fb20456a93628def8163a250', 'request_id': 'req-b4d4ac50-3073-4d98-88e1-7122fd6927e9'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:30.772883 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b4d4ac50-3073-4d98-88e1-7122fd6927e9 admin admin] The token cache is being invalidate because project 6e5d7f73fb20456a93628def8163a250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:46:30.775433 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b4d4ac50-3073-4d98-88e1-7122fd6927e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:30.777469 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-b4d4ac50-3073-4d98-88e1-7122fd6927e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:30.781553 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1190/2371] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:46:30 2022] DELETE /identity/v3/projects/6e5d7f73fb20456a93628def8163a250 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:46:30.787550 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9750973-6cc7-448e-a81f-41a170892560 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:30.788175 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9750973-6cc7-448e-a81f-41a170892560 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:30.788689 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9750973-6cc7-448e-a81f-41a170892560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:30.827594 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e9750973-6cc7-448e-a81f-41a170892560 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:30.829271 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e9750973-6cc7-448e-a81f-41a170892560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:30.978209 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1182/2372] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:46:30.979470 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf20b0-0c4f-45ff-937a-612149523c6b None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:30.979784 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf20b0-0c4f-45ff-937a-612149523c6b None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:30.980069 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf20b0-0c4f-45ff-937a-612149523c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:31.001750 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-cfcf20b0-0c4f-45ff-937a-612149523c6b None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:31.003411 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-cfcf20b0-0c4f-45ff-937a-612149523c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:31.027722 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9750973-6cc7-448e-a81f-41a170892560 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:31.039012 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9750973-6cc7-448e-a81f-41a170892560 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:31.040302 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1191/2373] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:46:31.057154 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a06b3-ea90-4277-9416-65616240487e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:31.058226 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a06b3-ea90-4277-9416-65616240487e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:31.062111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a06b3-ea90-4277-9416-65616240487e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:31.062644 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a06b3-ea90-4277-9416-65616240487e admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:31.063902 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a06b3-ea90-4277-9416-65616240487e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:46:31.064376 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a06b3-ea90-4277-9416-65616240487e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:31.072444 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a06b3-ea90-4277-9416-65616240487e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:31.107640 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1183/2374] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:46:31.110045 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf20b0-0c4f-45ff-937a-612149523c6b None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:31.122428 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf20b0-0c4f-45ff-937a-612149523c6b None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:31.133260 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fcf69-2f4e-447e-82a4-fabe4c91fbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:31.134855 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fcf69-2f4e-447e-82a4-fabe4c91fbcc admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:31.135419 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fcf69-2f4e-447e-82a4-fabe4c91fbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:31.135901 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fcf69-2f4e-447e-82a4-fabe4c91fbcc admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:31.137277 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fcf69-2f4e-447e-82a4-fabe4c91fbcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:31.141798 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fcf69-2f4e-447e-82a4-fabe4c91fbcc admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:31.204055 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1192/2375] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:46:31 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:46:31.205321 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a06b3-ea90-4277-9416-65616240487e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:31.218691 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a06b3-ea90-4277-9416-65616240487e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:31.364260 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc693794-2207-4caf-980e-8dd003849116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:31.367684 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc693794-2207-4caf-980e-8dd003849116 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:31.368254 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc693794-2207-4caf-980e-8dd003849116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:31.368750 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc693794-2207-4caf-980e-8dd003849116 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:31.369945 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc693794-2207-4caf-980e-8dd003849116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:31.373322 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc693794-2207-4caf-980e-8dd003849116 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:31.467351 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1184/2376] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:46:31 2022] POST /identity/v3/users => generated 289 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:46:31.492820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fcf69-2f4e-447e-82a4-fabe4c91fbcc admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:31.515929 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fcf69-2f4e-447e-82a4-fabe4c91fbcc admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:31.531286 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b55adf-7e8a-4977-bcdf-4d01fe88b58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:31.532371 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b55adf-7e8a-4977-bcdf-4d01fe88b58e admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:31.533171 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b55adf-7e8a-4977-bcdf-4d01fe88b58e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:31.533646 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b55adf-7e8a-4977-bcdf-4d01fe88b58e admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:31.534930 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b55adf-7e8a-4977-bcdf-4d01fe88b58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:31.536871 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b55adf-7e8a-4977-bcdf-4d01fe88b58e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:31.557217 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc693794-2207-4caf-980e-8dd003849116 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:31.558396 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1193/2377] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:46:31.569439 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc693794-2207-4caf-980e-8dd003849116 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:31.582640 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e53e90-f111-45f5-a8e0-2c09fef2b256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:31.583478 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e53e90-f111-45f5-a8e0-2c09fef2b256 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:31.583782 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e53e90-f111-45f5-a8e0-2c09fef2b256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:31.584143 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e53e90-f111-45f5-a8e0-2c09fef2b256 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:31.584894 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e53e90-f111-45f5-a8e0-2c09fef2b256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:31.587163 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e53e90-f111-45f5-a8e0-2c09fef2b256 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:31.604634 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1185/2378] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:46:31.606962 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b55adf-7e8a-4977-bcdf-4d01fe88b58e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:31.619113 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b55adf-7e8a-4977-bcdf-4d01fe88b58e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:31.626890 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979bdbc-a69d-47fb-aac1-2e34953b35f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:31.628176 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979bdbc-a69d-47fb-aac1-2e34953b35f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:31.628545 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979bdbc-a69d-47fb-aac1-2e34953b35f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:31.628910 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979bdbc-a69d-47fb-aac1-2e34953b35f9 admin admin] PATH_INFO: `/v3/projects/9398375d818c4ef5be2518b514c5c8f5/users/bcd8fdb6dbe047c5bc4b38dc01da3ec8/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:31.674000 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979bdbc-a69d-47fb-aac1-2e34953b35f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9398375d818c4ef5be2518b514c5c8f5, user_id=bcd8fdb6dbe047c5bc4b38dc01da3ec8, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:31.689375 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979bdbc-a69d-47fb-aac1-2e34953b35f9 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:31.734244 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920c4a4-90d9-4523-acb2-40ee4e1ec5df None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:31.734443 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920c4a4-90d9-4523-acb2-40ee4e1ec5df None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:31.734703 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920c4a4-90d9-4523-acb2-40ee4e1ec5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:31.742333 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1194/2379] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:46:31 2022] PUT /identity/v3/projects/9398375d818c4ef5be2518b514c5c8f5/users/bcd8fdb6dbe047c5bc4b38dc01da3ec8/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:31.768762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-9920c4a4-90d9-4523-acb2-40ee4e1ec5df None None] MFA Rules not processed for user `bcd8fdb6dbe047c5bc4b38dc01da3ec8`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:31.769965 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9920c4a4-90d9-4523-acb2-40ee4e1ec5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:31.848936 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979bdbc-a69d-47fb-aac1-2e34953b35f9 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:31.860389 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1186/2380] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:31.927375 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979bdbc-a69d-47fb-aac1-2e34953b35f9 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:31.933617 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cc741-19e0-4fab-8ead-ef4318c29f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:31.934648 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cc741-19e0-4fab-8ead-ef4318c29f4e admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:31.934931 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cc741-19e0-4fab-8ead-ef4318c29f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:31.935205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cc741-19e0-4fab-8ead-ef4318c29f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:31.935947 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cc741-19e0-4fab-8ead-ef4318c29f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:31.937949 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cc741-19e0-4fab-8ead-ef4318c29f4e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:31.996544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1195/2381] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:46:31 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:46:32.000082 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920c4a4-90d9-4523-acb2-40ee4e1ec5df None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:32.015188 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920c4a4-90d9-4523-acb2-40ee4e1ec5df None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:32.095981 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923edef7-81bc-43e6-b2bf-9dc14d3c1e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:32.097477 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923edef7-81bc-43e6-b2bf-9dc14d3c1e44 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:32.097948 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923edef7-81bc-43e6-b2bf-9dc14d3c1e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:32.098235 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923edef7-81bc-43e6-b2bf-9dc14d3c1e44 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:32.099003 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923edef7-81bc-43e6-b2bf-9dc14d3c1e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:32.101289 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923edef7-81bc-43e6-b2bf-9dc14d3c1e44 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:32.143093 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1187/2382] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:46:31 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:46:32.194123 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cc741-19e0-4fab-8ead-ef4318c29f4e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:32.211248 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cc741-19e0-4fab-8ead-ef4318c29f4e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:32.240515 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd2f18-2bff-4941-b3e6-5bf5f7cf5cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:32.242604 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd2f18-2bff-4941-b3e6-5bf5f7cf5cda admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:32.245782 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd2f18-2bff-4941-b3e6-5bf5f7cf5cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:32.246254 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd2f18-2bff-4941-b3e6-5bf5f7cf5cda admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:32.247407 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd2f18-2bff-4941-b3e6-5bf5f7cf5cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:32.252010 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd2f18-2bff-4941-b3e6-5bf5f7cf5cda admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:32.287232 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1196/2383] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:46:32.293937 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923edef7-81bc-43e6-b2bf-9dc14d3c1e44 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:32.316595 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923edef7-81bc-43e6-b2bf-9dc14d3c1e44 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:32.322908 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd2f18-2bff-4941-b3e6-5bf5f7cf5cda admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:32.324633 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-c5cd2f18-2bff-4941-b3e6-5bf5f7cf5cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:32.340250 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1010d-96ed-431d-9cfd-5cd258f008ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:32.340929 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1010d-96ed-431d-9cfd-5cd258f008ea admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:32.341260 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1010d-96ed-431d-9cfd-5cd258f008ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:32.341537 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1010d-96ed-431d-9cfd-5cd258f008ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:32.342308 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1010d-96ed-431d-9cfd-5cd258f008ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:32.343964 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1010d-96ed-431d-9cfd-5cd258f008ea admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:32.385761 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1188/2384] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:46:32.386694 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1010d-96ed-431d-9cfd-5cd258f008ea admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:32.396746 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1010d-96ed-431d-9cfd-5cd258f008ea admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:32.407924 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d990d-6d49-4a66-8eae-8811b78f3f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:32.408868 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d990d-6d49-4a66-8eae-8811b78f3f1f admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:32.409199 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d990d-6d49-4a66-8eae-8811b78f3f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:32.409508 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d990d-6d49-4a66-8eae-8811b78f3f1f admin admin] PATH_INFO: `/v3/projects/974f048b161840d2b4dc51281bfecb86/users/89bd21de382f4d1fa06d2147771aca18/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:32.428223 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d990d-6d49-4a66-8eae-8811b78f3f1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=974f048b161840d2b4dc51281bfecb86, user_id=89bd21de382f4d1fa06d2147771aca18, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:32.431574 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d990d-6d49-4a66-8eae-8811b78f3f1f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:32.441064 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd2f18-2bff-4941-b3e6-5bf5f7cf5cda admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:32.451269 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4b45d-ff42-4e83-850d-2a670c0f633d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:32.451959 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4b45d-ff42-4e83-850d-2a670c0f633d service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:32.452281 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4b45d-ff42-4e83-850d-2a670c0f633d service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:32.452559 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4b45d-ff42-4e83-850d-2a670c0f633d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:32.465581 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-12f4b45d-ff42-4e83-850d-2a670c0f633d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:32.472080 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1189/2385] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:46:32 2022] PUT /identity/v3/projects/974f048b161840d2b4dc51281bfecb86/users/89bd21de382f4d1fa06d2147771aca18/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:32.476154 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e77e53-6ead-45bd-9969-f0b5e518c776 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:32.476249 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e77e53-6ead-45bd-9969-f0b5e518c776 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:32.481621 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e77e53-6ead-45bd-9969-f0b5e518c776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:32.551080 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-10e77e53-6ead-45bd-9969-f0b5e518c776 None None] MFA Rules not processed for user `89bd21de382f4d1fa06d2147771aca18`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:32.552265 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-10e77e53-6ead-45bd-9969-f0b5e518c776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:32.628405 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4b45d-ff42-4e83-850d-2a670c0f633d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:32.630073 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4b45d-ff42-4e83-850d-2a670c0f633d service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:32.645556 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1190/2386] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:32.646822 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e77e53-6ead-45bd-9969-f0b5e518c776 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:32.659441 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1197/2387] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:46:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:46:32.750517 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e77e53-6ead-45bd-9969-f0b5e518c776 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:32.756018 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d344eb6-c252-4033-8108-3bd48de55a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:32.757023 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d344eb6-c252-4033-8108-3bd48de55a7a admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:32.757549 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d344eb6-c252-4033-8108-3bd48de55a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:32.758056 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d344eb6-c252-4033-8108-3bd48de55a7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:32.759023 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d344eb6-c252-4033-8108-3bd48de55a7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:32.761391 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d344eb6-c252-4033-8108-3bd48de55a7a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:32.807638 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1191/2388] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:46:32 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:46:32.808604 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4b45d-ff42-4e83-850d-2a670c0f633d service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:32.831844 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4b45d-ff42-4e83-850d-2a670c0f633d service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:32.970122 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126bebd-b9ae-4ff2-aafc-ae93862ebd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:32.971196 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126bebd-b9ae-4ff2-aafc-ae93862ebd31 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:32.971651 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126bebd-b9ae-4ff2-aafc-ae93862ebd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:32.972109 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126bebd-b9ae-4ff2-aafc-ae93862ebd31 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:32.972983 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126bebd-b9ae-4ff2-aafc-ae93862ebd31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:32.975517 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126bebd-b9ae-4ff2-aafc-ae93862ebd31 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:33.025997 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1198/2389] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:46:32 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:46:33.027175 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d344eb6-c252-4033-8108-3bd48de55a7a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:33.042429 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d344eb6-c252-4033-8108-3bd48de55a7a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:33.054294 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d118f-9b9e-4b8d-99a3-7700285fac73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:33.054952 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d118f-9b9e-4b8d-99a3-7700285fac73 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:33.055312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d118f-9b9e-4b8d-99a3-7700285fac73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:33.055972 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d118f-9b9e-4b8d-99a3-7700285fac73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:33.057172 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d118f-9b9e-4b8d-99a3-7700285fac73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:33.062507 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d118f-9b9e-4b8d-99a3-7700285fac73 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:33.090616 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1192/2390] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:46:33.094367 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126bebd-b9ae-4ff2-aafc-ae93862ebd31 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:33.117497 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126bebd-b9ae-4ff2-aafc-ae93862ebd31 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:33.123933 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10815d94-14be-46c2-b5ed-f14364e49ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:33.124835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10815d94-14be-46c2-b5ed-f14364e49ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:33.125116 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10815d94-14be-46c2-b5ed-f14364e49ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:33.125394 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10815d94-14be-46c2-b5ed-f14364e49ca9 admin admin] PATH_INFO: `/v3/projects/c0a9cf489d1341d78fa4b62c7d9d2744/users/c52831ec41cd40afaba90e6b7364dd49/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:33.147093 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10815d94-14be-46c2-b5ed-f14364e49ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a9cf489d1341d78fa4b62c7d9d2744, user_id=c52831ec41cd40afaba90e6b7364dd49, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:33.151182 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10815d94-14be-46c2-b5ed-f14364e49ca9 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:33.178508 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1199/2391] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:46:33 2022] PUT /identity/v3/projects/c0a9cf489d1341d78fa4b62c7d9d2744/users/c52831ec41cd40afaba90e6b7364dd49/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:46:33.183287 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d118f-9b9e-4b8d-99a3-7700285fac73 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:33.201917 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d118f-9b9e-4b8d-99a3-7700285fac73 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:33.290198 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf397f26-5dfc-4147-810b-cd654530c3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:33.291012 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf397f26-5dfc-4147-810b-cd654530c3ca admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:33.291396 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf397f26-5dfc-4147-810b-cd654530c3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:33.292021 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf397f26-5dfc-4147-810b-cd654530c3ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:33.292858 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf397f26-5dfc-4147-810b-cd654530c3ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:33.294607 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf397f26-5dfc-4147-810b-cd654530c3ca admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:33.309894 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1193/2392] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:46:33.314779 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10815d94-14be-46c2-b5ed-f14364e49ca9 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:33.334297 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10815d94-14be-46c2-b5ed-f14364e49ca9 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:33.348659 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f4965-32ea-4482-9101-9a4a448795d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:33.350400 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f4965-32ea-4482-9101-9a4a448795d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:33.350916 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f4965-32ea-4482-9101-9a4a448795d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:33.351402 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f4965-32ea-4482-9101-9a4a448795d9 admin admin] PATH_INFO: `/v3/projects/c0a9cf489d1341d78fa4b62c7d9d2744/users/c52831ec41cd40afaba90e6b7364dd49/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:33.354360 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f4965-32ea-4482-9101-9a4a448795d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a9cf489d1341d78fa4b62c7d9d2744, user_id=c52831ec41cd40afaba90e6b7364dd49, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:33.357305 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f4965-32ea-4482-9101-9a4a448795d9 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:33.393505 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d28cb-6f38-4938-862f-68748522d303 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:33.394615 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d28cb-6f38-4938-862f-68748522d303 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:33.395156 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d28cb-6f38-4938-862f-68748522d303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:33.398144 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1200/2393] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:46:33 2022] PUT /identity/v3/projects/c0a9cf489d1341d78fa4b62c7d9d2744/users/c52831ec41cd40afaba90e6b7364dd49/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:33.463358 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-9b1d28cb-6f38-4938-862f-68748522d303 None None] MFA Rules not processed for user `c52831ec41cd40afaba90e6b7364dd49`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:33.465892 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9b1d28cb-6f38-4938-862f-68748522d303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:33.576681 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1194/2394] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:33.584444 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f4965-32ea-4482-9101-9a4a448795d9 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:33.586449 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-ab7f4965-32ea-4482-9101-9a4a448795d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:33.667274 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f4965-32ea-4482-9101-9a4a448795d9 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:33.672568 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa5888-1e4b-4fba-b06f-a499624f7c92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:33.673709 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa5888-1e4b-4fba-b06f-a499624f7c92 service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:33.674269 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa5888-1e4b-4fba-b06f-a499624f7c92 service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:33.674774 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa5888-1e4b-4fba-b06f-a499624f7c92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:33.750198 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa5888-1e4b-4fba-b06f-a499624f7c92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:33.751815 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa5888-1e4b-4fba-b06f-a499624f7c92 service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:33.766551 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1201/2395] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:46:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:46:34.258145 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d28cb-6f38-4938-862f-68748522d303 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:34.260002 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9b1d28cb-6f38-4938-862f-68748522d303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:34.345172 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d28cb-6f38-4938-862f-68748522d303 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:34.359539 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88893528-4b6d-4817-a8db-acba3bdae5b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:34.359539 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88893528-4b6d-4817-a8db-acba3bdae5b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:34.359539 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88893528-4b6d-4817-a8db-acba3bdae5b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:34.360083 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88893528-4b6d-4817-a8db-acba3bdae5b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:34.363526 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-88893528-4b6d-4817-a8db-acba3bdae5b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:34.532864 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88893528-4b6d-4817-a8db-acba3bdae5b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:34.534343 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88893528-4b6d-4817-a8db-acba3bdae5b4 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:34.565723 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1195/2396] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:46:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:46:37.814281 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa5888-1e4b-4fba-b06f-a499624f7c92 service cinder] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:37.842157 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa5888-1e4b-4fba-b06f-a499624f7c92 service cinder] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:37.847865 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba82eb7-d61f-4f26-912b-b7107f2b829f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:37.848609 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba82eb7-d61f-4f26-912b-b7107f2b829f service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:37.848896 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba82eb7-d61f-4f26-912b-b7107f2b829f service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:37.849206 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba82eb7-d61f-4f26-912b-b7107f2b829f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:37.959604 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba82eb7-d61f-4f26-912b-b7107f2b829f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:37.961090 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba82eb7-d61f-4f26-912b-b7107f2b829f service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:38.001803 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1202/2397] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:46:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:46:38.491650 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd199952-6378-40bf-a7f9-c0a5fab899d2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:38.494150 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd199952-6378-40bf-a7f9-c0a5fab899d2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:38.495901 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd199952-6378-40bf-a7f9-c0a5fab899d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:38.536026 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-bd199952-6378-40bf-a7f9-c0a5fab899d2 None None] MFA Rules not processed for user `2b8d57b4da614728a52f90e2d7e6ed84`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:38.537277 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-bd199952-6378-40bf-a7f9-c0a5fab899d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:38.642767 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1196/2398] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:38.784046 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba82eb7-d61f-4f26-912b-b7107f2b829f service cinder] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:38.794592 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba82eb7-d61f-4f26-912b-b7107f2b829f service cinder] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:38.813080 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a54c7a-ad00-494e-9f5f-1fd0288a64ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:38.813752 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a54c7a-ad00-494e-9f5f-1fd0288a64ec service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:38.815204 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a54c7a-ad00-494e-9f5f-1fd0288a64ec service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:38.815800 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a54c7a-ad00-494e-9f5f-1fd0288a64ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:38.854038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a54c7a-ad00-494e-9f5f-1fd0288a64ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:38.855500 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a54c7a-ad00-494e-9f5f-1fd0288a64ec service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:38.868185 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1203/2399] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:46:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:46:39.495005 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd199952-6378-40bf-a7f9-c0a5fab899d2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:39.497311 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-bd199952-6378-40bf-a7f9-c0a5fab899d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:39.596607 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd199952-6378-40bf-a7f9-c0a5fab899d2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:39.602917 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7465c-5dbc-46e5-9dca-092f5c0aa151 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c8f232fc83474b8731ee6c1eb321fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:39.603743 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7465c-5dbc-46e5-9dca-092f5c0aa151 service placement] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:39.604079 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7465c-5dbc-46e5-9dca-092f5c0aa151 service placement] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:39.604365 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7465c-5dbc-46e5-9dca-092f5c0aa151 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:39.606187 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1ee7465c-5dbc-46e5-9dca-092f5c0aa151 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:39.621579 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7465c-5dbc-46e5-9dca-092f5c0aa151 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:39.623188 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7465c-5dbc-46e5-9dca-092f5c0aa151 service placement] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:39.639524 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1197/2400] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:46:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:46:42.433711 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a54c7a-ad00-494e-9f5f-1fd0288a64ec service cinder] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:42.435148 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-43a54c7a-ad00-494e-9f5f-1fd0288a64ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:42.491937 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a54c7a-ad00-494e-9f5f-1fd0288a64ec service cinder] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:42.495631 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f1e58-4ee4-4887-9a22-d81b63ae3b9b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10453496872a45a9867fc6a13a13de49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:42.496222 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f1e58-4ee4-4887-9a22-d81b63ae3b9b service glance] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:42.496501 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f1e58-4ee4-4887-9a22-d81b63ae3b9b service glance] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:42.496773 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f1e58-4ee4-4887-9a22-d81b63ae3b9b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:42.498513 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-635f1e58-4ee4-4887-9a22-d81b63ae3b9b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:42.516726 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7465c-5dbc-46e5-9dca-092f5c0aa151 service placement] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:42.518150 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1ee7465c-5dbc-46e5-9dca-092f5c0aa151 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:42.537291 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7465c-5dbc-46e5-9dca-092f5c0aa151 service placement] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:42.545376 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e5218-29ac-49ae-8f15-d8a6f8b2a3e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:42.546413 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e5218-29ac-49ae-8f15-d8a6f8b2a3e0 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:42.546855 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e5218-29ac-49ae-8f15-d8a6f8b2a3e0 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:42.547316 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e5218-29ac-49ae-8f15-d8a6f8b2a3e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:42.549316 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d54e5218-29ac-49ae-8f15-d8a6f8b2a3e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:42.561451 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e5218-29ac-49ae-8f15-d8a6f8b2a3e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:42.561852 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f1e58-4ee4-4887-9a22-d81b63ae3b9b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:42.562989 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e5218-29ac-49ae-8f15-d8a6f8b2a3e0 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:42.563712 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f1e58-4ee4-4887-9a22-d81b63ae3b9b service glance] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:42.574273 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1198/2401] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:46:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:46:42.574968 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1204/2402] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:46:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:46:44.341569 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba74639-80bc-4e7a-83b8-289d8c4ac7d5 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:44.342090 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba74639-80bc-4e7a-83b8-289d8c4ac7d5 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:44.342090 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba74639-80bc-4e7a-83b8-289d8c4ac7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:44.366439 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-cba74639-80bc-4e7a-83b8-289d8c4ac7d5 None None] MFA Rules not processed for user `9761863f36284bd4be1ce29c86b631cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:44.368442 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cba74639-80bc-4e7a-83b8-289d8c4ac7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:44.458272 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1199/2403] 10.222.0.35 () {58 vars in 1009 bytes} [Tue Feb 8 16:46:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:44.477393 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f1e58-4ee4-4887-9a22-d81b63ae3b9b service glance] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:44.478970 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-635f1e58-4ee4-4887-9a22-d81b63ae3b9b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:44.583470 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f1e58-4ee4-4887-9a22-d81b63ae3b9b service glance] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:44.590024 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da290c-dac0-44ae-80d1-a995b18fa8ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00fd3c05cd8e4167946a1f567df2cc6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:44.590954 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da290c-dac0-44ae-80d1-a995b18fa8ea service swift] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:44.591452 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da290c-dac0-44ae-80d1-a995b18fa8ea service swift] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:44.591978 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da290c-dac0-44ae-80d1-a995b18fa8ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:44.605172 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da290c-dac0-44ae-80d1-a995b18fa8ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:44.606955 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da290c-dac0-44ae-80d1-a995b18fa8ea service swift] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:44.619523 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1205/2404] 10.222.0.35 () {60 vars in 1384 bytes} [Tue Feb 8 16:46:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:46:47.120505 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba74639-80bc-4e7a-83b8-289d8c4ac7d5 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:47.182830 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba74639-80bc-4e7a-83b8-289d8c4ac7d5 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:47.187604 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ba3e5-29c7-4866-894f-4875c2b9dde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:47.188520 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ba3e5-29c7-4866-894f-4875c2b9dde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:47.188800 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ba3e5-29c7-4866-894f-4875c2b9dde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:47.189077 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ba3e5-29c7-4866-894f-4875c2b9dde2 admin admin] PATH_INFO: `/v3/users/bcd8fdb6dbe047c5bc4b38dc01da3ec8` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:47.190269 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ba3e5-29c7-4866-894f-4875c2b9dde2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcd8fdb6dbe047c5bc4b38dc01da3ec8)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:47.192235 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ba3e5-29c7-4866-894f-4875c2b9dde2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:47.243127 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-cf5ba3e5-29c7-4866-894f-4875c2b9dde2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcd8fdb6dbe047c5bc4b38dc01da3ec8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:47.250145 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-cf5ba3e5-29c7-4866-894f-4875c2b9dde2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcd8fdb6dbe047c5bc4b38dc01da3ec8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:47.265370 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-cf5ba3e5-29c7-4866-894f-4875c2b9dde2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcd8fdb6dbe047c5bc4b38dc01da3ec8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:47.270368 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-cf5ba3e5-29c7-4866-894f-4875c2b9dde2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcd8fdb6dbe047c5bc4b38dc01da3ec8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:47.270996 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-cf5ba3e5-29c7-4866-894f-4875c2b9dde2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcd8fdb6dbe047c5bc4b38dc01da3ec8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:47.277574 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1200/2405] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:46:47 2022] DELETE /identity/v3/users/bcd8fdb6dbe047c5bc4b38dc01da3ec8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:47.282504 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eee19e-360f-4109-b64f-3981194d7012 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:47.282990 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eee19e-360f-4109-b64f-3981194d7012 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:47.282990 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eee19e-360f-4109-b64f-3981194d7012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:47.300630 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-52eee19e-360f-4109-b64f-3981194d7012 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:46:47.301847 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-52eee19e-360f-4109-b64f-3981194d7012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:47.376367 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1206/2406] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:46:47.387329 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ba3e5-29c7-4866-894f-4875c2b9dde2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:47.389015 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cf5ba3e5-29c7-4866-894f-4875c2b9dde2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:47.454619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ba3e5-29c7-4866-894f-4875c2b9dde2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:47.463446 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677aea97-75cd-46d9-9e4d-17b3f08a030c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:47.464161 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677aea97-75cd-46d9-9e4d-17b3f08a030c service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:47.464444 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677aea97-75cd-46d9-9e4d-17b3f08a030c service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:47.464723 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677aea97-75cd-46d9-9e4d-17b3f08a030c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:47.474298 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677aea97-75cd-46d9-9e4d-17b3f08a030c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:47.475762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677aea97-75cd-46d9-9e4d-17b3f08a030c service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:47.487029 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1201/2407] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:46:47.933297 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eee19e-360f-4109-b64f-3981194d7012 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:47.935113 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-52eee19e-360f-4109-b64f-3981194d7012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:47.950842 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eee19e-360f-4109-b64f-3981194d7012 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:47.955993 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a43f5-8a86-483c-b92e-b0d8d7783fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:47.956941 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a43f5-8a86-483c-b92e-b0d8d7783fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:47.957230 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a43f5-8a86-483c-b92e-b0d8d7783fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:47.957507 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a43f5-8a86-483c-b92e-b0d8d7783fde admin admin] PATH_INFO: `/v3/projects/9398375d818c4ef5be2518b514c5c8f5` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:47.958924 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a43f5-8a86-483c-b92e-b0d8d7783fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=9398375d818c4ef5be2518b514c5c8f5)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:47.961908 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a43f5-8a86-483c-b92e-b0d8d7783fde admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:48.040323 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-818a43f5-8a86-483c-b92e-b0d8d7783fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9398375d818c4ef5be2518b514c5c8f5', 'request_id': 'req-818a43f5-8a86-483c-b92e-b0d8d7783fde'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:48.047201 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-818a43f5-8a86-483c-b92e-b0d8d7783fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9398375d818c4ef5be2518b514c5c8f5', 'request_id': 'req-818a43f5-8a86-483c-b92e-b0d8d7783fde'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:48.053070 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-818a43f5-8a86-483c-b92e-b0d8d7783fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9398375d818c4ef5be2518b514c5c8f5', 'request_id': 'req-818a43f5-8a86-483c-b92e-b0d8d7783fde'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:48.080024 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-818a43f5-8a86-483c-b92e-b0d8d7783fde admin admin] The token cache is being invalidate because project 9398375d818c4ef5be2518b514c5c8f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:46:48.080897 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-818a43f5-8a86-483c-b92e-b0d8d7783fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:48.081781 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-818a43f5-8a86-483c-b92e-b0d8d7783fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:48.095029 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1207/2408] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:46:47 2022] DELETE /identity/v3/projects/9398375d818c4ef5be2518b514c5c8f5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:48.098801 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677aea97-75cd-46d9-9e4d-17b3f08a030c service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:48.111554 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677aea97-75cd-46d9-9e4d-17b3f08a030c service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:48.184025 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3464a8-4625-40d5-abb3-eebc6b818cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:48.185756 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3464a8-4625-40d5-abb3-eebc6b818cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:48.186272 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3464a8-4625-40d5-abb3-eebc6b818cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:48.186768 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3464a8-4625-40d5-abb3-eebc6b818cb2 admin admin] PATH_INFO: `/v3/users/89bd21de382f4d1fa06d2147771aca18` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:48.188296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3464a8-4625-40d5-abb3-eebc6b818cb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89bd21de382f4d1fa06d2147771aca18)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:48.191533 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3464a8-4625-40d5-abb3-eebc6b818cb2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:48.287301 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1a3464a8-4625-40d5-abb3-eebc6b818cb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89bd21de382f4d1fa06d2147771aca18'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:48.303443 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1a3464a8-4625-40d5-abb3-eebc6b818cb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89bd21de382f4d1fa06d2147771aca18'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:48.354175 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1a3464a8-4625-40d5-abb3-eebc6b818cb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89bd21de382f4d1fa06d2147771aca18'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:48.371838 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1a3464a8-4625-40d5-abb3-eebc6b818cb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89bd21de382f4d1fa06d2147771aca18'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:48.372594 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1a3464a8-4625-40d5-abb3-eebc6b818cb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89bd21de382f4d1fa06d2147771aca18'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:48.392485 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1202/2409] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:46:48 2022] DELETE /identity/v3/users/89bd21de382f4d1fa06d2147771aca18 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:48.746247 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a43f5-8a86-483c-b92e-b0d8d7783fde admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:48.747991 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-818a43f5-8a86-483c-b92e-b0d8d7783fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:48.772810 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a43f5-8a86-483c-b92e-b0d8d7783fde admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:48.865526 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231a0db-3394-4f46-a01b-75f33780db63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:48.866393 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231a0db-3394-4f46-a01b-75f33780db63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:48.866674 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231a0db-3394-4f46-a01b-75f33780db63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:48.867044 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231a0db-3394-4f46-a01b-75f33780db63 admin admin] PATH_INFO: `/v3/projects/974f048b161840d2b4dc51281bfecb86` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:48.869026 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231a0db-3394-4f46-a01b-75f33780db63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=974f048b161840d2b4dc51281bfecb86)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:48.872446 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231a0db-3394-4f46-a01b-75f33780db63 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:48.970572 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-8231a0db-3394-4f46-a01b-75f33780db63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '974f048b161840d2b4dc51281bfecb86', 'request_id': 'req-8231a0db-3394-4f46-a01b-75f33780db63'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:48.977610 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-8231a0db-3394-4f46-a01b-75f33780db63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '974f048b161840d2b4dc51281bfecb86', 'request_id': 'req-8231a0db-3394-4f46-a01b-75f33780db63'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:48.987970 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-8231a0db-3394-4f46-a01b-75f33780db63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '974f048b161840d2b4dc51281bfecb86', 'request_id': 'req-8231a0db-3394-4f46-a01b-75f33780db63'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:49.009079 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-8231a0db-3394-4f46-a01b-75f33780db63 admin admin] The token cache is being invalidate because project 974f048b161840d2b4dc51281bfecb86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:46:49.009408 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-8231a0db-3394-4f46-a01b-75f33780db63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:49.010021 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-8231a0db-3394-4f46-a01b-75f33780db63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:49.016354 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1208/2410] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:46:48 2022] DELETE /identity/v3/projects/974f048b161840d2b4dc51281bfecb86 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:49.017599 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3464a8-4625-40d5-abb3-eebc6b818cb2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:49.019805 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1a3464a8-4625-40d5-abb3-eebc6b818cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:49.034005 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3464a8-4625-40d5-abb3-eebc6b818cb2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:49.094386 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5e486-08a3-474e-83b7-ca3b430c5578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:49.095247 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5e486-08a3-474e-83b7-ca3b430c5578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:49.095363 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5e486-08a3-474e-83b7-ca3b430c5578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:49.095638 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5e486-08a3-474e-83b7-ca3b430c5578 admin admin] PATH_INFO: `/v3/users/c52831ec41cd40afaba90e6b7364dd49` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:49.100706 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5e486-08a3-474e-83b7-ca3b430c5578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c52831ec41cd40afaba90e6b7364dd49)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:49.106071 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5e486-08a3-474e-83b7-ca3b430c5578 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:49.154605 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2cb5e486-08a3-474e-83b7-ca3b430c5578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c52831ec41cd40afaba90e6b7364dd49'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:49.161943 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2cb5e486-08a3-474e-83b7-ca3b430c5578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c52831ec41cd40afaba90e6b7364dd49'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:49.175630 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2cb5e486-08a3-474e-83b7-ca3b430c5578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c52831ec41cd40afaba90e6b7364dd49'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:49.185496 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2cb5e486-08a3-474e-83b7-ca3b430c5578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c52831ec41cd40afaba90e6b7364dd49'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:49.187012 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2cb5e486-08a3-474e-83b7-ca3b430c5578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c52831ec41cd40afaba90e6b7364dd49'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:49.200256 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1203/2411] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:46:49 2022] DELETE /identity/v3/users/c52831ec41cd40afaba90e6b7364dd49 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:46:49.591398 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231a0db-3394-4f46-a01b-75f33780db63 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:46:49.592986 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-8231a0db-3394-4f46-a01b-75f33780db63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:46:49.607089 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231a0db-3394-4f46-a01b-75f33780db63 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:46:49.691048 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065df2a-c387-4235-ba41-f8e2ac825059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:46:49.691852 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065df2a-c387-4235-ba41-f8e2ac825059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:46:49.692135 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065df2a-c387-4235-ba41-f8e2ac825059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:46:49.692410 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065df2a-c387-4235-ba41-f8e2ac825059 admin admin] PATH_INFO: `/v3/projects/c0a9cf489d1341d78fa4b62c7d9d2744` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:46:49.693605 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065df2a-c387-4235-ba41-f8e2ac825059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0a9cf489d1341d78fa4b62c7d9d2744)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:46:49.695708 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065df2a-c387-4235-ba41-f8e2ac825059 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:46:49.749646 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-2065df2a-c387-4235-ba41-f8e2ac825059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a9cf489d1341d78fa4b62c7d9d2744', 'request_id': 'req-2065df2a-c387-4235-ba41-f8e2ac825059'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:49.755996 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-2065df2a-c387-4235-ba41-f8e2ac825059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a9cf489d1341d78fa4b62c7d9d2744', 'request_id': 'req-2065df2a-c387-4235-ba41-f8e2ac825059'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:49.761338 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-2065df2a-c387-4235-ba41-f8e2ac825059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a9cf489d1341d78fa4b62c7d9d2744', 'request_id': 'req-2065df2a-c387-4235-ba41-f8e2ac825059'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:49.779320 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-2065df2a-c387-4235-ba41-f8e2ac825059 admin admin] The token cache is being invalidate because project c0a9cf489d1341d78fa4b62c7d9d2744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:46:49.779646 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-2065df2a-c387-4235-ba41-f8e2ac825059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:49.780526 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-2065df2a-c387-4235-ba41-f8e2ac825059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:46:49.782201 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1209/2412] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:46:49 2022] DELETE /identity/v3/projects/c0a9cf489d1341d78fa4b62c7d9d2744 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:04.031817 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5e486-08a3-474e-83b7-ca3b430c5578 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:04.033910 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2cb5e486-08a3-474e-83b7-ca3b430c5578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:04.092065 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5e486-08a3-474e-83b7-ca3b430c5578 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:04.142295 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bbd1b-2eaf-4c45-8198-5bb2062768eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:04.143031 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bbd1b-2eaf-4c45-8198-5bb2062768eb service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:04.143386 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bbd1b-2eaf-4c45-8198-5bb2062768eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:04.143725 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bbd1b-2eaf-4c45-8198-5bb2062768eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:04.146017 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-319bbd1b-2eaf-4c45-8198-5bb2062768eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:04.156253 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bbd1b-2eaf-4c45-8198-5bb2062768eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:04.157933 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bbd1b-2eaf-4c45-8198-5bb2062768eb service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:04.167736 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1204/2413] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:47:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:47:04.325309 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a32b1c-7241-4a39-9136-3afdf81f334b None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:04.325309 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a32b1c-7241-4a39-9136-3afdf81f334b None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:04.325309 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a32b1c-7241-4a39-9136-3afdf81f334b None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:04.327345 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1210/2414] 10.222.0.35 () {54 vars in 921 bytes} [Tue Feb 8 16:47:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:47:04.335003 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe3a83-c2e6-4b03-89da-723c0d467a04 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:04.336215 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe3a83-c2e6-4b03-89da-723c0d467a04 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:04.336840 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe3a83-c2e6-4b03-89da-723c0d467a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:04.388296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-21fe3a83-c2e6-4b03-89da-723c0d467a04 None None] MFA Rules not processed for user `ccb02e5d8ef14f8f85bbacfa5b1f5be3`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:04.391479 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-21fe3a83-c2e6-4b03-89da-723c0d467a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:04.448221 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a32b1c-7241-4a39-9136-3afdf81f334b None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:04.451211 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-33a32b1c-7241-4a39-9136-3afdf81f334b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:04.506146 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1205/2415] 10.222.0.35 () {58 vars in 1018 bytes} [Tue Feb 8 16:47:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:47:04.518126 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe3a83-c2e6-4b03-89da-723c0d467a04 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:04.519550 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-21fe3a83-c2e6-4b03-89da-723c0d467a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:04.551242 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a32b1c-7241-4a39-9136-3afdf81f334b None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:04.558315 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4a4ab-7f9f-4743-a02a-fe479ab3480b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:04.559352 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4a4ab-7f9f-4743-a02a-fe479ab3480b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:04.559643 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4a4ab-7f9f-4743-a02a-fe479ab3480b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:04.559949 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4a4ab-7f9f-4743-a02a-fe479ab3480b admin admin] PATH_INFO: `/v3/users/a5eff85a200a4a599e0cefe8d681d72d` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:04.561172 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4a4ab-7f9f-4743-a02a-fe479ab3480b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5eff85a200a4a599e0cefe8d681d72d)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:04.564277 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4a4ab-7f9f-4743-a02a-fe479ab3480b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:04.581751 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe3a83-c2e6-4b03-89da-723c0d467a04 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:04.587847 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ee82f-bcea-4a2d-8d41-354370356f55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10453496872a45a9867fc6a13a13de49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:04.588508 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ee82f-bcea-4a2d-8d41-354370356f55 service glance] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:04.588788 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ee82f-bcea-4a2d-8d41-354370356f55 service glance] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:04.589061 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ee82f-bcea-4a2d-8d41-354370356f55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:04.604874 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ee82f-bcea-4a2d-8d41-354370356f55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:04.606371 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ee82f-bcea-4a2d-8d41-354370356f55 service glance] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:04.620863 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1206/2416] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:47:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:47:04.622678 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ee82f-bcea-4a2d-8d41-354370356f55 service glance] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:04.622973 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f41ee82f-bcea-4a2d-8d41-354370356f55 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:04.623485 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a3b4a4ab-7f9f-4743-a02a-fe479ab3480b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5eff85a200a4a599e0cefe8d681d72d'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:04.638679 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ee82f-bcea-4a2d-8d41-354370356f55 service glance] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:04.638897 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a3b4a4ab-7f9f-4743-a02a-fe479ab3480b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5eff85a200a4a599e0cefe8d681d72d'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:04.645244 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5bdb3-68bc-4117-94fb-7ca6d7b71b8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:04.646079 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5bdb3-68bc-4117-94fb-7ca6d7b71b8c service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:04.646382 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5bdb3-68bc-4117-94fb-7ca6d7b71b8c service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:04.646848 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5bdb3-68bc-4117-94fb-7ca6d7b71b8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:04.646988 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a3b4a4ab-7f9f-4743-a02a-fe479ab3480b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5eff85a200a4a599e0cefe8d681d72d'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:04.653523 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7ec5bdb3-68bc-4117-94fb-7ca6d7b71b8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:04.659132 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a3b4a4ab-7f9f-4743-a02a-fe479ab3480b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5eff85a200a4a599e0cefe8d681d72d'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:04.660195 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a3b4a4ab-7f9f-4743-a02a-fe479ab3480b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5eff85a200a4a599e0cefe8d681d72d'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:04.668950 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1211/2417] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:47:04 2022] DELETE /identity/v3/users/a5eff85a200a4a599e0cefe8d681d72d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:47:04.684739 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5bdb3-68bc-4117-94fb-7ca6d7b71b8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:04.686704 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5bdb3-68bc-4117-94fb-7ca6d7b71b8c service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:04.698505 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1207/2418] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:47:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:47:04.710055 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644ef60-14ce-4ef1-ad8a-ca79382fb23e None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:04.711309 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644ef60-14ce-4ef1-ad8a-ca79382fb23e None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:04.711686 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644ef60-14ce-4ef1-ad8a-ca79382fb23e None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:04.713857 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1212/2419] 10.222.0.35 () {54 vars in 921 bytes} [Tue Feb 8 16:47:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:47:04.719216 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c0a38-ecfc-4081-90aa-682319a6737d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:04.719515 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c0a38-ecfc-4081-90aa-682319a6737d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:04.719935 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c0a38-ecfc-4081-90aa-682319a6737d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:04.742574 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-185c0a38-ecfc-4081-90aa-682319a6737d None None] MFA Rules not processed for user `0b936dc9a67846f08e51648e64c3d6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:04.744012 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-185c0a38-ecfc-4081-90aa-682319a6737d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:04.816767 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1208/2420] 10.222.0.35 () {58 vars in 1018 bytes} [Tue Feb 8 16:47:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:04.832925 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644ef60-14ce-4ef1-ad8a-ca79382fb23e None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:04.836137 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-7644ef60-14ce-4ef1-ad8a-ca79382fb23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:04.870843 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644ef60-14ce-4ef1-ad8a-ca79382fb23e None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:04.871048 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c0a38-ecfc-4081-90aa-682319a6737d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:04.872485 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-185c0a38-ecfc-4081-90aa-682319a6737d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:04.875263 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e85969-a683-4248-91fc-2a91c8e1301b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:04.876132 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e85969-a683-4248-91fc-2a91c8e1301b service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:04.876572 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e85969-a683-4248-91fc-2a91c8e1301b service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:04.877287 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e85969-a683-4248-91fc-2a91c8e1301b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:04.891312 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e85969-a683-4248-91fc-2a91c8e1301b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:04.892817 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e85969-a683-4248-91fc-2a91c8e1301b service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:04.904323 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1213/2421] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:47:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:47:04.971483 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c0a38-ecfc-4081-90aa-682319a6737d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:04.983855 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459b086-afa8-4ebc-85b3-cb675ede791b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:04.984820 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459b086-afa8-4ebc-85b3-cb675ede791b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:04.985092 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459b086-afa8-4ebc-85b3-cb675ede791b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:04.985359 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459b086-afa8-4ebc-85b3-cb675ede791b admin admin] PATH_INFO: `/v3/projects/3b57fcb90a594af1b70daaecbf9efd96` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:04.986563 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459b086-afa8-4ebc-85b3-cb675ede791b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b57fcb90a594af1b70daaecbf9efd96)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:04.988509 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459b086-afa8-4ebc-85b3-cb675ede791b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:05.045693 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2459b086-afa8-4ebc-85b3-cb675ede791b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b57fcb90a594af1b70daaecbf9efd96', 'request_id': 'req-2459b086-afa8-4ebc-85b3-cb675ede791b'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:05.053061 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2459b086-afa8-4ebc-85b3-cb675ede791b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b57fcb90a594af1b70daaecbf9efd96', 'request_id': 'req-2459b086-afa8-4ebc-85b3-cb675ede791b'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:05.060113 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2459b086-afa8-4ebc-85b3-cb675ede791b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b57fcb90a594af1b70daaecbf9efd96', 'request_id': 'req-2459b086-afa8-4ebc-85b3-cb675ede791b'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:05.076499 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2459b086-afa8-4ebc-85b3-cb675ede791b admin admin] The token cache is being invalidate because project 3b57fcb90a594af1b70daaecbf9efd96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:47:05.076795 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2459b086-afa8-4ebc-85b3-cb675ede791b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:05.078312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2459b086-afa8-4ebc-85b3-cb675ede791b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:05.080303 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1209/2422] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:47:04 2022] DELETE /identity/v3/projects/3b57fcb90a594af1b70daaecbf9efd96 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:47:05.087161 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c4309-ddd5-44b1-84f0-0c02c75b147c None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:05.087479 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c4309-ddd5-44b1-84f0-0c02c75b147c None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:05.087926 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c4309-ddd5-44b1-84f0-0c02c75b147c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:05.120335 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-cb8c4309-ddd5-44b1-84f0-0c02c75b147c None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:05.121726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-cb8c4309-ddd5-44b1-84f0-0c02c75b147c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:05.189054 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1214/2423] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:47:05.197670 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd718c5d-2ea5-4e55-a642-430689d23cdd None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:05.197961 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd718c5d-2ea5-4e55-a642-430689d23cdd None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:05.198243 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd718c5d-2ea5-4e55-a642-430689d23cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:05.216585 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-dd718c5d-2ea5-4e55-a642-430689d23cdd None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:05.217853 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-dd718c5d-2ea5-4e55-a642-430689d23cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:05.226464 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1210/2424] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:47:05.231280 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c4309-ddd5-44b1-84f0-0c02c75b147c None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:05.246630 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c4309-ddd5-44b1-84f0-0c02c75b147c None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:05.254954 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5d89f-9e71-401f-9b49-ea96a207ed1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:05.256096 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5d89f-9e71-401f-9b49-ea96a207ed1c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:05.256643 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5d89f-9e71-401f-9b49-ea96a207ed1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:05.257205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5d89f-9e71-401f-9b49-ea96a207ed1c admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:05.259140 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5d89f-9e71-401f-9b49-ea96a207ed1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:47:05.259693 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5d89f-9e71-401f-9b49-ea96a207ed1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:05.262679 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5d89f-9e71-401f-9b49-ea96a207ed1c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:05.284273 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1215/2425] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:47:05.288412 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd718c5d-2ea5-4e55-a642-430689d23cdd None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:05.297431 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd718c5d-2ea5-4e55-a642-430689d23cdd None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:05.302058 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2647d-e5c9-4608-a501-bdaf10d26b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:05.302678 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2647d-e5c9-4608-a501-bdaf10d26b90 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:05.302992 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2647d-e5c9-4608-a501-bdaf10d26b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:05.303264 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2647d-e5c9-4608-a501-bdaf10d26b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:05.304482 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2647d-e5c9-4608-a501-bdaf10d26b90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:05.306389 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2647d-e5c9-4608-a501-bdaf10d26b90 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:05.333856 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1211/2426] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:47:05 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:47:05.338110 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5d89f-9e71-401f-9b49-ea96a207ed1c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:05.356818 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5d89f-9e71-401f-9b49-ea96a207ed1c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:05.414500 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446c4e2-991f-442e-ae27-20497c53d513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:05.415076 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446c4e2-991f-442e-ae27-20497c53d513 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:05.415361 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446c4e2-991f-442e-ae27-20497c53d513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:05.415640 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446c4e2-991f-442e-ae27-20497c53d513 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:05.416385 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446c4e2-991f-442e-ae27-20497c53d513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:05.418312 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446c4e2-991f-442e-ae27-20497c53d513 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:05.440329 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1216/2427] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:47:05 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:47:05.444242 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2647d-e5c9-4608-a501-bdaf10d26b90 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:05.456373 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2647d-e5c9-4608-a501-bdaf10d26b90 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:05.461139 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981de80-4375-4a0c-8f23-28c7f166a409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:05.461811 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981de80-4375-4a0c-8f23-28c7f166a409 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:05.462094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981de80-4375-4a0c-8f23-28c7f166a409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:05.462383 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981de80-4375-4a0c-8f23-28c7f166a409 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:05.463120 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981de80-4375-4a0c-8f23-28c7f166a409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:05.464726 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981de80-4375-4a0c-8f23-28c7f166a409 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:05.477632 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1212/2428] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:47:05.479734 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446c4e2-991f-442e-ae27-20497c53d513 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:05.489466 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446c4e2-991f-442e-ae27-20497c53d513 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:05.494934 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d686c7d-34f0-4a79-abb1-41bb598eff79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:05.495673 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d686c7d-34f0-4a79-abb1-41bb598eff79 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:05.496159 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d686c7d-34f0-4a79-abb1-41bb598eff79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:05.496491 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d686c7d-34f0-4a79-abb1-41bb598eff79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:05.497288 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d686c7d-34f0-4a79-abb1-41bb598eff79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:05.498909 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d686c7d-34f0-4a79-abb1-41bb598eff79 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:05.509614 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1217/2429] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:47:05.514035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981de80-4375-4a0c-8f23-28c7f166a409 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:05.524515 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981de80-4375-4a0c-8f23-28c7f166a409 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:05.529319 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8809d3-2f34-4119-8af5-c7944d3b62bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:05.530215 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8809d3-2f34-4119-8af5-c7944d3b62bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:05.530493 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8809d3-2f34-4119-8af5-c7944d3b62bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:05.530762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8809d3-2f34-4119-8af5-c7944d3b62bc admin admin] PATH_INFO: `/v3/projects/47bb2f1ebc3744fa99b3e04388b2544a/users/b16f573989834743be7055655959981c/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:05.545748 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8809d3-2f34-4119-8af5-c7944d3b62bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=47bb2f1ebc3744fa99b3e04388b2544a, user_id=b16f573989834743be7055655959981c, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:05.548410 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8809d3-2f34-4119-8af5-c7944d3b62bc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:05.564348 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1213/2430] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:47:05 2022] PUT /identity/v3/projects/47bb2f1ebc3744fa99b3e04388b2544a/users/b16f573989834743be7055655959981c/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:05.574742 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765f9ef-5b94-460a-8079-54044e1dee4c None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:05.575024 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765f9ef-5b94-460a-8079-54044e1dee4c None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:05.575300 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765f9ef-5b94-460a-8079-54044e1dee4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:05.602417 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-1765f9ef-5b94-460a-8079-54044e1dee4c None None] MFA Rules not processed for user `b16f573989834743be7055655959981c`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:05.603671 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-1765f9ef-5b94-460a-8079-54044e1dee4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:05.666888 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1218/2431] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:05.678578 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8809d3-2f34-4119-8af5-c7944d3b62bc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:05.680990 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4d8809d3-2f34-4119-8af5-c7944d3b62bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:05.737239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8809d3-2f34-4119-8af5-c7944d3b62bc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:05.741121 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf5742-8126-4af8-a10b-e54b99ea26b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:05.741768 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf5742-8126-4af8-a10b-e54b99ea26b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:05.742049 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf5742-8126-4af8-a10b-e54b99ea26b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:05.742320 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf5742-8126-4af8-a10b-e54b99ea26b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:05.750969 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf5742-8126-4af8-a10b-e54b99ea26b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:05.752744 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf5742-8126-4af8-a10b-e54b99ea26b1 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:05.763874 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1214/2432] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:47:05 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:47:06.373445 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765f9ef-5b94-460a-8079-54044e1dee4c None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:06.376687 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-1765f9ef-5b94-460a-8079-54044e1dee4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:06.477072 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765f9ef-5b94-460a-8079-54044e1dee4c None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:06.479526 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86375e68-adac-4e4b-bbfa-c7d0e40a70c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:06.480527 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86375e68-adac-4e4b-bbfa-c7d0e40a70c1 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:06.480934 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86375e68-adac-4e4b-bbfa-c7d0e40a70c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:06.481321 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86375e68-adac-4e4b-bbfa-c7d0e40a70c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:06.483373 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-86375e68-adac-4e4b-bbfa-c7d0e40a70c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:06.498264 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86375e68-adac-4e4b-bbfa-c7d0e40a70c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:06.499908 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86375e68-adac-4e4b-bbfa-c7d0e40a70c1 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:06.511077 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1219/2433] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:47:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:47:07.634884 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5c38-d389-4f2c-843d-be50e992cc3b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:07.635366 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5c38-d389-4f2c-843d-be50e992cc3b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:07.635483 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5c38-d389-4f2c-843d-be50e992cc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:07.652712 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-04ba5c38-d389-4f2c-843d-be50e992cc3b None None] MFA Rules not processed for user `9761863f36284bd4be1ce29c86b631cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:07.653909 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-04ba5c38-d389-4f2c-843d-be50e992cc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:07.721377 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1215/2434] 10.222.0.35 () {58 vars in 1009 bytes} [Tue Feb 8 16:47:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:07.735829 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86375e68-adac-4e4b-bbfa-c7d0e40a70c1 service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:07.737003 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-86375e68-adac-4e4b-bbfa-c7d0e40a70c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:07.804785 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86375e68-adac-4e4b-bbfa-c7d0e40a70c1 service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:07.809674 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105d6c1-0396-43f3-a16a-4e4309fe209a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00fd3c05cd8e4167946a1f567df2cc6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:07.810308 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105d6c1-0396-43f3-a16a-4e4309fe209a service swift] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:07.810592 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105d6c1-0396-43f3-a16a-4e4309fe209a service swift] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:07.810867 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105d6c1-0396-43f3-a16a-4e4309fe209a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:07.818682 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105d6c1-0396-43f3-a16a-4e4309fe209a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:07.820909 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105d6c1-0396-43f3-a16a-4e4309fe209a service swift] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:07.828695 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1220/2435] 10.222.0.35 () {60 vars in 1384 bytes} [Tue Feb 8 16:47:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:47:20.557753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba5c38-d389-4f2c-843d-be50e992cc3b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:20.620992 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba5c38-d389-4f2c-843d-be50e992cc3b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:20.625525 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258db17-3119-4c86-9e1a-5c2e51f23ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:20.626383 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258db17-3119-4c86-9e1a-5c2e51f23ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:20.626911 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258db17-3119-4c86-9e1a-5c2e51f23ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:20.627197 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258db17-3119-4c86-9e1a-5c2e51f23ed6 admin admin] PATH_INFO: `/v3/users/b16f573989834743be7055655959981c` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:20.628414 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258db17-3119-4c86-9e1a-5c2e51f23ed6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16f573989834743be7055655959981c)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:20.630336 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258db17-3119-4c86-9e1a-5c2e51f23ed6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:20.686442 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3258db17-3119-4c86-9e1a-5c2e51f23ed6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16f573989834743be7055655959981c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:20.702994 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3258db17-3119-4c86-9e1a-5c2e51f23ed6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16f573989834743be7055655959981c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:20.721735 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3258db17-3119-4c86-9e1a-5c2e51f23ed6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16f573989834743be7055655959981c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:20.730063 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3258db17-3119-4c86-9e1a-5c2e51f23ed6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16f573989834743be7055655959981c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:20.730769 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3258db17-3119-4c86-9e1a-5c2e51f23ed6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16f573989834743be7055655959981c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:20.739274 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1216/2436] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:47:20 2022] DELETE /identity/v3/users/b16f573989834743be7055655959981c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:20.742280 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253280da-d4ab-4534-8412-06a20fb14d64 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:20.743138 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253280da-d4ab-4534-8412-06a20fb14d64 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:20.743308 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253280da-d4ab-4534-8412-06a20fb14d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:20.765019 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-253280da-d4ab-4534-8412-06a20fb14d64 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:20.766952 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-253280da-d4ab-4534-8412-06a20fb14d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:20.829739 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1221/2437] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:20.840133 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258db17-3119-4c86-9e1a-5c2e51f23ed6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:20.841556 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3258db17-3119-4c86-9e1a-5c2e51f23ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:20.897533 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258db17-3119-4c86-9e1a-5c2e51f23ed6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:20.901995 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65cca7-6a0c-4ca6-90ad-23c38e23bf0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:20.902636 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65cca7-6a0c-4ca6-90ad-23c38e23bf0c service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:20.902914 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65cca7-6a0c-4ca6-90ad-23c38e23bf0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:20.903185 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65cca7-6a0c-4ca6-90ad-23c38e23bf0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:20.912336 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65cca7-6a0c-4ca6-90ad-23c38e23bf0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:20.914975 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65cca7-6a0c-4ca6-90ad-23c38e23bf0c service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:20.924927 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1217/2438] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:47:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:47:21.422117 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253280da-d4ab-4534-8412-06a20fb14d64 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:21.424260 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-253280da-d4ab-4534-8412-06a20fb14d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:21.449509 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253280da-d4ab-4534-8412-06a20fb14d64 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:21.454793 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2dfaa5-5d02-42cc-a20e-089a77d94e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:21.456128 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dfaa5-5d02-42cc-a20e-089a77d94e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:21.456547 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dfaa5-5d02-42cc-a20e-089a77d94e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:21.456905 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dfaa5-5d02-42cc-a20e-089a77d94e8d admin admin] PATH_INFO: `/v3/projects/47bb2f1ebc3744fa99b3e04388b2544a` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:21.458360 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2dfaa5-5d02-42cc-a20e-089a77d94e8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=47bb2f1ebc3744fa99b3e04388b2544a)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:21.461021 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2dfaa5-5d02-42cc-a20e-089a77d94e8d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:21.512554 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-8c2dfaa5-5d02-42cc-a20e-089a77d94e8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47bb2f1ebc3744fa99b3e04388b2544a', 'request_id': 'req-8c2dfaa5-5d02-42cc-a20e-089a77d94e8d'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:21.518773 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-8c2dfaa5-5d02-42cc-a20e-089a77d94e8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47bb2f1ebc3744fa99b3e04388b2544a', 'request_id': 'req-8c2dfaa5-5d02-42cc-a20e-089a77d94e8d'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:21.524863 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-8c2dfaa5-5d02-42cc-a20e-089a77d94e8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47bb2f1ebc3744fa99b3e04388b2544a', 'request_id': 'req-8c2dfaa5-5d02-42cc-a20e-089a77d94e8d'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:21.538189 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-8c2dfaa5-5d02-42cc-a20e-089a77d94e8d admin admin] The token cache is being invalidate because project 47bb2f1ebc3744fa99b3e04388b2544a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:47:21.540048 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-8c2dfaa5-5d02-42cc-a20e-089a77d94e8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:21.544060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-8c2dfaa5-5d02-42cc-a20e-089a77d94e8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:21.548192 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1222/2439] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:47:21 2022] DELETE /identity/v3/projects/47bb2f1ebc3744fa99b3e04388b2544a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:21.552040 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa33b95-823e-40f2-b0cb-25f4780e6a6d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:21.552601 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa33b95-823e-40f2-b0cb-25f4780e6a6d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:21.553122 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa33b95-823e-40f2-b0cb-25f4780e6a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:21.579875 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-9fa33b95-823e-40f2-b0cb-25f4780e6a6d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:21.583263 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9fa33b95-823e-40f2-b0cb-25f4780e6a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:21.659265 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1218/2440] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:47:21.668668 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb212dd-f679-490d-ad1c-679e111e5fc7 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:21.668966 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb212dd-f679-490d-ad1c-679e111e5fc7 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:21.669402 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb212dd-f679-490d-ad1c-679e111e5fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:21.688722 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-4cb212dd-f679-490d-ad1c-679e111e5fc7 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:21.689935 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-4cb212dd-f679-490d-ad1c-679e111e5fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:21.699029 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1223/2441] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:21.703286 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa33b95-823e-40f2-b0cb-25f4780e6a6d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:21.714527 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa33b95-823e-40f2-b0cb-25f4780e6a6d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:21.719407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf32a34-4dc5-451e-a8f3-d1982a699624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:21.720176 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf32a34-4dc5-451e-a8f3-d1982a699624 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:21.720530 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf32a34-4dc5-451e-a8f3-d1982a699624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:21.720875 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf32a34-4dc5-451e-a8f3-d1982a699624 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:21.721688 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf32a34-4dc5-451e-a8f3-d1982a699624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:47:21.722069 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf32a34-4dc5-451e-a8f3-d1982a699624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:21.723735 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf32a34-4dc5-451e-a8f3-d1982a699624 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:21.736805 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1219/2442] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:47:21.741333 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb212dd-f679-490d-ad1c-679e111e5fc7 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:21.752357 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb212dd-f679-490d-ad1c-679e111e5fc7 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:21.757101 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fea22f-bf7c-4b3c-95bf-39b4778383e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:21.757822 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fea22f-bf7c-4b3c-95bf-39b4778383e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:21.758109 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fea22f-bf7c-4b3c-95bf-39b4778383e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:21.758384 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fea22f-bf7c-4b3c-95bf-39b4778383e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:21.759105 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fea22f-bf7c-4b3c-95bf-39b4778383e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:21.761035 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fea22f-bf7c-4b3c-95bf-39b4778383e0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:21.786055 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1224/2443] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:47:21 2022] POST /identity/v3/projects => generated 405 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:47:21.790709 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf32a34-4dc5-451e-a8f3-d1982a699624 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:21.800590 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf32a34-4dc5-451e-a8f3-d1982a699624 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:21.857213 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c5d7e-0726-477a-b790-1da95e24e27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:21.858024 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c5d7e-0726-477a-b790-1da95e24e27c admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:21.858392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c5d7e-0726-477a-b790-1da95e24e27c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:21.858739 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c5d7e-0726-477a-b790-1da95e24e27c admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:21.859509 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c5d7e-0726-477a-b790-1da95e24e27c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:21.861531 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c5d7e-0726-477a-b790-1da95e24e27c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:21.886711 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1220/2444] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:47:21 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:47:21.888071 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fea22f-bf7c-4b3c-95bf-39b4778383e0 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:21.899433 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fea22f-bf7c-4b3c-95bf-39b4778383e0 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:21.904145 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3550a-d366-4959-95ce-cbd1f3f13569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:21.904802 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3550a-d366-4959-95ce-cbd1f3f13569 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:21.905124 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3550a-d366-4959-95ce-cbd1f3f13569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:21.905408 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3550a-d366-4959-95ce-cbd1f3f13569 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:21.906152 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3550a-d366-4959-95ce-cbd1f3f13569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:21.907738 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3550a-d366-4959-95ce-cbd1f3f13569 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:21.919558 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1225/2445] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:47:21.923511 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c5d7e-0726-477a-b790-1da95e24e27c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:21.934684 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c5d7e-0726-477a-b790-1da95e24e27c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:21.939506 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec5153-d9c9-4ade-8fb5-75a56a131733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:21.940210 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec5153-d9c9-4ade-8fb5-75a56a131733 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:21.940493 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec5153-d9c9-4ade-8fb5-75a56a131733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:21.940767 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec5153-d9c9-4ade-8fb5-75a56a131733 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:21.941535 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec5153-d9c9-4ade-8fb5-75a56a131733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:21.943120 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec5153-d9c9-4ade-8fb5-75a56a131733 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:21.953561 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1221/2446] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:47:21.957816 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3550a-d366-4959-95ce-cbd1f3f13569 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:21.968470 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3550a-d366-4959-95ce-cbd1f3f13569 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:21.975041 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac065d4f-95c2-41ad-b129-f466809cec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:21.976590 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac065d4f-95c2-41ad-b129-f466809cec7d admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:21.977061 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac065d4f-95c2-41ad-b129-f466809cec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:21.977494 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac065d4f-95c2-41ad-b129-f466809cec7d admin admin] PATH_INFO: `/v3/projects/8f67f20d253a4da18210be90efa5daee/users/17d235c24dfa4c959a2f1376ed780764/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:21.993702 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac065d4f-95c2-41ad-b129-f466809cec7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f67f20d253a4da18210be90efa5daee, user_id=17d235c24dfa4c959a2f1376ed780764, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:21.996391 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac065d4f-95c2-41ad-b129-f466809cec7d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:22.010660 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1226/2447] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:47:21 2022] PUT /identity/v3/projects/8f67f20d253a4da18210be90efa5daee/users/17d235c24dfa4c959a2f1376ed780764/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:22.016830 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bf9f2-ae99-4e7e-97af-a32d2a8ddd52 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:22.017361 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bf9f2-ae99-4e7e-97af-a32d2a8ddd52 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:22.017860 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bf9f2-ae99-4e7e-97af-a32d2a8ddd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:22.040862 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ca0bf9f2-ae99-4e7e-97af-a32d2a8ddd52 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:22.041993 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ca0bf9f2-ae99-4e7e-97af-a32d2a8ddd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:22.099340 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1222/2448] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:22.110457 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac065d4f-95c2-41ad-b129-f466809cec7d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:22.112163 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-ac065d4f-95c2-41ad-b129-f466809cec7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:22.166567 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac065d4f-95c2-41ad-b129-f466809cec7d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:22.170178 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb3743-96a2-407f-9959-3ca656e37694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:22.170802 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb3743-96a2-407f-9959-3ca656e37694 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:22.171079 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb3743-96a2-407f-9959-3ca656e37694 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:22.171350 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb3743-96a2-407f-9959-3ca656e37694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:22.180668 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb3743-96a2-407f-9959-3ca656e37694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:22.182133 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb3743-96a2-407f-9959-3ca656e37694 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:22.192477 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1227/2449] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:47:23.105044 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1890243-a6e4-4ff0-9043-1fbf9f70ec1a None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:23.105520 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1890243-a6e4-4ff0-9043-1fbf9f70ec1a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:23.105624 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1890243-a6e4-4ff0-9043-1fbf9f70ec1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:23.133485 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d1890243-a6e4-4ff0-9043-1fbf9f70ec1a None None] MFA Rules not processed for user `17d235c24dfa4c959a2f1376ed780764`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:23.134713 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d1890243-a6e4-4ff0-9043-1fbf9f70ec1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:23.199103 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1223/2450] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:23 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:23.203779 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb3743-96a2-407f-9959-3ca656e37694 service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:23.213341 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb3743-96a2-407f-9959-3ca656e37694 service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:23.217858 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b056c-4922-4e12-a9f3-b0d2794e8197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:23.218497 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b056c-4922-4e12-a9f3-b0d2794e8197 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:23.218781 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b056c-4922-4e12-a9f3-b0d2794e8197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:23.219059 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b056c-4922-4e12-a9f3-b0d2794e8197 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:23.219799 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b056c-4922-4e12-a9f3-b0d2794e8197 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:23.221679 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b056c-4922-4e12-a9f3-b0d2794e8197 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:23.250649 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1228/2451] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:47:23 2022] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:47:23.252031 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1890243-a6e4-4ff0-9043-1fbf9f70ec1a None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:23.263944 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1890243-a6e4-4ff0-9043-1fbf9f70ec1a None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:23.321253 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cdd9b-b573-44a6-8e67-34027790100c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:23.321988 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cdd9b-b573-44a6-8e67-34027790100c admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:23.322268 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cdd9b-b573-44a6-8e67-34027790100c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:23.322538 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cdd9b-b573-44a6-8e67-34027790100c admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:23.323241 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cdd9b-b573-44a6-8e67-34027790100c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:23.325209 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cdd9b-b573-44a6-8e67-34027790100c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:23.346361 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1224/2452] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:47:23 2022] POST /identity/v3/users => generated 309 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:47:23.350274 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b056c-4922-4e12-a9f3-b0d2794e8197 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:23.360544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b056c-4922-4e12-a9f3-b0d2794e8197 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:23.365451 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60ef4e-083a-404f-9c3e-17947286ea83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:23.366094 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60ef4e-083a-404f-9c3e-17947286ea83 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:23.366378 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60ef4e-083a-404f-9c3e-17947286ea83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:23.366684 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60ef4e-083a-404f-9c3e-17947286ea83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:23.367422 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60ef4e-083a-404f-9c3e-17947286ea83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:23.369069 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60ef4e-083a-404f-9c3e-17947286ea83 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:23.379407 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1229/2453] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:47:23.383935 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cdd9b-b573-44a6-8e67-34027790100c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:23.393813 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cdd9b-b573-44a6-8e67-34027790100c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:23.399238 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd0069-c30b-4582-aa74-c71c721400b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:23.400120 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd0069-c30b-4582-aa74-c71c721400b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:23.400395 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd0069-c30b-4582-aa74-c71c721400b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:23.400662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd0069-c30b-4582-aa74-c71c721400b0 admin admin] PATH_INFO: `/v3/projects/2f76dece2d704b68a3bdbd49c8613bd2/users/962763800afd4776befa102359009b71/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:23.415523 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd0069-c30b-4582-aa74-c71c721400b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f76dece2d704b68a3bdbd49c8613bd2, user_id=962763800afd4776befa102359009b71, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:23.418208 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd0069-c30b-4582-aa74-c71c721400b0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:23.430979 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1225/2454] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:47:23 2022] PUT /identity/v3/projects/2f76dece2d704b68a3bdbd49c8613bd2/users/962763800afd4776befa102359009b71/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:23.434959 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60ef4e-083a-404f-9c3e-17947286ea83 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:23.445164 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60ef4e-083a-404f-9c3e-17947286ea83 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:23.498932 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee85e42-29c7-49e0-9154-f784d26ee6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:23.499579 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee85e42-29c7-49e0-9154-f784d26ee6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:23.499893 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee85e42-29c7-49e0-9154-f784d26ee6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:23.500170 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee85e42-29c7-49e0-9154-f784d26ee6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:23.500893 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee85e42-29c7-49e0-9154-f784d26ee6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:23.502718 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee85e42-29c7-49e0-9154-f784d26ee6c5 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:23.512596 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1230/2455] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:47:23.516719 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd0069-c30b-4582-aa74-c71c721400b0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:23.527277 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd0069-c30b-4582-aa74-c71c721400b0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:23.531914 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c01d3-1b11-4003-80bb-dc1f428eecde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:23.532776 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c01d3-1b11-4003-80bb-dc1f428eecde admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:23.533059 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c01d3-1b11-4003-80bb-dc1f428eecde admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:23.533336 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c01d3-1b11-4003-80bb-dc1f428eecde admin admin] PATH_INFO: `/v3/projects/2f76dece2d704b68a3bdbd49c8613bd2/users/962763800afd4776befa102359009b71/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:23.535301 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c01d3-1b11-4003-80bb-dc1f428eecde admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f76dece2d704b68a3bdbd49c8613bd2, user_id=962763800afd4776befa102359009b71, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:23.537962 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c01d3-1b11-4003-80bb-dc1f428eecde admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:23.548753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1226/2456] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:47:23 2022] PUT /identity/v3/projects/2f76dece2d704b68a3bdbd49c8613bd2/users/962763800afd4776befa102359009b71/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:24.238803 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116086e0-d952-43a1-b053-931195c95988 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:24.239311 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116086e0-d952-43a1-b053-931195c95988 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:24.239410 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116086e0-d952-43a1-b053-931195c95988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:24.266784 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-116086e0-d952-43a1-b053-931195c95988 None None] MFA Rules not processed for user `962763800afd4776befa102359009b71`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:24.268015 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-116086e0-d952-43a1-b053-931195c95988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:24.339238 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1231/2457] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:24 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:25.396762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c01d3-1b11-4003-80bb-dc1f428eecde admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:25.463637 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c01d3-1b11-4003-80bb-dc1f428eecde admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:25.468280 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938c9be-931c-4380-8f3c-dd0072c37a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:25.469134 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938c9be-931c-4380-8f3c-dd0072c37a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:25.469415 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938c9be-931c-4380-8f3c-dd0072c37a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:25.469688 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938c9be-931c-4380-8f3c-dd0072c37a92 admin admin] PATH_INFO: `/v3/users/17d235c24dfa4c959a2f1376ed780764` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:25.470882 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938c9be-931c-4380-8f3c-dd0072c37a92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d235c24dfa4c959a2f1376ed780764)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:25.472836 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938c9be-931c-4380-8f3c-dd0072c37a92 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:25.517581 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9938c9be-931c-4380-8f3c-dd0072c37a92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d235c24dfa4c959a2f1376ed780764'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:25.524715 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9938c9be-931c-4380-8f3c-dd0072c37a92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d235c24dfa4c959a2f1376ed780764'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:25.535879 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9938c9be-931c-4380-8f3c-dd0072c37a92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d235c24dfa4c959a2f1376ed780764'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:25.542820 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9938c9be-931c-4380-8f3c-dd0072c37a92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d235c24dfa4c959a2f1376ed780764'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:25.543462 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9938c9be-931c-4380-8f3c-dd0072c37a92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d235c24dfa4c959a2f1376ed780764'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:25.549121 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1227/2458] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:47:25 2022] DELETE /identity/v3/users/17d235c24dfa4c959a2f1376ed780764 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:25.722732 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116086e0-d952-43a1-b053-931195c95988 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:25.733302 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116086e0-d952-43a1-b053-931195c95988 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:25.789876 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90c962-c09f-43d0-b4cb-2120d33af950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:25.790723 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90c962-c09f-43d0-b4cb-2120d33af950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:25.791008 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90c962-c09f-43d0-b4cb-2120d33af950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:25.791285 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90c962-c09f-43d0-b4cb-2120d33af950 admin admin] PATH_INFO: `/v3/projects/8f67f20d253a4da18210be90efa5daee` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:25.792634 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90c962-c09f-43d0-b4cb-2120d33af950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f67f20d253a4da18210be90efa5daee)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:25.794521 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90c962-c09f-43d0-b4cb-2120d33af950 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:25.839815 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-bc90c962-c09f-43d0-b4cb-2120d33af950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f67f20d253a4da18210be90efa5daee', 'request_id': 'req-bc90c962-c09f-43d0-b4cb-2120d33af950'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:25.845633 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-bc90c962-c09f-43d0-b4cb-2120d33af950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f67f20d253a4da18210be90efa5daee', 'request_id': 'req-bc90c962-c09f-43d0-b4cb-2120d33af950'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:25.851012 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-bc90c962-c09f-43d0-b4cb-2120d33af950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f67f20d253a4da18210be90efa5daee', 'request_id': 'req-bc90c962-c09f-43d0-b4cb-2120d33af950'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:25.866908 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-bc90c962-c09f-43d0-b4cb-2120d33af950 admin admin] The token cache is being invalidate because project 8f67f20d253a4da18210be90efa5daee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:47:25.867170 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-bc90c962-c09f-43d0-b4cb-2120d33af950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:25.867822 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-bc90c962-c09f-43d0-b4cb-2120d33af950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:25.869587 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1232/2459] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:47:25 2022] DELETE /identity/v3/projects/8f67f20d253a4da18210be90efa5daee => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:25.873373 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938c9be-931c-4380-8f3c-dd0072c37a92 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:25.874797 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9938c9be-931c-4380-8f3c-dd0072c37a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:25.888170 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938c9be-931c-4380-8f3c-dd0072c37a92 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:25.943121 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c99b61-b114-45d2-ac76-ec820505d561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:25.943933 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c99b61-b114-45d2-ac76-ec820505d561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:25.944215 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c99b61-b114-45d2-ac76-ec820505d561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:25.944488 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c99b61-b114-45d2-ac76-ec820505d561 admin admin] PATH_INFO: `/v3/users/962763800afd4776befa102359009b71` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:25.945957 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c99b61-b114-45d2-ac76-ec820505d561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=962763800afd4776befa102359009b71)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:25.947920 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c99b61-b114-45d2-ac76-ec820505d561 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:25.994131 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-16c99b61-b114-45d2-ac76-ec820505d561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '962763800afd4776befa102359009b71'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:26.000549 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-16c99b61-b114-45d2-ac76-ec820505d561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '962763800afd4776befa102359009b71'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:26.012297 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-16c99b61-b114-45d2-ac76-ec820505d561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '962763800afd4776befa102359009b71'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:26.019307 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-16c99b61-b114-45d2-ac76-ec820505d561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '962763800afd4776befa102359009b71'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:26.019989 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-16c99b61-b114-45d2-ac76-ec820505d561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '962763800afd4776befa102359009b71'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:26.026661 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1228/2460] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:47:25 2022] DELETE /identity/v3/users/962763800afd4776befa102359009b71 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:26.197645 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90c962-c09f-43d0-b4cb-2120d33af950 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:26.199085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-bc90c962-c09f-43d0-b4cb-2120d33af950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:26.215381 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90c962-c09f-43d0-b4cb-2120d33af950 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:26.271810 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95185b3-4ce8-4fad-98b5-1f8e1b6f7301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:26.272940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95185b3-4ce8-4fad-98b5-1f8e1b6f7301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:26.273463 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95185b3-4ce8-4fad-98b5-1f8e1b6f7301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:26.273751 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95185b3-4ce8-4fad-98b5-1f8e1b6f7301 admin admin] PATH_INFO: `/v3/projects/2f76dece2d704b68a3bdbd49c8613bd2` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:26.274954 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95185b3-4ce8-4fad-98b5-1f8e1b6f7301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f76dece2d704b68a3bdbd49c8613bd2)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:26.276884 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95185b3-4ce8-4fad-98b5-1f8e1b6f7301 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:26.321595 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-f95185b3-4ce8-4fad-98b5-1f8e1b6f7301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f76dece2d704b68a3bdbd49c8613bd2', 'request_id': 'req-f95185b3-4ce8-4fad-98b5-1f8e1b6f7301'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:26.327508 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-f95185b3-4ce8-4fad-98b5-1f8e1b6f7301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f76dece2d704b68a3bdbd49c8613bd2', 'request_id': 'req-f95185b3-4ce8-4fad-98b5-1f8e1b6f7301'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:26.332735 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-f95185b3-4ce8-4fad-98b5-1f8e1b6f7301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f76dece2d704b68a3bdbd49c8613bd2', 'request_id': 'req-f95185b3-4ce8-4fad-98b5-1f8e1b6f7301'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:26.344432 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-f95185b3-4ce8-4fad-98b5-1f8e1b6f7301 admin admin] The token cache is being invalidate because project 2f76dece2d704b68a3bdbd49c8613bd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:47:26.344712 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-f95185b3-4ce8-4fad-98b5-1f8e1b6f7301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:26.345332 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-f95185b3-4ce8-4fad-98b5-1f8e1b6f7301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:26.346848 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1233/2461] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:47:26 2022] DELETE /identity/v3/projects/2f76dece2d704b68a3bdbd49c8613bd2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:26.353216 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee2ad5-78f3-4323-8744-d36e10716ad5 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:26.353532 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee2ad5-78f3-4323-8744-d36e10716ad5 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:26.353810 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee2ad5-78f3-4323-8744-d36e10716ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:26.371980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e7ee2ad5-78f3-4323-8744-d36e10716ad5 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:26.373158 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e7ee2ad5-78f3-4323-8744-d36e10716ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:26.440051 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1229/2462] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:26.447982 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468ef61-708f-42ad-b272-f58d6c6ca8ca None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:26.448217 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468ef61-708f-42ad-b272-f58d6c6ca8ca None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:26.448460 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468ef61-708f-42ad-b272-f58d6c6ca8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:26.468138 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-b468ef61-708f-42ad-b272-f58d6c6ca8ca None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:26.469341 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-b468ef61-708f-42ad-b272-f58d6c6ca8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:26.482332 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1234/2463] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:26.486488 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee2ad5-78f3-4323-8744-d36e10716ad5 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:26.497744 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee2ad5-78f3-4323-8744-d36e10716ad5 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:26.502837 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af3cbe-757f-48a3-baab-b148fd31ab3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:26.503501 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af3cbe-757f-48a3-baab-b148fd31ab3e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:26.503817 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af3cbe-757f-48a3-baab-b148fd31ab3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:26.504100 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af3cbe-757f-48a3-baab-b148fd31ab3e admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:26.504855 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af3cbe-757f-48a3-baab-b148fd31ab3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:47:26.505181 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af3cbe-757f-48a3-baab-b148fd31ab3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:26.506784 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af3cbe-757f-48a3-baab-b148fd31ab3e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:26.520256 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1230/2464] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:47:26.525027 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468ef61-708f-42ad-b272-f58d6c6ca8ca None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:26.534578 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468ef61-708f-42ad-b272-f58d6c6ca8ca None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:26.540398 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8298d6b-cde3-49db-83d9-e1647fe28e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:26.540973 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8298d6b-cde3-49db-83d9-e1647fe28e4b admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:26.541255 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8298d6b-cde3-49db-83d9-e1647fe28e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:26.541537 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8298d6b-cde3-49db-83d9-e1647fe28e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:26.542256 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8298d6b-cde3-49db-83d9-e1647fe28e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:26.544242 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8298d6b-cde3-49db-83d9-e1647fe28e4b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:26.575798 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1235/2465] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:47:26 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:47:26.578711 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af3cbe-757f-48a3-baab-b148fd31ab3e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:26.591906 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af3cbe-757f-48a3-baab-b148fd31ab3e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:26.653921 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40120d64-a9aa-459d-aa91-67d97f94c2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:26.654601 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40120d64-a9aa-459d-aa91-67d97f94c2ed admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:26.654882 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40120d64-a9aa-459d-aa91-67d97f94c2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:26.655156 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40120d64-a9aa-459d-aa91-67d97f94c2ed admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:26.655909 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40120d64-a9aa-459d-aa91-67d97f94c2ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:26.657850 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40120d64-a9aa-459d-aa91-67d97f94c2ed admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:26.683342 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1231/2466] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:47:26 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:47:26.684619 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8298d6b-cde3-49db-83d9-e1647fe28e4b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:26.695713 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8298d6b-cde3-49db-83d9-e1647fe28e4b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:26.700760 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b9b6d-48be-486f-9698-e3d76480ca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:26.701364 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b9b6d-48be-486f-9698-e3d76480ca7f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:26.701645 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b9b6d-48be-486f-9698-e3d76480ca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:26.701918 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b9b6d-48be-486f-9698-e3d76480ca7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:26.702658 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b9b6d-48be-486f-9698-e3d76480ca7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:26.704282 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b9b6d-48be-486f-9698-e3d76480ca7f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:26.716194 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1236/2467] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:47:26.720341 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40120d64-a9aa-459d-aa91-67d97f94c2ed admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:26.731164 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40120d64-a9aa-459d-aa91-67d97f94c2ed admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:26.735969 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cc538-6012-4df2-b5ab-55e0a8672492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:26.736630 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cc538-6012-4df2-b5ab-55e0a8672492 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:26.736908 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cc538-6012-4df2-b5ab-55e0a8672492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:26.737179 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cc538-6012-4df2-b5ab-55e0a8672492 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:26.737911 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07cc538-6012-4df2-b5ab-55e0a8672492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:26.739506 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07cc538-6012-4df2-b5ab-55e0a8672492 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:26.750190 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1232/2468] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:47:26.754715 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b9b6d-48be-486f-9698-e3d76480ca7f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:26.764692 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b9b6d-48be-486f-9698-e3d76480ca7f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:26.769724 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285adc9b-1414-4b64-a7b4-e6a101e78484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:26.770626 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285adc9b-1414-4b64-a7b4-e6a101e78484 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:26.770908 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285adc9b-1414-4b64-a7b4-e6a101e78484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:26.771184 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285adc9b-1414-4b64-a7b4-e6a101e78484 admin admin] PATH_INFO: `/v3/projects/63ae1bd413c64ed5a0a8bb8c59ebc7cf/users/3079e77b3b22451ebe38eb62342195e7/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:26.787221 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285adc9b-1414-4b64-a7b4-e6a101e78484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ae1bd413c64ed5a0a8bb8c59ebc7cf, user_id=3079e77b3b22451ebe38eb62342195e7, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:26.790622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285adc9b-1414-4b64-a7b4-e6a101e78484 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:26.803073 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1237/2469] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:47:26 2022] PUT /identity/v3/projects/63ae1bd413c64ed5a0a8bb8c59ebc7cf/users/3079e77b3b22451ebe38eb62342195e7/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:47:26.813261 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9e92e-4e3c-4e65-9dae-2f82945c4292 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:26.813621 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9e92e-4e3c-4e65-9dae-2f82945c4292 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:26.813985 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9e92e-4e3c-4e65-9dae-2f82945c4292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:26.840762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-66c9e92e-4e3c-4e65-9dae-2f82945c4292 None None] MFA Rules not processed for user `3079e77b3b22451ebe38eb62342195e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:26.841975 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-66c9e92e-4e3c-4e65-9dae-2f82945c4292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:26.904304 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1233/2470] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:26.908686 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285adc9b-1414-4b64-a7b4-e6a101e78484 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:26.968560 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285adc9b-1414-4b64-a7b4-e6a101e78484 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:26.973269 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1474d1a-21c1-42b0-adfc-4de44352495d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:26.973909 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1474d1a-21c1-42b0-adfc-4de44352495d admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:26.974196 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1474d1a-21c1-42b0-adfc-4de44352495d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:26.974474 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1474d1a-21c1-42b0-adfc-4de44352495d admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:26.975180 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1474d1a-21c1-42b0-adfc-4de44352495d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:26.978116 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1474d1a-21c1-42b0-adfc-4de44352495d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:27.004626 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1238/2471] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:47:26 2022] POST /identity/v3/projects => generated 393 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:47:27.009218 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9e92e-4e3c-4e65-9dae-2f82945c4292 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:27.019431 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9e92e-4e3c-4e65-9dae-2f82945c4292 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:27.074097 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee03e86-eec4-4859-b24d-4b1f540136ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:27.074759 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee03e86-eec4-4859-b24d-4b1f540136ee admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:27.075040 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee03e86-eec4-4859-b24d-4b1f540136ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:27.075316 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee03e86-eec4-4859-b24d-4b1f540136ee admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:27.076067 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee03e86-eec4-4859-b24d-4b1f540136ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:27.078102 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee03e86-eec4-4859-b24d-4b1f540136ee admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:27.098881 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1234/2472] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:47:27 2022] POST /identity/v3/users => generated 303 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:47:27.103409 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1474d1a-21c1-42b0-adfc-4de44352495d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:27.113393 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1474d1a-21c1-42b0-adfc-4de44352495d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:27.118885 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b90d9a-d7ae-4938-9d3f-1de41cd4be6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:27.119534 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b90d9a-d7ae-4938-9d3f-1de41cd4be6b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:27.119851 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b90d9a-d7ae-4938-9d3f-1de41cd4be6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:27.120181 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b90d9a-d7ae-4938-9d3f-1de41cd4be6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:27.120916 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b90d9a-d7ae-4938-9d3f-1de41cd4be6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:27.122533 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b90d9a-d7ae-4938-9d3f-1de41cd4be6b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:27.134098 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1239/2473] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:47:27.138357 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee03e86-eec4-4859-b24d-4b1f540136ee admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:27.148440 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee03e86-eec4-4859-b24d-4b1f540136ee admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:27.156803 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6623218-bb86-474a-9a08-267e9a5a8bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:27.157765 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6623218-bb86-474a-9a08-267e9a5a8bd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:27.158050 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6623218-bb86-474a-9a08-267e9a5a8bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:27.158331 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6623218-bb86-474a-9a08-267e9a5a8bd4 admin admin] PATH_INFO: `/v3/projects/e3253f6ee1e74128b2da987cf45e1562/users/d229cd49b25443aab290c9b7745e6d3e/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:27.173985 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6623218-bb86-474a-9a08-267e9a5a8bd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3253f6ee1e74128b2da987cf45e1562, user_id=d229cd49b25443aab290c9b7745e6d3e, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:27.176675 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6623218-bb86-474a-9a08-267e9a5a8bd4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:27.191518 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1235/2474] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:47:27 2022] PUT /identity/v3/projects/e3253f6ee1e74128b2da987cf45e1562/users/d229cd49b25443aab290c9b7745e6d3e/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:27.195543 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b90d9a-d7ae-4938-9d3f-1de41cd4be6b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:27.205457 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b90d9a-d7ae-4938-9d3f-1de41cd4be6b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:27.259624 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b8476-caeb-43af-9978-878b96e7a2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:27.260230 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b8476-caeb-43af-9978-878b96e7a2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:27.260512 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b8476-caeb-43af-9978-878b96e7a2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:27.260787 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b8476-caeb-43af-9978-878b96e7a2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:27.261512 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b8476-caeb-43af-9978-878b96e7a2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:27.263102 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b8476-caeb-43af-9978-878b96e7a2a1 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:27.272691 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1240/2475] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:47:27.276885 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6623218-bb86-474a-9a08-267e9a5a8bd4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:27.286776 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6623218-bb86-474a-9a08-267e9a5a8bd4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:27.291838 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411ae53-dea7-4f94-ac45-07c3e4ac5cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:27.292698 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411ae53-dea7-4f94-ac45-07c3e4ac5cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:27.292976 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411ae53-dea7-4f94-ac45-07c3e4ac5cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:27.293248 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411ae53-dea7-4f94-ac45-07c3e4ac5cb3 admin admin] PATH_INFO: `/v3/projects/e3253f6ee1e74128b2da987cf45e1562/users/d229cd49b25443aab290c9b7745e6d3e/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:27.295186 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411ae53-dea7-4f94-ac45-07c3e4ac5cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3253f6ee1e74128b2da987cf45e1562, user_id=d229cd49b25443aab290c9b7745e6d3e, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:27.297812 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411ae53-dea7-4f94-ac45-07c3e4ac5cb3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:27.308600 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1236/2476] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:47:27 2022] PUT /identity/v3/projects/e3253f6ee1e74128b2da987cf45e1562/users/d229cd49b25443aab290c9b7745e6d3e/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:27.319858 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157ab30-c485-41d0-b885-9a7102c92b80 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:27.320150 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157ab30-c485-41d0-b885-9a7102c92b80 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:27.320428 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157ab30-c485-41d0-b885-9a7102c92b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:27.346175 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-3157ab30-c485-41d0-b885-9a7102c92b80 None None] MFA Rules not processed for user `d229cd49b25443aab290c9b7745e6d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:27.347365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-3157ab30-c485-41d0-b885-9a7102c92b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:27.411533 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1241/2477] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:27.422031 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411ae53-dea7-4f94-ac45-07c3e4ac5cb3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:27.423734 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7411ae53-dea7-4f94-ac45-07c3e4ac5cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:27.481132 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411ae53-dea7-4f94-ac45-07c3e4ac5cb3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:27.484846 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06b68f-0a4c-4f35-b7db-ab3d9d84177c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:27.485477 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06b68f-0a4c-4f35-b7db-ab3d9d84177c service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:27.485758 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06b68f-0a4c-4f35-b7db-ab3d9d84177c service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:27.486034 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06b68f-0a4c-4f35-b7db-ab3d9d84177c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:27.494836 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06b68f-0a4c-4f35-b7db-ab3d9d84177c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:27.496297 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06b68f-0a4c-4f35-b7db-ab3d9d84177c service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:27.505663 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1237/2478] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:47:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:47:27.548169 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157ab30-c485-41d0-b885-9a7102c92b80 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:27.549606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-3157ab30-c485-41d0-b885-9a7102c92b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:27.561556 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157ab30-c485-41d0-b885-9a7102c92b80 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:27.565239 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722271bc-8d23-41a2-aeb6-c76e03ab9e62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:27.565865 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722271bc-8d23-41a2-aeb6-c76e03ab9e62 service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:27.566149 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722271bc-8d23-41a2-aeb6-c76e03ab9e62 service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:27.566427 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722271bc-8d23-41a2-aeb6-c76e03ab9e62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:27.623451 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722271bc-8d23-41a2-aeb6-c76e03ab9e62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:27.624900 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722271bc-8d23-41a2-aeb6-c76e03ab9e62 service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:27.634104 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1242/2479] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:47:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:47:30.812462 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06b68f-0a4c-4f35-b7db-ab3d9d84177c service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:30.876478 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06b68f-0a4c-4f35-b7db-ab3d9d84177c service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:30.882826 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9504c-0827-4b04-812a-602599fbe48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:30.883724 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9504c-0827-4b04-812a-602599fbe48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:30.884038 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9504c-0827-4b04-812a-602599fbe48a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:30.884313 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9504c-0827-4b04-812a-602599fbe48a admin admin] PATH_INFO: `/v3/users/3079e77b3b22451ebe38eb62342195e7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:30.885558 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9504c-0827-4b04-812a-602599fbe48a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3079e77b3b22451ebe38eb62342195e7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:30.887459 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9504c-0827-4b04-812a-602599fbe48a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:30.941070 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-18d9504c-0827-4b04-812a-602599fbe48a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3079e77b3b22451ebe38eb62342195e7'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:30.948469 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-18d9504c-0827-4b04-812a-602599fbe48a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3079e77b3b22451ebe38eb62342195e7'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:30.959682 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-18d9504c-0827-4b04-812a-602599fbe48a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3079e77b3b22451ebe38eb62342195e7'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:30.967896 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-18d9504c-0827-4b04-812a-602599fbe48a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3079e77b3b22451ebe38eb62342195e7'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:30.968534 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-18d9504c-0827-4b04-812a-602599fbe48a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3079e77b3b22451ebe38eb62342195e7'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:30.974423 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1238/2480] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:47:30 2022] DELETE /identity/v3/users/3079e77b3b22451ebe38eb62342195e7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:30.979079 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf56e4-b45f-40c2-9a40-02d784660cf5 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:30.979548 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf56e4-b45f-40c2-9a40-02d784660cf5 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:30.979786 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf56e4-b45f-40c2-9a40-02d784660cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:30.996557 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-6dbf56e4-b45f-40c2-9a40-02d784660cf5 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:30.997737 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-6dbf56e4-b45f-40c2-9a40-02d784660cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:31.060106 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1243/2481] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:31.070544 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9504c-0827-4b04-812a-602599fbe48a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:31.071971 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-18d9504c-0827-4b04-812a-602599fbe48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:31.127159 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9504c-0827-4b04-812a-602599fbe48a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:31.130711 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f3275-b101-433f-95d4-02b7e96d2877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:31.131346 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f3275-b101-433f-95d4-02b7e96d2877 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:31.131636 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f3275-b101-433f-95d4-02b7e96d2877 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:31.132606 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f3275-b101-433f-95d4-02b7e96d2877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:31.141542 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f3275-b101-433f-95d4-02b7e96d2877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:31.142961 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f3275-b101-433f-95d4-02b7e96d2877 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:31.152354 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1239/2482] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:47:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:47:31.459060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf56e4-b45f-40c2-9a40-02d784660cf5 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:31.460683 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-6dbf56e4-b45f-40c2-9a40-02d784660cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:31.473064 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf56e4-b45f-40c2-9a40-02d784660cf5 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:31.478748 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de15bd-b088-48fb-b494-44f7fd4691f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:31.479598 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de15bd-b088-48fb-b494-44f7fd4691f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:31.479949 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de15bd-b088-48fb-b494-44f7fd4691f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:31.480197 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de15bd-b088-48fb-b494-44f7fd4691f5 admin admin] PATH_INFO: `/v3/projects/63ae1bd413c64ed5a0a8bb8c59ebc7cf` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:31.481406 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de15bd-b088-48fb-b494-44f7fd4691f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ae1bd413c64ed5a0a8bb8c59ebc7cf)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:31.483318 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de15bd-b088-48fb-b494-44f7fd4691f5 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:31.529531 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-81de15bd-b088-48fb-b494-44f7fd4691f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ae1bd413c64ed5a0a8bb8c59ebc7cf', 'request_id': 'req-81de15bd-b088-48fb-b494-44f7fd4691f5'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:31.535569 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-81de15bd-b088-48fb-b494-44f7fd4691f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ae1bd413c64ed5a0a8bb8c59ebc7cf', 'request_id': 'req-81de15bd-b088-48fb-b494-44f7fd4691f5'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:31.542084 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-81de15bd-b088-48fb-b494-44f7fd4691f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ae1bd413c64ed5a0a8bb8c59ebc7cf', 'request_id': 'req-81de15bd-b088-48fb-b494-44f7fd4691f5'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:31.558181 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-81de15bd-b088-48fb-b494-44f7fd4691f5 admin admin] The token cache is being invalidate because project 63ae1bd413c64ed5a0a8bb8c59ebc7cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:47:31.558463 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-81de15bd-b088-48fb-b494-44f7fd4691f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:31.559074 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-81de15bd-b088-48fb-b494-44f7fd4691f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:31.560616 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1244/2483] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:47:31 2022] DELETE /identity/v3/projects/63ae1bd413c64ed5a0a8bb8c59ebc7cf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:31.564473 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f3275-b101-433f-95d4-02b7e96d2877 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:31.573818 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f3275-b101-433f-95d4-02b7e96d2877 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:31.627280 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44545ca9-cbd1-4e48-81b8-951230607891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:31.628160 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44545ca9-cbd1-4e48-81b8-951230607891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:31.628440 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44545ca9-cbd1-4e48-81b8-951230607891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:31.628708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44545ca9-cbd1-4e48-81b8-951230607891 admin admin] PATH_INFO: `/v3/users/d229cd49b25443aab290c9b7745e6d3e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:31.629932 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44545ca9-cbd1-4e48-81b8-951230607891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d229cd49b25443aab290c9b7745e6d3e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:31.631779 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44545ca9-cbd1-4e48-81b8-951230607891 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:31.676987 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-44545ca9-cbd1-4e48-81b8-951230607891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd229cd49b25443aab290c9b7745e6d3e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:31.684201 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-44545ca9-cbd1-4e48-81b8-951230607891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd229cd49b25443aab290c9b7745e6d3e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:31.695294 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-44545ca9-cbd1-4e48-81b8-951230607891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd229cd49b25443aab290c9b7745e6d3e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:31.702010 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-44545ca9-cbd1-4e48-81b8-951230607891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd229cd49b25443aab290c9b7745e6d3e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:31.702708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-44545ca9-cbd1-4e48-81b8-951230607891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd229cd49b25443aab290c9b7745e6d3e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:31.708713 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1240/2484] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:47:31 2022] DELETE /identity/v3/users/d229cd49b25443aab290c9b7745e6d3e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:31.969515 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de15bd-b088-48fb-b494-44f7fd4691f5 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:31.971040 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-81de15bd-b088-48fb-b494-44f7fd4691f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:31.984095 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de15bd-b088-48fb-b494-44f7fd4691f5 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:32.039204 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e2e18-e082-4130-930d-91193769c377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:32.040110 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e2e18-e082-4130-930d-91193769c377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:32.040388 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e2e18-e082-4130-930d-91193769c377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:32.040661 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e2e18-e082-4130-930d-91193769c377 admin admin] PATH_INFO: `/v3/projects/e3253f6ee1e74128b2da987cf45e1562` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:32.041833 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e2e18-e082-4130-930d-91193769c377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3253f6ee1e74128b2da987cf45e1562)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:32.043834 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e2e18-e082-4130-930d-91193769c377 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:32.087291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c17e2e18-e082-4130-930d-91193769c377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3253f6ee1e74128b2da987cf45e1562', 'request_id': 'req-c17e2e18-e082-4130-930d-91193769c377'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:32.093215 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c17e2e18-e082-4130-930d-91193769c377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3253f6ee1e74128b2da987cf45e1562', 'request_id': 'req-c17e2e18-e082-4130-930d-91193769c377'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:32.099471 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c17e2e18-e082-4130-930d-91193769c377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3253f6ee1e74128b2da987cf45e1562', 'request_id': 'req-c17e2e18-e082-4130-930d-91193769c377'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:32.111315 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c17e2e18-e082-4130-930d-91193769c377 admin admin] The token cache is being invalidate because project e3253f6ee1e74128b2da987cf45e1562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:47:32.111604 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c17e2e18-e082-4130-930d-91193769c377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:32.112276 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c17e2e18-e082-4130-930d-91193769c377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:32.113857 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1245/2485] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:47:31 2022] DELETE /identity/v3/projects/e3253f6ee1e74128b2da987cf45e1562 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:32.120291 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090eadca-2776-4221-ab8c-cc43ae0f144b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:32.120724 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090eadca-2776-4221-ab8c-cc43ae0f144b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:32.121023 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090eadca-2776-4221-ab8c-cc43ae0f144b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:32.146741 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-090eadca-2776-4221-ab8c-cc43ae0f144b None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:32.148277 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-090eadca-2776-4221-ab8c-cc43ae0f144b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:32.219707 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1241/2486] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:32.227775 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10311760-1780-44dc-ad1a-d6239bf840cd None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:32.228078 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10311760-1780-44dc-ad1a-d6239bf840cd None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:32.228360 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10311760-1780-44dc-ad1a-d6239bf840cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:32.247116 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-10311760-1780-44dc-ad1a-d6239bf840cd None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:32.248355 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-10311760-1780-44dc-ad1a-d6239bf840cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:32.256520 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1246/2487] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:32.260906 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090eadca-2776-4221-ab8c-cc43ae0f144b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:32.270558 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090eadca-2776-4221-ab8c-cc43ae0f144b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:32.275472 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7a0ca-63d8-4c55-b9a6-ebd853569c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:32.276161 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7a0ca-63d8-4c55-b9a6-ebd853569c5a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:32.276443 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7a0ca-63d8-4c55-b9a6-ebd853569c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:32.276716 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7a0ca-63d8-4c55-b9a6-ebd853569c5a admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:32.277447 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7a0ca-63d8-4c55-b9a6-ebd853569c5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:47:32.277756 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7a0ca-63d8-4c55-b9a6-ebd853569c5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:32.279382 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7a0ca-63d8-4c55-b9a6-ebd853569c5a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:32.291582 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1242/2488] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:47:32.295920 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10311760-1780-44dc-ad1a-d6239bf840cd None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:32.305674 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10311760-1780-44dc-ad1a-d6239bf840cd None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:32.310847 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238cf26b-00d8-4b62-ad9c-ca6a3dd625c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:32.311527 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cf26b-00d8-4b62-ad9c-ca6a3dd625c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:32.311846 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cf26b-00d8-4b62-ad9c-ca6a3dd625c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:32.312120 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cf26b-00d8-4b62-ad9c-ca6a3dd625c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:32.313177 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238cf26b-00d8-4b62-ad9c-ca6a3dd625c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:32.314708 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238cf26b-00d8-4b62-ad9c-ca6a3dd625c3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:32.342342 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1247/2489] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:47:32 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:47:32.346946 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7a0ca-63d8-4c55-b9a6-ebd853569c5a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:32.357066 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7a0ca-63d8-4c55-b9a6-ebd853569c5a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:32.415725 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0202751-a58d-40b9-8630-aa8c2c84c818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:32.416426 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0202751-a58d-40b9-8630-aa8c2c84c818 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:32.416710 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0202751-a58d-40b9-8630-aa8c2c84c818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:32.416986 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0202751-a58d-40b9-8630-aa8c2c84c818 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:32.417684 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0202751-a58d-40b9-8630-aa8c2c84c818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:32.419582 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0202751-a58d-40b9-8630-aa8c2c84c818 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:32.440154 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1243/2490] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:47:32 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:47:32.444861 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238cf26b-00d8-4b62-ad9c-ca6a3dd625c3 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:32.455313 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238cf26b-00d8-4b62-ad9c-ca6a3dd625c3 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:32.460607 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9ee7d-05ae-4b11-825b-529260dbff9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:32.461317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9ee7d-05ae-4b11-825b-529260dbff9e admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:32.461599 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9ee7d-05ae-4b11-825b-529260dbff9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:32.462002 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9ee7d-05ae-4b11-825b-529260dbff9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:32.462750 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9ee7d-05ae-4b11-825b-529260dbff9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:32.464374 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9ee7d-05ae-4b11-825b-529260dbff9e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:32.477856 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1248/2491] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:47:32.479456 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0202751-a58d-40b9-8630-aa8c2c84c818 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:32.489841 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0202751-a58d-40b9-8630-aa8c2c84c818 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:32.495306 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3cdd2-5ae7-45a5-8f4c-5e214edea049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:32.496016 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3cdd2-5ae7-45a5-8f4c-5e214edea049 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:32.496357 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3cdd2-5ae7-45a5-8f4c-5e214edea049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:32.496634 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3cdd2-5ae7-45a5-8f4c-5e214edea049 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:32.497394 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3cdd2-5ae7-45a5-8f4c-5e214edea049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:32.498992 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3cdd2-5ae7-45a5-8f4c-5e214edea049 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:32.511107 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1244/2492] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:47:32.514643 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9ee7d-05ae-4b11-825b-529260dbff9e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:32.525088 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9ee7d-05ae-4b11-825b-529260dbff9e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:32.529676 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c382f4-9f91-4963-8f51-b5f89cc513ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:32.530544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c382f4-9f91-4963-8f51-b5f89cc513ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:32.530822 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c382f4-9f91-4963-8f51-b5f89cc513ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:32.531093 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c382f4-9f91-4963-8f51-b5f89cc513ad admin admin] PATH_INFO: `/v3/projects/5672a7c8a6d8463f806b8a9078ec635b/users/84c25c72efdf4b098cc5f2dd3526fb31/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:32.545381 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c382f4-9f91-4963-8f51-b5f89cc513ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=5672a7c8a6d8463f806b8a9078ec635b, user_id=84c25c72efdf4b098cc5f2dd3526fb31, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:32.548051 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c382f4-9f91-4963-8f51-b5f89cc513ad admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:32.573554 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1249/2493] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:47:32 2022] PUT /identity/v3/projects/5672a7c8a6d8463f806b8a9078ec635b/users/84c25c72efdf4b098cc5f2dd3526fb31/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:32.582094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855b048-ddbf-4bd1-b329-a8e10928c25e None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:32.582094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855b048-ddbf-4bd1-b329-a8e10928c25e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:32.582094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855b048-ddbf-4bd1-b329-a8e10928c25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:32.610116 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-7855b048-ddbf-4bd1-b329-a8e10928c25e None None] MFA Rules not processed for user `84c25c72efdf4b098cc5f2dd3526fb31`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:32.611343 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7855b048-ddbf-4bd1-b329-a8e10928c25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:32.673224 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1245/2494] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:32.677550 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c382f4-9f91-4963-8f51-b5f89cc513ad admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:32.736094 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c382f4-9f91-4963-8f51-b5f89cc513ad admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:32.740761 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e0797-0042-41e6-ae4a-6b958b277756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:32.742029 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e0797-0042-41e6-ae4a-6b958b277756 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:32.742309 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e0797-0042-41e6-ae4a-6b958b277756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:32.742586 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e0797-0042-41e6-ae4a-6b958b277756 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:32.743291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e0797-0042-41e6-ae4a-6b958b277756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:32.745213 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e0797-0042-41e6-ae4a-6b958b277756 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:32.774061 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1250/2495] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:47:32 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:47:32.777700 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855b048-ddbf-4bd1-b329-a8e10928c25e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:32.788341 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855b048-ddbf-4bd1-b329-a8e10928c25e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:32.841996 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c437a0d-3978-4f10-98a1-252591c5b5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:32.842657 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c437a0d-3978-4f10-98a1-252591c5b5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:32.842942 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c437a0d-3978-4f10-98a1-252591c5b5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:32.843220 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c437a0d-3978-4f10-98a1-252591c5b5e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:32.843952 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c437a0d-3978-4f10-98a1-252591c5b5e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:32.845851 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c437a0d-3978-4f10-98a1-252591c5b5e2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:32.864951 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1246/2496] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:47:32 2022] POST /identity/v3/users => generated 299 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:47:32.869423 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e0797-0042-41e6-ae4a-6b958b277756 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:32.879734 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e0797-0042-41e6-ae4a-6b958b277756 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:32.885327 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535de21-b06b-4276-a6a3-0c835dec1bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:32.885965 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535de21-b06b-4276-a6a3-0c835dec1bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:32.886246 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535de21-b06b-4276-a6a3-0c835dec1bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:32.886525 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535de21-b06b-4276-a6a3-0c835dec1bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:32.887254 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535de21-b06b-4276-a6a3-0c835dec1bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:32.888855 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535de21-b06b-4276-a6a3-0c835dec1bf4 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:32.899384 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1251/2497] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:47:32.903374 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c437a0d-3978-4f10-98a1-252591c5b5e2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:32.913431 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c437a0d-3978-4f10-98a1-252591c5b5e2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:32.918286 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835eb7e-6fd9-44cb-9d5c-052008f30903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:32.919169 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835eb7e-6fd9-44cb-9d5c-052008f30903 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:32.919450 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835eb7e-6fd9-44cb-9d5c-052008f30903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:32.919721 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835eb7e-6fd9-44cb-9d5c-052008f30903 admin admin] PATH_INFO: `/v3/projects/514b20ca1b66428e8abcf7b2678bf7e8/users/352417d61bbd46dcb631681f111dad56/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:32.934654 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835eb7e-6fd9-44cb-9d5c-052008f30903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=514b20ca1b66428e8abcf7b2678bf7e8, user_id=352417d61bbd46dcb631681f111dad56, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:32.937250 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835eb7e-6fd9-44cb-9d5c-052008f30903 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:32.950312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1247/2498] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:47:32 2022] PUT /identity/v3/projects/514b20ca1b66428e8abcf7b2678bf7e8/users/352417d61bbd46dcb631681f111dad56/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:47:32.954112 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535de21-b06b-4276-a6a3-0c835dec1bf4 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:32.963986 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535de21-b06b-4276-a6a3-0c835dec1bf4 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:33.018780 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2347a-05bc-4284-bc1c-a8829662a101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:33.019490 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2347a-05bc-4284-bc1c-a8829662a101 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:33.019699 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2347a-05bc-4284-bc1c-a8829662a101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:33.020008 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2347a-05bc-4284-bc1c-a8829662a101 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:33.020732 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2347a-05bc-4284-bc1c-a8829662a101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:33.022299 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2347a-05bc-4284-bc1c-a8829662a101 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:33.031951 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1252/2499] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:47:33.036058 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835eb7e-6fd9-44cb-9d5c-052008f30903 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:33.046590 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835eb7e-6fd9-44cb-9d5c-052008f30903 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:33.051266 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951e2f0-7c5f-48dc-a175-dd5c5a480897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:33.052165 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951e2f0-7c5f-48dc-a175-dd5c5a480897 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:33.052448 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951e2f0-7c5f-48dc-a175-dd5c5a480897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:33.052722 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951e2f0-7c5f-48dc-a175-dd5c5a480897 admin admin] PATH_INFO: `/v3/projects/514b20ca1b66428e8abcf7b2678bf7e8/users/352417d61bbd46dcb631681f111dad56/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:33.055422 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951e2f0-7c5f-48dc-a175-dd5c5a480897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=514b20ca1b66428e8abcf7b2678bf7e8, user_id=352417d61bbd46dcb631681f111dad56, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:33.058082 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951e2f0-7c5f-48dc-a175-dd5c5a480897 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:33.068114 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1248/2500] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:47:33 2022] PUT /identity/v3/projects/514b20ca1b66428e8abcf7b2678bf7e8/users/352417d61bbd46dcb631681f111dad56/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:33.078298 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01772e59-3d3a-4c73-bf62-63021af2ebe1 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:33.078592 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01772e59-3d3a-4c73-bf62-63021af2ebe1 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:33.078879 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01772e59-3d3a-4c73-bf62-63021af2ebe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:33.105238 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-01772e59-3d3a-4c73-bf62-63021af2ebe1 None None] MFA Rules not processed for user `352417d61bbd46dcb631681f111dad56`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:33.106428 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-01772e59-3d3a-4c73-bf62-63021af2ebe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:33.172044 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1253/2501] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:33.183270 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951e2f0-7c5f-48dc-a175-dd5c5a480897 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:33.185032 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9951e2f0-7c5f-48dc-a175-dd5c5a480897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:33.239847 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951e2f0-7c5f-48dc-a175-dd5c5a480897 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:33.244485 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630873a-98d2-4b76-ada8-12ea7d7c7845 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:33.245123 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630873a-98d2-4b76-ada8-12ea7d7c7845 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:33.245429 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630873a-98d2-4b76-ada8-12ea7d7c7845 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:33.245698 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630873a-98d2-4b76-ada8-12ea7d7c7845 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:33.255079 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630873a-98d2-4b76-ada8-12ea7d7c7845 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:33.256596 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630873a-98d2-4b76-ada8-12ea7d7c7845 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:33.266389 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1249/2502] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:47:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:47:33.789001 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01772e59-3d3a-4c73-bf62-63021af2ebe1 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:33.848021 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01772e59-3d3a-4c73-bf62-63021af2ebe1 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:33.852855 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827f35e-8834-4827-9775-0d298bcf7926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:33.853713 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827f35e-8834-4827-9775-0d298bcf7926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:33.853997 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827f35e-8834-4827-9775-0d298bcf7926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:33.854301 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827f35e-8834-4827-9775-0d298bcf7926 admin admin] PATH_INFO: `/v3/users/84c25c72efdf4b098cc5f2dd3526fb31` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:33.855502 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827f35e-8834-4827-9775-0d298bcf7926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84c25c72efdf4b098cc5f2dd3526fb31)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:33.857469 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827f35e-8834-4827-9775-0d298bcf7926 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:33.901635 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c827f35e-8834-4827-9775-0d298bcf7926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84c25c72efdf4b098cc5f2dd3526fb31'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:33.912971 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c827f35e-8834-4827-9775-0d298bcf7926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84c25c72efdf4b098cc5f2dd3526fb31'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:33.919406 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c827f35e-8834-4827-9775-0d298bcf7926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84c25c72efdf4b098cc5f2dd3526fb31'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:33.926229 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c827f35e-8834-4827-9775-0d298bcf7926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84c25c72efdf4b098cc5f2dd3526fb31'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:33.926851 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c827f35e-8834-4827-9775-0d298bcf7926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84c25c72efdf4b098cc5f2dd3526fb31'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:33.932654 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1254/2503] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:47:33 2022] DELETE /identity/v3/users/84c25c72efdf4b098cc5f2dd3526fb31 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:33.937117 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3464de-e190-44d7-b5ea-b06b314bb219 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:33.937411 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3464de-e190-44d7-b5ea-b06b314bb219 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:33.937693 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3464de-e190-44d7-b5ea-b06b314bb219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:33.955878 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ad3464de-e190-44d7-b5ea-b06b314bb219 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:33.957014 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ad3464de-e190-44d7-b5ea-b06b314bb219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:34.013614 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1250/2504] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:47:34.023842 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827f35e-8834-4827-9775-0d298bcf7926 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:34.025224 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-c827f35e-8834-4827-9775-0d298bcf7926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:34.079605 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827f35e-8834-4827-9775-0d298bcf7926 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:34.083310 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c9826-dafa-4b6f-bb4f-b650955c0f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:34.084024 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c9826-dafa-4b6f-bb4f-b650955c0f67 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:34.084310 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c9826-dafa-4b6f-bb4f-b650955c0f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:34.084590 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c9826-dafa-4b6f-bb4f-b650955c0f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:34.096948 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c9826-dafa-4b6f-bb4f-b650955c0f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:34.098438 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c9826-dafa-4b6f-bb4f-b650955c0f67 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:34.108374 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1255/2505] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:47:34.375941 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3464de-e190-44d7-b5ea-b06b314bb219 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:34.377681 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ad3464de-e190-44d7-b5ea-b06b314bb219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:34.390501 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3464de-e190-44d7-b5ea-b06b314bb219 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:34.396176 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcd60b-0dc0-4ecd-a827-e907d694fda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:34.398266 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcd60b-0dc0-4ecd-a827-e907d694fda1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:34.398970 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcd60b-0dc0-4ecd-a827-e907d694fda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:34.398970 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcd60b-0dc0-4ecd-a827-e907d694fda1 admin admin] PATH_INFO: `/v3/projects/5672a7c8a6d8463f806b8a9078ec635b` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:34.400328 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcd60b-0dc0-4ecd-a827-e907d694fda1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5672a7c8a6d8463f806b8a9078ec635b)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:34.402274 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcd60b-0dc0-4ecd-a827-e907d694fda1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:34.451120 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d2fcd60b-0dc0-4ecd-a827-e907d694fda1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5672a7c8a6d8463f806b8a9078ec635b', 'request_id': 'req-d2fcd60b-0dc0-4ecd-a827-e907d694fda1'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:34.457152 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d2fcd60b-0dc0-4ecd-a827-e907d694fda1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5672a7c8a6d8463f806b8a9078ec635b', 'request_id': 'req-d2fcd60b-0dc0-4ecd-a827-e907d694fda1'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:34.462903 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d2fcd60b-0dc0-4ecd-a827-e907d694fda1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5672a7c8a6d8463f806b8a9078ec635b', 'request_id': 'req-d2fcd60b-0dc0-4ecd-a827-e907d694fda1'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:34.474413 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d2fcd60b-0dc0-4ecd-a827-e907d694fda1 admin admin] The token cache is being invalidate because project 5672a7c8a6d8463f806b8a9078ec635b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:47:34.474697 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d2fcd60b-0dc0-4ecd-a827-e907d694fda1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:34.475292 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d2fcd60b-0dc0-4ecd-a827-e907d694fda1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:34.477565 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1251/2506] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:47:34 2022] DELETE /identity/v3/projects/5672a7c8a6d8463f806b8a9078ec635b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:34.481488 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c9826-dafa-4b6f-bb4f-b650955c0f67 service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:34.490857 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c9826-dafa-4b6f-bb4f-b650955c0f67 service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:34.545394 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4cff37-6a1a-423e-9a57-b4541a0e1da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:34.546258 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cff37-6a1a-423e-9a57-b4541a0e1da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:34.546539 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cff37-6a1a-423e-9a57-b4541a0e1da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:34.546839 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4cff37-6a1a-423e-9a57-b4541a0e1da2 admin admin] PATH_INFO: `/v3/users/352417d61bbd46dcb631681f111dad56` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:34.548071 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4cff37-6a1a-423e-9a57-b4541a0e1da2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=352417d61bbd46dcb631681f111dad56)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:34.549975 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4cff37-6a1a-423e-9a57-b4541a0e1da2 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:34.593918 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-de4cff37-6a1a-423e-9a57-b4541a0e1da2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352417d61bbd46dcb631681f111dad56'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:34.604882 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-de4cff37-6a1a-423e-9a57-b4541a0e1da2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352417d61bbd46dcb631681f111dad56'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:34.611186 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-de4cff37-6a1a-423e-9a57-b4541a0e1da2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352417d61bbd46dcb631681f111dad56'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:34.618156 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-de4cff37-6a1a-423e-9a57-b4541a0e1da2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352417d61bbd46dcb631681f111dad56'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:34.618865 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-de4cff37-6a1a-423e-9a57-b4541a0e1da2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352417d61bbd46dcb631681f111dad56'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:34.624705 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1256/2507] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:47:34 2022] DELETE /identity/v3/users/352417d61bbd46dcb631681f111dad56 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:34.893771 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcd60b-0dc0-4ecd-a827-e907d694fda1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:34.895218 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d2fcd60b-0dc0-4ecd-a827-e907d694fda1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:34.909651 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcd60b-0dc0-4ecd-a827-e907d694fda1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:34.965966 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1b836-b25e-4b7d-90c7-993177e93717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:34.966730 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1b836-b25e-4b7d-90c7-993177e93717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:34.967008 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1b836-b25e-4b7d-90c7-993177e93717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:34.967281 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1b836-b25e-4b7d-90c7-993177e93717 admin admin] PATH_INFO: `/v3/projects/514b20ca1b66428e8abcf7b2678bf7e8` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:34.968469 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1b836-b25e-4b7d-90c7-993177e93717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=514b20ca1b66428e8abcf7b2678bf7e8)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:34.970346 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1b836-b25e-4b7d-90c7-993177e93717 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:35.015687 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8ae1b836-b25e-4b7d-90c7-993177e93717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '514b20ca1b66428e8abcf7b2678bf7e8', 'request_id': 'req-8ae1b836-b25e-4b7d-90c7-993177e93717'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:35.021639 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8ae1b836-b25e-4b7d-90c7-993177e93717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '514b20ca1b66428e8abcf7b2678bf7e8', 'request_id': 'req-8ae1b836-b25e-4b7d-90c7-993177e93717'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:35.026821 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8ae1b836-b25e-4b7d-90c7-993177e93717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '514b20ca1b66428e8abcf7b2678bf7e8', 'request_id': 'req-8ae1b836-b25e-4b7d-90c7-993177e93717'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:35.039688 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8ae1b836-b25e-4b7d-90c7-993177e93717 admin admin] The token cache is being invalidate because project 514b20ca1b66428e8abcf7b2678bf7e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:47:35.039995 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8ae1b836-b25e-4b7d-90c7-993177e93717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:35.040618 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8ae1b836-b25e-4b7d-90c7-993177e93717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:35.042134 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1252/2508] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:47:34 2022] DELETE /identity/v3/projects/514b20ca1b66428e8abcf7b2678bf7e8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:35.047832 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f956881-8bd5-4167-acac-8dab62996c20 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:35.048504 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f956881-8bd5-4167-acac-8dab62996c20 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:35.048504 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f956881-8bd5-4167-acac-8dab62996c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:35.067559 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-0f956881-8bd5-4167-acac-8dab62996c20 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:35.068847 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-0f956881-8bd5-4167-acac-8dab62996c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:35.128257 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1257/2509] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:35.136769 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81e87c-c49c-430f-ba04-838321df6ce3 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:35.137084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81e87c-c49c-430f-ba04-838321df6ce3 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:35.137360 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81e87c-c49c-430f-ba04-838321df6ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:35.154977 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-5c81e87c-c49c-430f-ba04-838321df6ce3 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:35.156202 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5c81e87c-c49c-430f-ba04-838321df6ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:35.164002 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1253/2510] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:35.168143 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f956881-8bd5-4167-acac-8dab62996c20 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:35.177659 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f956881-8bd5-4167-acac-8dab62996c20 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:35.182870 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b88eb-013d-4171-806a-933d1b512ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:35.183511 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b88eb-013d-4171-806a-933d1b512ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:35.183824 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b88eb-013d-4171-806a-933d1b512ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:35.184104 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b88eb-013d-4171-806a-933d1b512ba4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:35.184835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b88eb-013d-4171-806a-933d1b512ba4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:47:35.185144 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b88eb-013d-4171-806a-933d1b512ba4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:35.186712 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b88eb-013d-4171-806a-933d1b512ba4 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:35.198648 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1258/2511] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:47:35.202754 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81e87c-c49c-430f-ba04-838321df6ce3 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:35.211738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81e87c-c49c-430f-ba04-838321df6ce3 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:35.216429 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a706e6-2c5e-47e8-ba79-f706d43c5750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:35.216996 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a706e6-2c5e-47e8-ba79-f706d43c5750 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:35.217273 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a706e6-2c5e-47e8-ba79-f706d43c5750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:35.217543 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a706e6-2c5e-47e8-ba79-f706d43c5750 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:35.218237 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a706e6-2c5e-47e8-ba79-f706d43c5750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:35.220189 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a706e6-2c5e-47e8-ba79-f706d43c5750 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:35.245475 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1254/2512] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:47:35 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:47:35.249525 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b88eb-013d-4171-806a-933d1b512ba4 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:35.259642 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b88eb-013d-4171-806a-933d1b512ba4 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:35.314078 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238915b-bdfc-408b-aab8-e88f5b4f7fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:35.314776 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238915b-bdfc-408b-aab8-e88f5b4f7fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:35.315056 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238915b-bdfc-408b-aab8-e88f5b4f7fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:35.315327 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238915b-bdfc-408b-aab8-e88f5b4f7fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:35.316083 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238915b-bdfc-408b-aab8-e88f5b4f7fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:35.318062 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238915b-bdfc-408b-aab8-e88f5b4f7fe3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:35.337257 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1259/2513] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:47:35 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:47:35.341354 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a706e6-2c5e-47e8-ba79-f706d43c5750 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:35.352213 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a706e6-2c5e-47e8-ba79-f706d43c5750 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:35.357070 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86065534-7e6c-4c32-8fa3-5623ccc8fbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:35.357759 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86065534-7e6c-4c32-8fa3-5623ccc8fbce admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:35.358039 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86065534-7e6c-4c32-8fa3-5623ccc8fbce admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:35.358339 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86065534-7e6c-4c32-8fa3-5623ccc8fbce admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:35.359076 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86065534-7e6c-4c32-8fa3-5623ccc8fbce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:35.360704 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86065534-7e6c-4c32-8fa3-5623ccc8fbce admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:35.372774 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1255/2514] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:47:35.376822 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238915b-bdfc-408b-aab8-e88f5b4f7fe3 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:35.387413 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238915b-bdfc-408b-aab8-e88f5b4f7fe3 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:35.392178 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da4210-5135-401f-947d-acee39723064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:35.392901 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da4210-5135-401f-947d-acee39723064 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:35.393191 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da4210-5135-401f-947d-acee39723064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:35.393473 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da4210-5135-401f-947d-acee39723064 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:35.394212 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da4210-5135-401f-947d-acee39723064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:35.395824 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da4210-5135-401f-947d-acee39723064 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:35.406111 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1260/2515] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:47:35.410192 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86065534-7e6c-4c32-8fa3-5623ccc8fbce admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:35.420559 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86065534-7e6c-4c32-8fa3-5623ccc8fbce admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:35.426050 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdc5c2-0793-410e-949d-90b06dab883d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:35.426921 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdc5c2-0793-410e-949d-90b06dab883d admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:35.427357 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdc5c2-0793-410e-949d-90b06dab883d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:35.427842 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdc5c2-0793-410e-949d-90b06dab883d admin admin] PATH_INFO: `/v3/projects/4628b38b90b6499e97fe1045b54098f8/users/2b96d3350af145ac8a7805eacfd8b246/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:35.442903 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdc5c2-0793-410e-949d-90b06dab883d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4628b38b90b6499e97fe1045b54098f8, user_id=2b96d3350af145ac8a7805eacfd8b246, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:35.446258 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdc5c2-0793-410e-949d-90b06dab883d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:35.462377 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1256/2516] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:47:35 2022] PUT /identity/v3/projects/4628b38b90b6499e97fe1045b54098f8/users/2b96d3350af145ac8a7805eacfd8b246/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:35.467525 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d485b-0bba-47be-ac0b-949938ab401c None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:35.467744 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d485b-0bba-47be-ac0b-949938ab401c None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:35.468057 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d485b-0bba-47be-ac0b-949938ab401c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:35.486952 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-ef8d485b-0bba-47be-ac0b-949938ab401c None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:35.488260 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-ef8d485b-0bba-47be-ac0b-949938ab401c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:35.551931 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1261/2517] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:35.562717 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdc5c2-0793-410e-949d-90b06dab883d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:35.564600 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-41fdc5c2-0793-410e-949d-90b06dab883d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:35.621669 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdc5c2-0793-410e-949d-90b06dab883d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:35.625287 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fe18c-96cd-4fc4-bf70-d3476fd3fdad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:35.625921 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fe18c-96cd-4fc4-bf70-d3476fd3fdad service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:35.626208 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fe18c-96cd-4fc4-bf70-d3476fd3fdad service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:35.626736 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fe18c-96cd-4fc4-bf70-d3476fd3fdad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:35.635806 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fe18c-96cd-4fc4-bf70-d3476fd3fdad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:35.637232 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fe18c-96cd-4fc4-bf70-d3476fd3fdad service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:35.646517 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1257/2518] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:47:36.278941 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6a6de-1fc5-435b-8794-81396fe7805f None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:36.279503 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6a6de-1fc5-435b-8794-81396fe7805f None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:36.279866 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6a6de-1fc5-435b-8794-81396fe7805f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:36.306626 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-1da6a6de-1fc5-435b-8794-81396fe7805f None None] MFA Rules not processed for user `2b96d3350af145ac8a7805eacfd8b246`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:36.307909 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-1da6a6de-1fc5-435b-8794-81396fe7805f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:36.372683 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1262/2519] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:36.384750 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fe18c-96cd-4fc4-bf70-d3476fd3fdad service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:36.386208 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-000fe18c-96cd-4fc4-bf70-d3476fd3fdad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:36.441163 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fe18c-96cd-4fc4-bf70-d3476fd3fdad service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:36.444934 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5d532-9c49-4210-bab1-d38a740e7fad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:36.445727 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5d532-9c49-4210-bab1-d38a740e7fad service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:36.446157 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5d532-9c49-4210-bab1-d38a740e7fad service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:36.446431 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5d532-9c49-4210-bab1-d38a740e7fad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:36.454722 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5d532-9c49-4210-bab1-d38a740e7fad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:36.456180 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5d532-9c49-4210-bab1-d38a740e7fad service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:36.466055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1258/2520] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:47:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:47:37.843145 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096e62a-4df5-42d9-9342-a5bf050c04b8 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:37.843145 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096e62a-4df5-42d9-9342-a5bf050c04b8 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:37.843686 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096e62a-4df5-42d9-9342-a5bf050c04b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:37.861835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-c096e62a-4df5-42d9-9342-a5bf050c04b8 None None] MFA Rules not processed for user `2b96d3350af145ac8a7805eacfd8b246`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:37.863018 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-c096e62a-4df5-42d9-9342-a5bf050c04b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:37.873355 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1263/2521] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:38.194327 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5d532-9c49-4210-bab1-d38a740e7fad service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:38.196558 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a6d5d532-9c49-4210-bab1-d38a740e7fad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:38.208909 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5d532-9c49-4210-bab1-d38a740e7fad service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:38.214046 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ecd0b-b532-4a17-8a41-c3a6b9e79c3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:38.214708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ecd0b-b532-4a17-8a41-c3a6b9e79c3c service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:38.214987 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ecd0b-b532-4a17-8a41-c3a6b9e79c3c service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:38.215276 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ecd0b-b532-4a17-8a41-c3a6b9e79c3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:38.217319 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b81ecd0b-b532-4a17-8a41-c3a6b9e79c3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:38.297759 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ecd0b-b532-4a17-8a41-c3a6b9e79c3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:38.299833 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ecd0b-b532-4a17-8a41-c3a6b9e79c3c service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:38.312801 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1259/2522] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:47:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:47:38.572846 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096e62a-4df5-42d9-9342-a5bf050c04b8 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:38.574295 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-c096e62a-4df5-42d9-9342-a5bf050c04b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:38.680700 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096e62a-4df5-42d9-9342-a5bf050c04b8 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:38.688067 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16b2f9-b81d-4aea-a9d3-8780d8555048 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:38.689136 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16b2f9-b81d-4aea-a9d3-8780d8555048 service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:38.689414 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16b2f9-b81d-4aea-a9d3-8780d8555048 service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:38.689687 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16b2f9-b81d-4aea-a9d3-8780d8555048 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:38.691532 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-8a16b2f9-b81d-4aea-a9d3-8780d8555048 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:38.705117 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16b2f9-b81d-4aea-a9d3-8780d8555048 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:38.706719 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16b2f9-b81d-4aea-a9d3-8780d8555048 service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:38.718107 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1264/2523] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:47:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:47:39.650870 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ecd0b-b532-4a17-8a41-c3a6b9e79c3c service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:39.653388 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b81ecd0b-b532-4a17-8a41-c3a6b9e79c3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:39.681225 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ecd0b-b532-4a17-8a41-c3a6b9e79c3c service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:39.689876 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326364b-7d2f-4746-b0ba-46f4479b9166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:39.691062 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326364b-7d2f-4746-b0ba-46f4479b9166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:39.691540 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326364b-7d2f-4746-b0ba-46f4479b9166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:39.693154 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326364b-7d2f-4746-b0ba-46f4479b9166 admin admin] PATH_INFO: `/v3/users/2a7421e6184e497eb23bf9f87957322c` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:39.694558 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326364b-7d2f-4746-b0ba-46f4479b9166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a7421e6184e497eb23bf9f87957322c)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:39.697976 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326364b-7d2f-4746-b0ba-46f4479b9166 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:39.782667 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0326364b-7d2f-4746-b0ba-46f4479b9166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a7421e6184e497eb23bf9f87957322c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:39.793603 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0326364b-7d2f-4746-b0ba-46f4479b9166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a7421e6184e497eb23bf9f87957322c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:39.817275 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0326364b-7d2f-4746-b0ba-46f4479b9166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a7421e6184e497eb23bf9f87957322c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:39.829340 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0326364b-7d2f-4746-b0ba-46f4479b9166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a7421e6184e497eb23bf9f87957322c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:39.830316 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0326364b-7d2f-4746-b0ba-46f4479b9166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a7421e6184e497eb23bf9f87957322c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:39.842437 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1260/2524] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:47:39 2022] DELETE /identity/v3/users/2a7421e6184e497eb23bf9f87957322c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:40.160414 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16b2f9-b81d-4aea-a9d3-8780d8555048 service nova] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:40.171880 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16b2f9-b81d-4aea-a9d3-8780d8555048 service nova] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:40.273190 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326364b-7d2f-4746-b0ba-46f4479b9166 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:40.275194 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0326364b-7d2f-4746-b0ba-46f4479b9166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:40.292568 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4483d6d-4949-4fbb-b2e1-613b51ac6cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:40.293767 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4483d6d-4949-4fbb-b2e1-613b51ac6cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:40.295461 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4483d6d-4949-4fbb-b2e1-613b51ac6cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:40.295926 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4483d6d-4949-4fbb-b2e1-613b51ac6cd0 admin admin] PATH_INFO: `/v3/projects/55220445da0d49ac8713e9036e8e6e06` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:40.299156 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4483d6d-4949-4fbb-b2e1-613b51ac6cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55220445da0d49ac8713e9036e8e6e06)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:40.302603 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4483d6d-4949-4fbb-b2e1-613b51ac6cd0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:40.399529 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c4483d6d-4949-4fbb-b2e1-613b51ac6cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55220445da0d49ac8713e9036e8e6e06', 'request_id': 'req-c4483d6d-4949-4fbb-b2e1-613b51ac6cd0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:40.404385 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326364b-7d2f-4746-b0ba-46f4479b9166 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:40.407100 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c4483d6d-4949-4fbb-b2e1-613b51ac6cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55220445da0d49ac8713e9036e8e6e06', 'request_id': 'req-c4483d6d-4949-4fbb-b2e1-613b51ac6cd0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:40.413783 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c4483d6d-4949-4fbb-b2e1-613b51ac6cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55220445da0d49ac8713e9036e8e6e06', 'request_id': 'req-c4483d6d-4949-4fbb-b2e1-613b51ac6cd0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:40.432653 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c4483d6d-4949-4fbb-b2e1-613b51ac6cd0 admin admin] The token cache is being invalidate because project 55220445da0d49ac8713e9036e8e6e06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:47:40.433559 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c4483d6d-4949-4fbb-b2e1-613b51ac6cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:40.435248 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-c4483d6d-4949-4fbb-b2e1-613b51ac6cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:47:40.438250 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1265/2525] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:47:40 2022] DELETE /identity/v3/projects/55220445da0d49ac8713e9036e8e6e06 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:47:40.566531 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ad516-0cac-486a-ad0a-31716bd7800e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:40.567118 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ad516-0cac-486a-ad0a-31716bd7800e service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:40.567684 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ad516-0cac-486a-ad0a-31716bd7800e service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:40.567684 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ad516-0cac-486a-ad0a-31716bd7800e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:40.569780 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d63ad516-0cac-486a-ad0a-31716bd7800e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:40.591102 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ad516-0cac-486a-ad0a-31716bd7800e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:40.592737 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ad516-0cac-486a-ad0a-31716bd7800e service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:40.611290 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1261/2526] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:47:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:47:40.892538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aa803-1f82-42ad-b9ff-0be456f28652 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:40.893012 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aa803-1f82-42ad-b9ff-0be456f28652 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:40.893436 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aa803-1f82-42ad-b9ff-0be456f28652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:40.913782 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-478aa803-1f82-42ad-b9ff-0be456f28652 None None] MFA Rules not processed for user `9761863f36284bd4be1ce29c86b631cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:40.916296 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-478aa803-1f82-42ad-b9ff-0be456f28652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:41.081318 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1266/2527] 10.222.0.35 () {58 vars in 967 bytes} [Tue Feb 8 16:47:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:47:41.118087 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ad516-0cac-486a-ad0a-31716bd7800e service nova] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:47:41.120848 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d63ad516-0cac-486a-ad0a-31716bd7800e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:41.233067 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ad516-0cac-486a-ad0a-31716bd7800e service nova] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:47:41.238713 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95ddfe-189e-48cc-b8a6-48a0af2bf0ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00fd3c05cd8e4167946a1f567df2cc6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:47:41.239480 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95ddfe-189e-48cc-b8a6-48a0af2bf0ea service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:41.239784 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95ddfe-189e-48cc-b8a6-48a0af2bf0ea service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:41.240071 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95ddfe-189e-48cc-b8a6-48a0af2bf0ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:41.250172 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95ddfe-189e-48cc-b8a6-48a0af2bf0ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:47:41.252103 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95ddfe-189e-48cc-b8a6-48a0af2bf0ea service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:47:41.262743 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1262/2528] 10.222.0.35 () {60 vars in 1384 bytes} [Tue Feb 8 16:47:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:47:53.365024 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04101f2-9c50-4fba-b716-3bb7eb42cd8a None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:47:53.365553 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04101f2-9c50-4fba-b716-3bb7eb42cd8a None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:47:53.365553 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04101f2-9c50-4fba-b716-3bb7eb42cd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:47:53.383901 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-f04101f2-9c50-4fba-b716-3bb7eb42cd8a None None] MFA Rules not processed for user `2b96d3350af145ac8a7805eacfd8b246`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:47:53.385143 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-f04101f2-9c50-4fba-b716-3bb7eb42cd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:47:53.437705 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1267/2529] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:47:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:48:05.334175 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95ddfe-189e-48cc-b8a6-48a0af2bf0ea service swift] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:48:05.335896 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4b95ddfe-189e-48cc-b8a6-48a0af2bf0ea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:48:05.351723 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95ddfe-189e-48cc-b8a6-48a0af2bf0ea service swift] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:48:05.357184 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0eb59-68a6-47e5-9f4b-3faa1b1655dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:48:05.357813 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0eb59-68a6-47e5-9f4b-3faa1b1655dd service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:48:05.358092 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0eb59-68a6-47e5-9f4b-3faa1b1655dd service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:48:05.358364 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0eb59-68a6-47e5-9f4b-3faa1b1655dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:48:05.360128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-44d0eb59-68a6-47e5-9f4b-3faa1b1655dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:48:05.416656 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0eb59-68a6-47e5-9f4b-3faa1b1655dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:48:05.418242 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0eb59-68a6-47e5-9f4b-3faa1b1655dd service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:48:05.427818 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1263/2530] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:48:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:48:13.213230 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80035677-e252-422a-bc49-564323a520a3 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:48:13.213738 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80035677-e252-422a-bc49-564323a520a3 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:48:13.213848 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80035677-e252-422a-bc49-564323a520a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:48:13.231098 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-80035677-e252-422a-bc49-564323a520a3 None None] MFA Rules not processed for user `9761863f36284bd4be1ce29c86b631cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:48:13.232324 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-80035677-e252-422a-bc49-564323a520a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:48:13.239454 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1268/2531] 10.222.0.35 () {58 vars in 1009 bytes} [Tue Feb 8 16:48:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:48:13.252759 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0eb59-68a6-47e5-9f4b-3faa1b1655dd service nova] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:48:13.265162 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0eb59-68a6-47e5-9f4b-3faa1b1655dd service nova] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:48:13.270234 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63ee80-466f-4ed9-a4a0-434e76ec6276 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00fd3c05cd8e4167946a1f567df2cc6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:48:13.270869 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63ee80-466f-4ed9-a4a0-434e76ec6276 service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:48:13.271152 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63ee80-466f-4ed9-a4a0-434e76ec6276 service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:48:13.271431 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63ee80-466f-4ed9-a4a0-434e76ec6276 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:48:13.279818 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63ee80-466f-4ed9-a4a0-434e76ec6276 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:48:13.281383 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63ee80-466f-4ed9-a4a0-434e76ec6276 service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:48:13.289261 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1264/2532] 10.222.0.35 () {60 vars in 1384 bytes} [Tue Feb 8 16:48:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:48:27.624386 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d54211-2d47-4405-a721-1c7a858c166c None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:48:27.625654 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d54211-2d47-4405-a721-1c7a858c166c None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:48:27.625654 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d54211-2d47-4405-a721-1c7a858c166c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:48:27.642828 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-40d54211-2d47-4405-a721-1c7a858c166c None None] MFA Rules not processed for user `9761863f36284bd4be1ce29c86b631cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:48:27.644039 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-40d54211-2d47-4405-a721-1c7a858c166c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:48:27.651460 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1269/2533] 10.222.0.35 () {58 vars in 967 bytes} [Tue Feb 8 16:48:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:48:27.664508 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63ee80-466f-4ed9-a4a0-434e76ec6276 service swift] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:48:27.675048 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63ee80-466f-4ed9-a4a0-434e76ec6276 service swift] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:48:27.680917 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47849bee-53b7-421a-ae60-57d18b754535 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00fd3c05cd8e4167946a1f567df2cc6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:48:27.681546 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47849bee-53b7-421a-ae60-57d18b754535 service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:48:27.681829 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47849bee-53b7-421a-ae60-57d18b754535 service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:48:27.682107 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47849bee-53b7-421a-ae60-57d18b754535 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:48:27.690318 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47849bee-53b7-421a-ae60-57d18b754535 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:48:27.691855 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47849bee-53b7-421a-ae60-57d18b754535 service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:48:27.700066 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1265/2534] 10.222.0.35 () {60 vars in 1384 bytes} [Tue Feb 8 16:48:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:48:29.561095 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d54211-2d47-4405-a721-1c7a858c166c None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:48:29.563068 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-40d54211-2d47-4405-a721-1c7a858c166c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:48:29.627606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d54211-2d47-4405-a721-1c7a858c166c None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:48:29.632098 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbe218-6186-4a5d-8323-614c294b09a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:48:29.633485 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbe218-6186-4a5d-8323-614c294b09a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:48:29.633769 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbe218-6186-4a5d-8323-614c294b09a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:48:29.634042 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbe218-6186-4a5d-8323-614c294b09a1 admin admin] PATH_INFO: `/v3/users/2b96d3350af145ac8a7805eacfd8b246` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:48:29.635263 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbe218-6186-4a5d-8323-614c294b09a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b96d3350af145ac8a7805eacfd8b246)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:48:29.637211 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbe218-6186-4a5d-8323-614c294b09a1 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:48:29.682423 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-12fbe218-6186-4a5d-8323-614c294b09a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b96d3350af145ac8a7805eacfd8b246'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:48:29.693357 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-12fbe218-6186-4a5d-8323-614c294b09a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b96d3350af145ac8a7805eacfd8b246'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:48:29.700563 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-12fbe218-6186-4a5d-8323-614c294b09a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b96d3350af145ac8a7805eacfd8b246'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:48:29.708275 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-12fbe218-6186-4a5d-8323-614c294b09a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b96d3350af145ac8a7805eacfd8b246'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:48:29.709014 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-12fbe218-6186-4a5d-8323-614c294b09a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b96d3350af145ac8a7805eacfd8b246'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:48:29.715023 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1270/2535] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:48:29 2022] DELETE /identity/v3/users/2b96d3350af145ac8a7805eacfd8b246 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:48:29.879407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47849bee-53b7-421a-ae60-57d18b754535 service swift] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:48:29.890474 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47849bee-53b7-421a-ae60-57d18b754535 service swift] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:48:29.945176 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98035f0e-ea3f-442b-a11f-2c3a98767cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:48:29.946009 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98035f0e-ea3f-442b-a11f-2c3a98767cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:48:29.946285 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98035f0e-ea3f-442b-a11f-2c3a98767cba admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:48:29.946555 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98035f0e-ea3f-442b-a11f-2c3a98767cba admin admin] PATH_INFO: `/v3/projects/4628b38b90b6499e97fe1045b54098f8` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:48:29.947732 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98035f0e-ea3f-442b-a11f-2c3a98767cba admin admin] RBAC: Authorizing `identity:delete_project(project_id=4628b38b90b6499e97fe1045b54098f8)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:48:29.949644 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98035f0e-ea3f-442b-a11f-2c3a98767cba admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:48:29.995203 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-98035f0e-ea3f-442b-a11f-2c3a98767cba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4628b38b90b6499e97fe1045b54098f8', 'request_id': 'req-98035f0e-ea3f-442b-a11f-2c3a98767cba'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:48:30.001385 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-98035f0e-ea3f-442b-a11f-2c3a98767cba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4628b38b90b6499e97fe1045b54098f8', 'request_id': 'req-98035f0e-ea3f-442b-a11f-2c3a98767cba'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:48:30.006549 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-98035f0e-ea3f-442b-a11f-2c3a98767cba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4628b38b90b6499e97fe1045b54098f8', 'request_id': 'req-98035f0e-ea3f-442b-a11f-2c3a98767cba'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:48:30.019005 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-98035f0e-ea3f-442b-a11f-2c3a98767cba admin admin] The token cache is being invalidate because project 4628b38b90b6499e97fe1045b54098f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:48:30.019294 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-98035f0e-ea3f-442b-a11f-2c3a98767cba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:48:30.019930 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-98035f0e-ea3f-442b-a11f-2c3a98767cba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:48:30.021429 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1266/2536] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:48:29 2022] DELETE /identity/v3/projects/4628b38b90b6499e97fe1045b54098f8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:48:30.029132 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a97c45-5c03-448e-b50f-3345cd4518f6 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:48:30.029559 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a97c45-5c03-448e-b50f-3345cd4518f6 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:48:30.029692 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a97c45-5c03-448e-b50f-3345cd4518f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:48:30.047528 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-69a97c45-5c03-448e-b50f-3345cd4518f6 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:48:30.048764 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-69a97c45-5c03-448e-b50f-3345cd4518f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:48:30.107104 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1271/2537] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:48:30.114788 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43db65-7e18-444c-8a7e-e2c23caf27af None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:48:30.115080 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43db65-7e18-444c-8a7e-e2c23caf27af None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:48:30.115360 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43db65-7e18-444c-8a7e-e2c23caf27af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:48:30.135443 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-fd43db65-7e18-444c-8a7e-e2c23caf27af None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:48:30.136608 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-fd43db65-7e18-444c-8a7e-e2c23caf27af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:48:30.144429 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1267/2538] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:48:30.148472 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a97c45-5c03-448e-b50f-3345cd4518f6 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:48:30.157985 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a97c45-5c03-448e-b50f-3345cd4518f6 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:48:30.162600 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f846e-64e4-42d3-a58b-ec2e58e44421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:48:30.163241 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f846e-64e4-42d3-a58b-ec2e58e44421 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:48:30.164052 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f846e-64e4-42d3-a58b-ec2e58e44421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:48:30.164330 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f846e-64e4-42d3-a58b-ec2e58e44421 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:48:30.165061 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f846e-64e4-42d3-a58b-ec2e58e44421 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:48:30.165369 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f846e-64e4-42d3-a58b-ec2e58e44421 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:48:30.166956 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f846e-64e4-42d3-a58b-ec2e58e44421 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:48:30.178124 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1272/2539] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:48:30.183088 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43db65-7e18-444c-8a7e-e2c23caf27af None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:48:30.192134 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43db65-7e18-444c-8a7e-e2c23caf27af None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:48:30.196829 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604fa63-72dd-4e7d-a250-6c6a17d28670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:48:30.197456 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604fa63-72dd-4e7d-a250-6c6a17d28670 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:48:30.197726 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604fa63-72dd-4e7d-a250-6c6a17d28670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:48:30.197993 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604fa63-72dd-4e7d-a250-6c6a17d28670 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:48:30.198677 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604fa63-72dd-4e7d-a250-6c6a17d28670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:48:30.200589 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604fa63-72dd-4e7d-a250-6c6a17d28670 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:48:30.233924 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1268/2540] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:48:30 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:48:30.238074 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f846e-64e4-42d3-a58b-ec2e58e44421 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:48:30.248584 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f846e-64e4-42d3-a58b-ec2e58e44421 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:48:30.303359 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2ae2b-e8c2-43d6-bee8-ceb0cf4e253b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:48:30.304088 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2ae2b-e8c2-43d6-bee8-ceb0cf4e253b admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:48:30.304499 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2ae2b-e8c2-43d6-bee8-ceb0cf4e253b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:48:30.304971 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2ae2b-e8c2-43d6-bee8-ceb0cf4e253b admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:48:30.305736 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2ae2b-e8c2-43d6-bee8-ceb0cf4e253b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:48:30.307645 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2ae2b-e8c2-43d6-bee8-ceb0cf4e253b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:48:30.327483 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1273/2541] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:48:30 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:48:30.331638 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604fa63-72dd-4e7d-a250-6c6a17d28670 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:48:30.342513 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604fa63-72dd-4e7d-a250-6c6a17d28670 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:48:30.347108 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e06749-75e9-4bcf-b605-b0520b6fd47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:48:30.347766 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e06749-75e9-4bcf-b605-b0520b6fd47c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:48:30.348097 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e06749-75e9-4bcf-b605-b0520b6fd47c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:48:30.348375 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e06749-75e9-4bcf-b605-b0520b6fd47c admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:48:30.349101 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e06749-75e9-4bcf-b605-b0520b6fd47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:48:30.350685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e06749-75e9-4bcf-b605-b0520b6fd47c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:48:30.360902 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1269/2542] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:48:30.364666 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2ae2b-e8c2-43d6-bee8-ceb0cf4e253b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:48:30.374995 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2ae2b-e8c2-43d6-bee8-ceb0cf4e253b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:48:30.379892 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514a0b0-7f14-43fc-bdfc-14bba258dd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:48:30.380527 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514a0b0-7f14-43fc-bdfc-14bba258dd30 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:48:30.380805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514a0b0-7f14-43fc-bdfc-14bba258dd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:48:30.381075 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514a0b0-7f14-43fc-bdfc-14bba258dd30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:48:30.381799 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514a0b0-7f14-43fc-bdfc-14bba258dd30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:48:30.383400 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514a0b0-7f14-43fc-bdfc-14bba258dd30 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:48:30.393061 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1274/2543] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:48:30.396955 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e06749-75e9-4bcf-b605-b0520b6fd47c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:48:30.407495 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e06749-75e9-4bcf-b605-b0520b6fd47c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:48:30.412196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f151a-be75-40f1-9bd4-507e34d14e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:48:30.413105 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f151a-be75-40f1-9bd4-507e34d14e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:48:30.413421 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f151a-be75-40f1-9bd4-507e34d14e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:48:30.414183 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f151a-be75-40f1-9bd4-507e34d14e49 admin admin] PATH_INFO: `/v3/projects/3d721564e7f34d38ad9af0b20a0b0581/users/581bda640b5b4bbab811a3b9a7094c0c/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:48:30.429135 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f151a-be75-40f1-9bd4-507e34d14e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d721564e7f34d38ad9af0b20a0b0581, user_id=581bda640b5b4bbab811a3b9a7094c0c, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:48:30.432046 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f151a-be75-40f1-9bd4-507e34d14e49 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:48:30.444345 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1270/2544] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:48:30 2022] PUT /identity/v3/projects/3d721564e7f34d38ad9af0b20a0b0581/users/581bda640b5b4bbab811a3b9a7094c0c/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:48:30.453996 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3a193-365c-43a2-9f26-3d6b406fddf8 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:48:30.454281 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3a193-365c-43a2-9f26-3d6b406fddf8 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:48:30.454579 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3a193-365c-43a2-9f26-3d6b406fddf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:48:30.481491 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-c8e3a193-365c-43a2-9f26-3d6b406fddf8 None None] MFA Rules not processed for user `581bda640b5b4bbab811a3b9a7094c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:48:30.482693 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-c8e3a193-365c-43a2-9f26-3d6b406fddf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:48:30.543608 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1275/2545] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:48:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:48:30.554848 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f151a-be75-40f1-9bd4-507e34d14e49 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:48:30.556557 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-472f151a-be75-40f1-9bd4-507e34d14e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:48:30.611458 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f151a-be75-40f1-9bd4-507e34d14e49 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:48:30.615105 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce0899-5653-4646-9de0-e67bd2c27887 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10453496872a45a9867fc6a13a13de49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:48:30.615737 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce0899-5653-4646-9de0-e67bd2c27887 service glance] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:48:30.616055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce0899-5653-4646-9de0-e67bd2c27887 service glance] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:48:30.616333 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce0899-5653-4646-9de0-e67bd2c27887 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:48:30.624499 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce0899-5653-4646-9de0-e67bd2c27887 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:48:30.626187 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce0899-5653-4646-9de0-e67bd2c27887 service glance] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:48:30.635615 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1271/2546] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:48:30 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:49:05.458729 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3a193-365c-43a2-9f26-3d6b406fddf8 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:49:05.519046 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3a193-365c-43a2-9f26-3d6b406fddf8 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:49:05.523561 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ea41c-3795-41c6-9e9a-7ac6589eb766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:49:05.524437 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ea41c-3795-41c6-9e9a-7ac6589eb766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:49:05.524720 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ea41c-3795-41c6-9e9a-7ac6589eb766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:49:05.524995 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ea41c-3795-41c6-9e9a-7ac6589eb766 admin admin] PATH_INFO: `/v3/users/581bda640b5b4bbab811a3b9a7094c0c` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:49:05.526191 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ea41c-3795-41c6-9e9a-7ac6589eb766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=581bda640b5b4bbab811a3b9a7094c0c)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:49:05.528720 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ea41c-3795-41c6-9e9a-7ac6589eb766 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:49:05.571873 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-af2ea41c-3795-41c6-9e9a-7ac6589eb766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '581bda640b5b4bbab811a3b9a7094c0c'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:49:05.583081 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-af2ea41c-3795-41c6-9e9a-7ac6589eb766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '581bda640b5b4bbab811a3b9a7094c0c'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:49:05.589494 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-af2ea41c-3795-41c6-9e9a-7ac6589eb766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '581bda640b5b4bbab811a3b9a7094c0c'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:49:05.597060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-af2ea41c-3795-41c6-9e9a-7ac6589eb766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '581bda640b5b4bbab811a3b9a7094c0c'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:49:05.597660 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-af2ea41c-3795-41c6-9e9a-7ac6589eb766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '581bda640b5b4bbab811a3b9a7094c0c'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:49:05.603433 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1276/2547] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:49:05 2022] DELETE /identity/v3/users/581bda640b5b4bbab811a3b9a7094c0c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:49:05.608574 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391ce45-f6c7-44a0-aae5-b11a2db0eafb None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:49:05.609067 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391ce45-f6c7-44a0-aae5-b11a2db0eafb None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:49:05.609176 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391ce45-f6c7-44a0-aae5-b11a2db0eafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:49:05.625939 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-5391ce45-f6c7-44a0-aae5-b11a2db0eafb None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:49:05.627138 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5391ce45-f6c7-44a0-aae5-b11a2db0eafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:49:05.684543 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1272/2548] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:49:05.694322 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ea41c-3795-41c6-9e9a-7ac6589eb766 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:49:05.695701 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-af2ea41c-3795-41c6-9e9a-7ac6589eb766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:49:05.751911 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ea41c-3795-41c6-9e9a-7ac6589eb766 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:49:05.755814 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57f218-8702-4183-a1f8-05b910d403b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:49:05.756491 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57f218-8702-4183-a1f8-05b910d403b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:49:05.756775 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57f218-8702-4183-a1f8-05b910d403b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:49:05.757096 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57f218-8702-4183-a1f8-05b910d403b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:49:05.766783 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57f218-8702-4183-a1f8-05b910d403b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:49:05.768315 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57f218-8702-4183-a1f8-05b910d403b1 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:49:05.777824 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1277/2549] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:49:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:49:06.132466 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391ce45-f6c7-44a0-aae5-b11a2db0eafb None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:49:06.133969 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5391ce45-f6c7-44a0-aae5-b11a2db0eafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:49:06.145966 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391ce45-f6c7-44a0-aae5-b11a2db0eafb None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:49:06.152273 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eec5bd-48dd-417a-9cb1-0ebf58d3008b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:49:06.153045 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eec5bd-48dd-417a-9cb1-0ebf58d3008b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:49:06.153364 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eec5bd-48dd-417a-9cb1-0ebf58d3008b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:49:06.153645 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eec5bd-48dd-417a-9cb1-0ebf58d3008b admin admin] PATH_INFO: `/v3/projects/3d721564e7f34d38ad9af0b20a0b0581` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:49:06.158500 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eec5bd-48dd-417a-9cb1-0ebf58d3008b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d721564e7f34d38ad9af0b20a0b0581)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:49:06.160505 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eec5bd-48dd-417a-9cb1-0ebf58d3008b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:49:06.206368 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-97eec5bd-48dd-417a-9cb1-0ebf58d3008b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d721564e7f34d38ad9af0b20a0b0581', 'request_id': 'req-97eec5bd-48dd-417a-9cb1-0ebf58d3008b'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:49:06.212285 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-97eec5bd-48dd-417a-9cb1-0ebf58d3008b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d721564e7f34d38ad9af0b20a0b0581', 'request_id': 'req-97eec5bd-48dd-417a-9cb1-0ebf58d3008b'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:49:06.218177 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-97eec5bd-48dd-417a-9cb1-0ebf58d3008b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d721564e7f34d38ad9af0b20a0b0581', 'request_id': 'req-97eec5bd-48dd-417a-9cb1-0ebf58d3008b'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:49:06.229566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-97eec5bd-48dd-417a-9cb1-0ebf58d3008b admin admin] The token cache is being invalidate because project 3d721564e7f34d38ad9af0b20a0b0581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:49:06.229854 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-97eec5bd-48dd-417a-9cb1-0ebf58d3008b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:49:06.230467 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-97eec5bd-48dd-417a-9cb1-0ebf58d3008b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:49:06.232039 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1273/2550] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:49:06 2022] DELETE /identity/v3/projects/3d721564e7f34d38ad9af0b20a0b0581 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:49:08.752686 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57f218-8702-4183-a1f8-05b910d403b1 service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:49:08.754022 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-1b57f218-8702-4183-a1f8-05b910d403b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:49:08.825737 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57f218-8702-4183-a1f8-05b910d403b1 service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:49:08.886677 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d38936-d213-4c84-938f-38a8406c33cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:49:08.887317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d38936-d213-4c84-938f-38a8406c33cb service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:49:08.887596 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d38936-d213-4c84-938f-38a8406c33cb service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:49:08.887913 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d38936-d213-4c84-938f-38a8406c33cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:49:08.889794 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-61d38936-d213-4c84-938f-38a8406c33cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:49:08.947646 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d38936-d213-4c84-938f-38a8406c33cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:49:08.949252 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d38936-d213-4c84-938f-38a8406c33cb service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:49:08.958466 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1278/2551] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:49:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:49:11.602257 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d310d0-ed2c-43fc-b642-020428bbef8c None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:49:11.602824 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d310d0-ed2c-43fc-b642-020428bbef8c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:49:11.602824 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d310d0-ed2c-43fc-b642-020428bbef8c None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:49:11.604659 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1274/2552] 10.222.0.35 () {54 vars in 921 bytes} [Tue Feb 8 16:49:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:49:11.613875 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eb9ce-9e43-4e0c-b04e-f9ceccf0a68d None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:49:11.614365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eb9ce-9e43-4e0c-b04e-f9ceccf0a68d None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:49:11.614462 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eb9ce-9e43-4e0c-b04e-f9ceccf0a68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:49:11.632658 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-b08eb9ce-9e43-4e0c-b04e-f9ceccf0a68d None None] MFA Rules not processed for user `0b936dc9a67846f08e51648e64c3d6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:49:11.633854 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-b08eb9ce-9e43-4e0c-b04e-f9ceccf0a68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:49:11.685548 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1279/2553] 10.222.0.35 () {58 vars in 1018 bytes} [Tue Feb 8 16:49:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:49:11.697480 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d310d0-ed2c-43fc-b642-020428bbef8c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:49:11.699192 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-37d310d0-ed2c-43fc-b642-020428bbef8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:49:11.713044 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d310d0-ed2c-43fc-b642-020428bbef8c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:49:11.716584 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64684c3-58d7-4900-a00e-0733cf699f0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:49:11.718128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64684c3-58d7-4900-a00e-0733cf699f0c service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:49:11.718501 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64684c3-58d7-4900-a00e-0733cf699f0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:49:11.718782 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64684c3-58d7-4900-a00e-0733cf699f0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:49:11.726030 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64684c3-58d7-4900-a00e-0733cf699f0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:49:11.727464 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64684c3-58d7-4900-a00e-0733cf699f0c service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:49:11.735495 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1275/2554] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:49:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:49:17.450103 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d77de-1f9a-49c3-8015-eba1a40ed234 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:49:17.450585 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d77de-1f9a-49c3-8015-eba1a40ed234 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:49:17.450695 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d77de-1f9a-49c3-8015-eba1a40ed234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:49:17.468436 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-788d77de-1f9a-49c3-8015-eba1a40ed234 None None] MFA Rules not processed for user `c858d129681846aba9e366c37c2213a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:49:17.469632 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-788d77de-1f9a-49c3-8015-eba1a40ed234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:49:17.522809 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1280/2555] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:49:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:49:37.980333 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d04180-2080-484d-bb7b-9ccc551fae2d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:49:37.980860 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d04180-2080-484d-bb7b-9ccc551fae2d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:49:37.980972 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d04180-2080-484d-bb7b-9ccc551fae2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:49:37.999502 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-61d04180-2080-484d-bb7b-9ccc551fae2d None None] MFA Rules not processed for user `c5f36415ea7148d79f9fdb9cfac129e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:49:38.000992 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-61d04180-2080-484d-bb7b-9ccc551fae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:49:38.052960 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1276/2556] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:49:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:49:42.024113 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d77de-1f9a-49c3-8015-eba1a40ed234 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:49:42.025624 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-788d77de-1f9a-49c3-8015-eba1a40ed234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:49:42.094187 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d77de-1f9a-49c3-8015-eba1a40ed234 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:49:42.099164 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768e70c-29f8-4528-9859-6809997e7c4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c8f232fc83474b8731ee6c1eb321fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:49:42.099868 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768e70c-29f8-4528-9859-6809997e7c4f service placement] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:49:42.100155 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768e70c-29f8-4528-9859-6809997e7c4f service placement] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:49:42.100431 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768e70c-29f8-4528-9859-6809997e7c4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:49:42.102190 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-c768e70c-29f8-4528-9859-6809997e7c4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:49:42.114275 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768e70c-29f8-4528-9859-6809997e7c4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:49:42.115820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768e70c-29f8-4528-9859-6809997e7c4f service placement] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:49:42.126751 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1281/2557] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:49:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:50:20.469730 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01556a75-be1f-43d5-bf38-1ffe9e5f2f27 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:20.470594 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01556a75-be1f-43d5-bf38-1ffe9e5f2f27 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:20.470881 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01556a75-be1f-43d5-bf38-1ffe9e5f2f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:20.489682 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-01556a75-be1f-43d5-bf38-1ffe9e5f2f27 None None] MFA Rules not processed for user `9761863f36284bd4be1ce29c86b631cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:50:20.491467 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-01556a75-be1f-43d5-bf38-1ffe9e5f2f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:50:20.545910 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1277/2558] 10.222.0.35 () {58 vars in 967 bytes} [Tue Feb 8 16:50:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:50:20.591176 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768e70c-29f8-4528-9859-6809997e7c4f service placement] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:50:20.592608 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-c768e70c-29f8-4528-9859-6809997e7c4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:50:20.657502 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768e70c-29f8-4528-9859-6809997e7c4f service placement] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:50:20.662858 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77544193-535a-44b0-9e6b-719c6a4f03ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00fd3c05cd8e4167946a1f567df2cc6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:50:20.663493 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77544193-535a-44b0-9e6b-719c6a4f03ca service swift] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:20.663809 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77544193-535a-44b0-9e6b-719c6a4f03ca service swift] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:20.664092 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77544193-535a-44b0-9e6b-719c6a4f03ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:20.671896 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77544193-535a-44b0-9e6b-719c6a4f03ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:50:20.673459 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77544193-535a-44b0-9e6b-719c6a4f03ca service swift] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:50:20.681879 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1282/2559] 10.222.0.35 () {60 vars in 1384 bytes} [Tue Feb 8 16:50:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:50:27.554613 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01556a75-be1f-43d5-bf38-1ffe9e5f2f27 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:50:27.556153 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-01556a75-be1f-43d5-bf38-1ffe9e5f2f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:50:27.627467 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01556a75-be1f-43d5-bf38-1ffe9e5f2f27 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:50:27.632114 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b248fc-a120-4f08-a7b2-09aaab40088a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:50:27.632972 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b248fc-a120-4f08-a7b2-09aaab40088a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:27.633255 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b248fc-a120-4f08-a7b2-09aaab40088a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:27.633532 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b248fc-a120-4f08-a7b2-09aaab40088a admin admin] PATH_INFO: `/v3/users/2b8d57b4da614728a52f90e2d7e6ed84` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:27.634751 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b248fc-a120-4f08-a7b2-09aaab40088a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8d57b4da614728a52f90e2d7e6ed84)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:50:27.636714 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b248fc-a120-4f08-a7b2-09aaab40088a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:50:27.682631 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c7b248fc-a120-4f08-a7b2-09aaab40088a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8d57b4da614728a52f90e2d7e6ed84'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:50:27.690788 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c7b248fc-a120-4f08-a7b2-09aaab40088a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8d57b4da614728a52f90e2d7e6ed84'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:50:27.702509 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c7b248fc-a120-4f08-a7b2-09aaab40088a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8d57b4da614728a52f90e2d7e6ed84'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:50:27.710761 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c7b248fc-a120-4f08-a7b2-09aaab40088a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8d57b4da614728a52f90e2d7e6ed84'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:50:27.711376 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c7b248fc-a120-4f08-a7b2-09aaab40088a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8d57b4da614728a52f90e2d7e6ed84'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:50:27.717297 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1278/2560] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:50:27 2022] DELETE /identity/v3/users/2b8d57b4da614728a52f90e2d7e6ed84 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:50:27.888360 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77544193-535a-44b0-9e6b-719c6a4f03ca service swift] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:50:27.901796 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77544193-535a-44b0-9e6b-719c6a4f03ca service swift] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:50:27.957123 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27990e-124e-46c7-b38c-68a3ae79a898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:50:27.957969 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27990e-124e-46c7-b38c-68a3ae79a898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:27.958256 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27990e-124e-46c7-b38c-68a3ae79a898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:27.958520 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27990e-124e-46c7-b38c-68a3ae79a898 admin admin] PATH_INFO: `/v3/projects/6cd968a946ad4d3d9281c64f94d2eb09` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:27.960367 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27990e-124e-46c7-b38c-68a3ae79a898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd968a946ad4d3d9281c64f94d2eb09)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:50:27.962244 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27990e-124e-46c7-b38c-68a3ae79a898 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:50:28.007775 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-bf27990e-124e-46c7-b38c-68a3ae79a898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd968a946ad4d3d9281c64f94d2eb09', 'request_id': 'req-bf27990e-124e-46c7-b38c-68a3ae79a898'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:50:28.013940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-bf27990e-124e-46c7-b38c-68a3ae79a898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd968a946ad4d3d9281c64f94d2eb09', 'request_id': 'req-bf27990e-124e-46c7-b38c-68a3ae79a898'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:50:28.019037 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-bf27990e-124e-46c7-b38c-68a3ae79a898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd968a946ad4d3d9281c64f94d2eb09', 'request_id': 'req-bf27990e-124e-46c7-b38c-68a3ae79a898'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:50:28.031097 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-bf27990e-124e-46c7-b38c-68a3ae79a898 admin admin] The token cache is being invalidate because project 6cd968a946ad4d3d9281c64f94d2eb09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:50:28.031380 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-bf27990e-124e-46c7-b38c-68a3ae79a898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:50:28.032025 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-bf27990e-124e-46c7-b38c-68a3ae79a898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:50:28.033542 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1283/2561] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:50:27 2022] DELETE /identity/v3/projects/6cd968a946ad4d3d9281c64f94d2eb09 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:50:28.037505 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b248fc-a120-4f08-a7b2-09aaab40088a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:50:28.038888 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c7b248fc-a120-4f08-a7b2-09aaab40088a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:50:28.051843 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b248fc-a120-4f08-a7b2-09aaab40088a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:50:28.107611 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12037ff0-9be5-4757-beb6-0461e142d856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:50:28.108515 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12037ff0-9be5-4757-beb6-0461e142d856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:28.108802 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12037ff0-9be5-4757-beb6-0461e142d856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:28.109082 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12037ff0-9be5-4757-beb6-0461e142d856 admin admin] PATH_INFO: `/v3/users/6eff71083f94443680361135a6f5f601` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:28.110309 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12037ff0-9be5-4757-beb6-0461e142d856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eff71083f94443680361135a6f5f601)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:50:28.112276 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12037ff0-9be5-4757-beb6-0461e142d856 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:50:28.160759 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-12037ff0-9be5-4757-beb6-0461e142d856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eff71083f94443680361135a6f5f601'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:50:28.167341 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-12037ff0-9be5-4757-beb6-0461e142d856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eff71083f94443680361135a6f5f601'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:50:28.178906 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-12037ff0-9be5-4757-beb6-0461e142d856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eff71083f94443680361135a6f5f601'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:50:28.186376 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-12037ff0-9be5-4757-beb6-0461e142d856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eff71083f94443680361135a6f5f601'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:50:28.187056 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-12037ff0-9be5-4757-beb6-0461e142d856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eff71083f94443680361135a6f5f601'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:50:28.193566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1279/2562] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:50:28 2022] DELETE /identity/v3/users/6eff71083f94443680361135a6f5f601 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:50:28.367628 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27990e-124e-46c7-b38c-68a3ae79a898 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:50:28.369096 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-bf27990e-124e-46c7-b38c-68a3ae79a898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:50:28.383328 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27990e-124e-46c7-b38c-68a3ae79a898 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:50:28.437861 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68226647-3903-4877-868e-0330c9210246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:50:28.438705 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68226647-3903-4877-868e-0330c9210246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:28.438981 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68226647-3903-4877-868e-0330c9210246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:28.439254 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68226647-3903-4877-868e-0330c9210246 admin admin] PATH_INFO: `/v3/projects/559f06f01fa44382a6a56bf847e5d610` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:28.440454 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68226647-3903-4877-868e-0330c9210246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=559f06f01fa44382a6a56bf847e5d610)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:50:28.442323 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68226647-3903-4877-868e-0330c9210246 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:50:28.485975 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-68226647-3903-4877-868e-0330c9210246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '559f06f01fa44382a6a56bf847e5d610', 'request_id': 'req-68226647-3903-4877-868e-0330c9210246'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:50:28.492468 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-68226647-3903-4877-868e-0330c9210246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '559f06f01fa44382a6a56bf847e5d610', 'request_id': 'req-68226647-3903-4877-868e-0330c9210246'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:50:28.497638 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-68226647-3903-4877-868e-0330c9210246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '559f06f01fa44382a6a56bf847e5d610', 'request_id': 'req-68226647-3903-4877-868e-0330c9210246'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:50:28.509886 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-68226647-3903-4877-868e-0330c9210246 admin admin] The token cache is being invalidate because project 559f06f01fa44382a6a56bf847e5d610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:50:28.510167 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-68226647-3903-4877-868e-0330c9210246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:50:28.510800 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-68226647-3903-4877-868e-0330c9210246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:50:28.512325 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1284/2563] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:50:28 2022] DELETE /identity/v3/projects/559f06f01fa44382a6a56bf847e5d610 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:50:28.518365 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea2c58-28e7-4dd2-ba98-f2227581881e None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:28.518661 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea2c58-28e7-4dd2-ba98-f2227581881e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:28.518956 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea2c58-28e7-4dd2-ba98-f2227581881e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:28.536631 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2dea2c58-28e7-4dd2-ba98-f2227581881e None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:50:28.537843 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2dea2c58-28e7-4dd2-ba98-f2227581881e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:50:28.595100 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1280/2564] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:50:28.603457 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d0fc6-6943-4428-a51f-5c9083cbd01e None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:28.603742 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d0fc6-6943-4428-a51f-5c9083cbd01e None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:28.604068 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d0fc6-6943-4428-a51f-5c9083cbd01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:28.622305 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-871d0fc6-6943-4428-a51f-5c9083cbd01e None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:50:28.623474 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-871d0fc6-6943-4428-a51f-5c9083cbd01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:50:28.632062 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1285/2565] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:50:28.636194 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea2c58-28e7-4dd2-ba98-f2227581881e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:50:28.645708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea2c58-28e7-4dd2-ba98-f2227581881e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:50:28.650668 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba061fd-0c18-4e37-b745-eee616a12799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:50:28.651309 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba061fd-0c18-4e37-b745-eee616a12799 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:28.651593 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba061fd-0c18-4e37-b745-eee616a12799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:28.651902 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba061fd-0c18-4e37-b745-eee616a12799 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:28.652632 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba061fd-0c18-4e37-b745-eee616a12799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:50:28.652941 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba061fd-0c18-4e37-b745-eee616a12799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:50:28.654534 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba061fd-0c18-4e37-b745-eee616a12799 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:50:28.665806 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1281/2566] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:50:28.669825 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d0fc6-6943-4428-a51f-5c9083cbd01e None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:50:28.679189 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d0fc6-6943-4428-a51f-5c9083cbd01e None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:50:28.684340 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306c84c-495b-4412-9dd9-fc2727461b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:50:28.684999 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306c84c-495b-4412-9dd9-fc2727461b43 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:28.685322 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306c84c-495b-4412-9dd9-fc2727461b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:28.685629 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306c84c-495b-4412-9dd9-fc2727461b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:28.687081 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306c84c-495b-4412-9dd9-fc2727461b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:50:28.688538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306c84c-495b-4412-9dd9-fc2727461b43 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:50:28.713435 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1286/2567] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:50:28 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:50:28.717612 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba061fd-0c18-4e37-b745-eee616a12799 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:50:28.728176 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba061fd-0c18-4e37-b745-eee616a12799 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:50:28.781155 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820af23b-19e9-4019-89be-59d8011ddec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:50:28.781812 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820af23b-19e9-4019-89be-59d8011ddec3 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:28.782098 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820af23b-19e9-4019-89be-59d8011ddec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:28.782453 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820af23b-19e9-4019-89be-59d8011ddec3 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:28.783141 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820af23b-19e9-4019-89be-59d8011ddec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:50:28.785088 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820af23b-19e9-4019-89be-59d8011ddec3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:50:28.805408 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1282/2568] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:50:28 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:50:28.809727 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306c84c-495b-4412-9dd9-fc2727461b43 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:50:28.821340 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306c84c-495b-4412-9dd9-fc2727461b43 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:50:28.826806 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad87e3d-fa96-4cbe-a409-585547f4365b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:50:28.827466 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad87e3d-fa96-4cbe-a409-585547f4365b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:28.827904 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad87e3d-fa96-4cbe-a409-585547f4365b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:28.828214 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad87e3d-fa96-4cbe-a409-585547f4365b admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:28.828957 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad87e3d-fa96-4cbe-a409-585547f4365b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:50:28.830595 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad87e3d-fa96-4cbe-a409-585547f4365b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:50:28.841266 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1287/2569] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:50:28.845291 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820af23b-19e9-4019-89be-59d8011ddec3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:50:28.855619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820af23b-19e9-4019-89be-59d8011ddec3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:50:28.860273 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309548d-4dc7-480e-b529-305b72983fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:50:28.860914 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309548d-4dc7-480e-b529-305b72983fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:28.861196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309548d-4dc7-480e-b529-305b72983fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:28.861474 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309548d-4dc7-480e-b529-305b72983fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:28.862200 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309548d-4dc7-480e-b529-305b72983fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:50:28.863803 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309548d-4dc7-480e-b529-305b72983fb6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:50:28.874281 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1283/2570] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:50:28.878225 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad87e3d-fa96-4cbe-a409-585547f4365b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:50:28.887927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad87e3d-fa96-4cbe-a409-585547f4365b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:50:28.892737 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4e0ae-bbf1-4470-b392-044fdd64129a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:50:28.893586 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4e0ae-bbf1-4470-b392-044fdd64129a admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:28.893862 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4e0ae-bbf1-4470-b392-044fdd64129a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:28.894132 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4e0ae-bbf1-4470-b392-044fdd64129a admin admin] PATH_INFO: `/v3/projects/9a449e431c5240b897d5cab55009fdbf/users/cd913a6397564f859fa9f1dd1edd4596/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:28.907983 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4e0ae-bbf1-4470-b392-044fdd64129a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a449e431c5240b897d5cab55009fdbf, user_id=cd913a6397564f859fa9f1dd1edd4596, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:50:28.910710 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4e0ae-bbf1-4470-b392-044fdd64129a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:50:28.923646 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1288/2571] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:50:28 2022] PUT /identity/v3/projects/9a449e431c5240b897d5cab55009fdbf/users/cd913a6397564f859fa9f1dd1edd4596/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:50:28.928741 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50636248-2413-4334-a508-4af223ea7019 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:28.929031 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50636248-2413-4334-a508-4af223ea7019 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:28.929317 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50636248-2413-4334-a508-4af223ea7019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:28.947312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-50636248-2413-4334-a508-4af223ea7019 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:50:28.948455 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-50636248-2413-4334-a508-4af223ea7019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:50:29.005084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1284/2572] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:50:29.014514 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4e0ae-bbf1-4470-b392-044fdd64129a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:50:29.016291 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-55b4e0ae-bbf1-4470-b392-044fdd64129a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:50:29.070301 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4e0ae-bbf1-4470-b392-044fdd64129a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:50:29.073905 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95448a21-6e23-40fc-8f42-766f1fb661b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:50:29.074538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95448a21-6e23-40fc-8f42-766f1fb661b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:29.074818 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95448a21-6e23-40fc-8f42-766f1fb661b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:29.075091 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95448a21-6e23-40fc-8f42-766f1fb661b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:29.085652 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95448a21-6e23-40fc-8f42-766f1fb661b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:50:29.087164 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95448a21-6e23-40fc-8f42-766f1fb661b1 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:50:29.096678 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1289/2573] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:50:33.043020 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d1d6b-27c8-465f-8d72-abd8261f9a8f None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:33.043540 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d1d6b-27c8-465f-8d72-abd8261f9a8f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:33.043628 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d1d6b-27c8-465f-8d72-abd8261f9a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:33.070492 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-6f9d1d6b-27c8-465f-8d72-abd8261f9a8f None None] MFA Rules not processed for user `cd913a6397564f859fa9f1dd1edd4596`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:50:33.072028 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6f9d1d6b-27c8-465f-8d72-abd8261f9a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:50:33.137419 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1285/2574] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:50:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:50:33.141871 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95448a21-6e23-40fc-8f42-766f1fb661b1 service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:50:33.152798 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95448a21-6e23-40fc-8f42-766f1fb661b1 service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:50:33.157745 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710d83d-2eb1-4953-8bd7-5afb515cb148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:50:33.158396 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710d83d-2eb1-4953-8bd7-5afb515cb148 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:33.158683 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710d83d-2eb1-4953-8bd7-5afb515cb148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:33.159090 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710d83d-2eb1-4953-8bd7-5afb515cb148 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:33.159842 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710d83d-2eb1-4953-8bd7-5afb515cb148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:50:33.162292 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710d83d-2eb1-4953-8bd7-5afb515cb148 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:50:33.210489 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1290/2575] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:50:33 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:50:33.214437 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d1d6b-27c8-465f-8d72-abd8261f9a8f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:50:33.228947 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d1d6b-27c8-465f-8d72-abd8261f9a8f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:50:33.287522 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796c071-83e9-4a52-a932-2386bba6c01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:50:33.288222 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796c071-83e9-4a52-a932-2386bba6c01c admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:33.288500 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796c071-83e9-4a52-a932-2386bba6c01c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:33.288770 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796c071-83e9-4a52-a932-2386bba6c01c admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:33.289479 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796c071-83e9-4a52-a932-2386bba6c01c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:50:33.291377 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796c071-83e9-4a52-a932-2386bba6c01c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:50:33.320256 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1286/2576] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:50:33 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:50:33.323834 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710d83d-2eb1-4953-8bd7-5afb515cb148 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:50:33.334870 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710d83d-2eb1-4953-8bd7-5afb515cb148 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:50:33.339745 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c054e3-4482-4278-bfd9-144fd3d4acba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:50:33.340519 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c054e3-4482-4278-bfd9-144fd3d4acba admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:33.340805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c054e3-4482-4278-bfd9-144fd3d4acba admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:33.341224 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c054e3-4482-4278-bfd9-144fd3d4acba admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:33.341976 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c054e3-4482-4278-bfd9-144fd3d4acba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:50:33.343642 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c054e3-4482-4278-bfd9-144fd3d4acba admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:50:33.356179 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1291/2577] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:50:33.360272 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796c071-83e9-4a52-a932-2386bba6c01c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:50:33.370917 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796c071-83e9-4a52-a932-2386bba6c01c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:50:33.376250 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130a2f7-2815-47d7-88c8-ba11906a382d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:50:33.377354 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130a2f7-2815-47d7-88c8-ba11906a382d admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:33.377638 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130a2f7-2815-47d7-88c8-ba11906a382d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:33.377973 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130a2f7-2815-47d7-88c8-ba11906a382d admin admin] PATH_INFO: `/v3/projects/b19ce5c3d7f341bcb5c8440adcc7ca49/users/9c1175ba0f2647c2b7b04ad667f9a8d1/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:33.395253 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130a2f7-2815-47d7-88c8-ba11906a382d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19ce5c3d7f341bcb5c8440adcc7ca49, user_id=9c1175ba0f2647c2b7b04ad667f9a8d1, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:50:33.398841 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130a2f7-2815-47d7-88c8-ba11906a382d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:50:33.413171 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1287/2578] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:50:33 2022] PUT /identity/v3/projects/b19ce5c3d7f341bcb5c8440adcc7ca49/users/9c1175ba0f2647c2b7b04ad667f9a8d1/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:50:33.417183 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c054e3-4482-4278-bfd9-144fd3d4acba admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:50:33.427379 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c054e3-4482-4278-bfd9-144fd3d4acba admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:50:33.486321 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c78557-801e-4d75-8450-f724728bc92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:50:33.486996 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c78557-801e-4d75-8450-f724728bc92f admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:33.487279 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c78557-801e-4d75-8450-f724728bc92f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:33.487558 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c78557-801e-4d75-8450-f724728bc92f admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:33.488340 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c78557-801e-4d75-8450-f724728bc92f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:50:33.489964 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c78557-801e-4d75-8450-f724728bc92f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:50:33.500541 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1292/2579] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:50:33.504753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130a2f7-2815-47d7-88c8-ba11906a382d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:50:33.516201 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130a2f7-2815-47d7-88c8-ba11906a382d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:50:33.521652 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac19aa-b76b-4ba0-96d9-6d328f8d5189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:50:33.522698 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac19aa-b76b-4ba0-96d9-6d328f8d5189 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:33.522977 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac19aa-b76b-4ba0-96d9-6d328f8d5189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:33.523258 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac19aa-b76b-4ba0-96d9-6d328f8d5189 admin admin] PATH_INFO: `/v3/projects/b19ce5c3d7f341bcb5c8440adcc7ca49/users/9c1175ba0f2647c2b7b04ad667f9a8d1/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:33.525323 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac19aa-b76b-4ba0-96d9-6d328f8d5189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19ce5c3d7f341bcb5c8440adcc7ca49, user_id=9c1175ba0f2647c2b7b04ad667f9a8d1, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:50:33.527992 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac19aa-b76b-4ba0-96d9-6d328f8d5189 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:50:33.539807 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1288/2580] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:50:33 2022] PUT /identity/v3/projects/b19ce5c3d7f341bcb5c8440adcc7ca49/users/9c1175ba0f2647c2b7b04ad667f9a8d1/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:50:37.913909 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807785eb-8660-4a46-9af9-2334d1b090e3 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:37.914881 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807785eb-8660-4a46-9af9-2334d1b090e3 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:37.915362 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807785eb-8660-4a46-9af9-2334d1b090e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:37.943351 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-807785eb-8660-4a46-9af9-2334d1b090e3 None None] MFA Rules not processed for user `9c1175ba0f2647c2b7b04ad667f9a8d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:50:37.944619 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-807785eb-8660-4a46-9af9-2334d1b090e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:50:38.024075 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1293/2581] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:50:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:50:38.027121 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac19aa-b76b-4ba0-96d9-6d328f8d5189 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:50:38.029471 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b5ac19aa-b76b-4ba0-96d9-6d328f8d5189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:50:38.110938 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac19aa-b76b-4ba0-96d9-6d328f8d5189 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:50:38.117092 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09930911-8f04-49ff-91ca-5e81463d8ffb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:50:38.117951 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09930911-8f04-49ff-91ca-5e81463d8ffb service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:50:38.118303 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09930911-8f04-49ff-91ca-5e81463d8ffb service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:50:38.118643 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09930911-8f04-49ff-91ca-5e81463d8ffb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:50:38.182093 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09930911-8f04-49ff-91ca-5e81463d8ffb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:50:38.183697 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09930911-8f04-49ff-91ca-5e81463d8ffb service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:50:38.193022 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1289/2582] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:50:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:51:01.905449 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c483f-552c-4fca-90aa-1e199eb921b8 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:01.905999 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c483f-552c-4fca-90aa-1e199eb921b8 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:01.905999 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c483f-552c-4fca-90aa-1e199eb921b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:01.923146 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-5a3c483f-552c-4fca-90aa-1e199eb921b8 None None] MFA Rules not processed for user `cd913a6397564f859fa9f1dd1edd4596`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:01.924349 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5a3c483f-552c-4fca-90aa-1e199eb921b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:01.931036 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1294/2583] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:02.242790 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09930911-8f04-49ff-91ca-5e81463d8ffb service nova] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:02.244263 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-09930911-8f04-49ff-91ca-5e81463d8ffb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:02.301437 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09930911-8f04-49ff-91ca-5e81463d8ffb service nova] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:02.304967 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45144fe-f931-42c0-a7d8-aeff1249ab82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:02.305615 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45144fe-f931-42c0-a7d8-aeff1249ab82 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:02.305902 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45144fe-f931-42c0-a7d8-aeff1249ab82 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:02.306178 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45144fe-f931-42c0-a7d8-aeff1249ab82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:02.307986 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f45144fe-f931-42c0-a7d8-aeff1249ab82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:02.318379 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45144fe-f931-42c0-a7d8-aeff1249ab82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:02.319832 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45144fe-f931-42c0-a7d8-aeff1249ab82 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:02.328298 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1290/2584] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:51:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:51:08.541588 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053c6df-55d6-4797-8d71-ac189faca061 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:08.542094 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053c6df-55d6-4797-8d71-ac189faca061 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:08.542185 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053c6df-55d6-4797-8d71-ac189faca061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:08.559549 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-4053c6df-55d6-4797-8d71-ac189faca061 None None] MFA Rules not processed for user `9761863f36284bd4be1ce29c86b631cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:08.560808 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-4053c6df-55d6-4797-8d71-ac189faca061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:08.616256 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1295/2585] 10.222.0.35 () {58 vars in 1009 bytes} [Tue Feb 8 16:51:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:08.629031 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45144fe-f931-42c0-a7d8-aeff1249ab82 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:08.630404 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f45144fe-f931-42c0-a7d8-aeff1249ab82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:08.701065 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45144fe-f931-42c0-a7d8-aeff1249ab82 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:08.706328 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb54fa-59a6-41af-987a-b34aadadbc11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00fd3c05cd8e4167946a1f567df2cc6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:08.707131 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb54fa-59a6-41af-987a-b34aadadbc11 service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:08.707417 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb54fa-59a6-41af-987a-b34aadadbc11 service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:08.707695 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb54fa-59a6-41af-987a-b34aadadbc11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:08.717658 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb54fa-59a6-41af-987a-b34aadadbc11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:08.719255 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb54fa-59a6-41af-987a-b34aadadbc11 service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:08.728240 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1291/2586] 10.222.0.35 () {60 vars in 1384 bytes} [Tue Feb 8 16:51:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:51:11.929930 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053c6df-55d6-4797-8d71-ac189faca061 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:11.943137 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053c6df-55d6-4797-8d71-ac189faca061 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:11.946937 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4677eaf-a05b-43f9-8371-f46bef0215ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:11.947881 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4677eaf-a05b-43f9-8371-f46bef0215ea service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:11.948376 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4677eaf-a05b-43f9-8371-f46bef0215ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:11.948891 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4677eaf-a05b-43f9-8371-f46bef0215ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:11.951243 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-c4677eaf-a05b-43f9-8371-f46bef0215ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:12.022868 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4677eaf-a05b-43f9-8371-f46bef0215ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:12.024653 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4677eaf-a05b-43f9-8371-f46bef0215ea service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:12.042350 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1296/2587] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:51:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:51:20.724332 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb54fa-59a6-41af-987a-b34aadadbc11 service swift] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:20.725872 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-fbeb54fa-59a6-41af-987a-b34aadadbc11 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:20.740631 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb54fa-59a6-41af-987a-b34aadadbc11 service swift] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:20.745172 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a254d-3e3b-4fe1-8e30-306eb125009e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:20.746034 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a254d-3e3b-4fe1-8e30-306eb125009e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:20.746316 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a254d-3e3b-4fe1-8e30-306eb125009e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:20.746744 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a254d-3e3b-4fe1-8e30-306eb125009e admin admin] PATH_INFO: `/v3/users/89bb4f5ad936444093f3115c65c441b1` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:20.748597 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a254d-3e3b-4fe1-8e30-306eb125009e admin admin] RBAC: Authorizing `identity:delete_user(user_id=89bb4f5ad936444093f3115c65c441b1)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:20.750504 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a254d-3e3b-4fe1-8e30-306eb125009e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:20.799431 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-cf8a254d-3e3b-4fe1-8e30-306eb125009e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89bb4f5ad936444093f3115c65c441b1'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:20.806041 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-cf8a254d-3e3b-4fe1-8e30-306eb125009e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89bb4f5ad936444093f3115c65c441b1'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:20.817293 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-cf8a254d-3e3b-4fe1-8e30-306eb125009e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89bb4f5ad936444093f3115c65c441b1'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:20.824949 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-cf8a254d-3e3b-4fe1-8e30-306eb125009e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89bb4f5ad936444093f3115c65c441b1'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:20.825704 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-cf8a254d-3e3b-4fe1-8e30-306eb125009e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89bb4f5ad936444093f3115c65c441b1'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:20.831639 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1292/2588] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:51:20 2022] DELETE /identity/v3/users/89bb4f5ad936444093f3115c65c441b1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:21.005772 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4677eaf-a05b-43f9-8371-f46bef0215ea service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:21.035136 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4677eaf-a05b-43f9-8371-f46bef0215ea service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:21.103568 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010ef5e-cebf-4668-a5d7-625b4bc23bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:21.104452 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010ef5e-cebf-4668-a5d7-625b4bc23bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:21.104734 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010ef5e-cebf-4668-a5d7-625b4bc23bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:21.105012 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010ef5e-cebf-4668-a5d7-625b4bc23bbd admin admin] PATH_INFO: `/v3/projects/08bc94fd80244144ae5883c54707e219` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:21.106319 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010ef5e-cebf-4668-a5d7-625b4bc23bbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=08bc94fd80244144ae5883c54707e219)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:21.108451 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010ef5e-cebf-4668-a5d7-625b4bc23bbd admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:21.157927 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a010ef5e-cebf-4668-a5d7-625b4bc23bbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08bc94fd80244144ae5883c54707e219', 'request_id': 'req-a010ef5e-cebf-4668-a5d7-625b4bc23bbd'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:21.164569 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a010ef5e-cebf-4668-a5d7-625b4bc23bbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08bc94fd80244144ae5883c54707e219', 'request_id': 'req-a010ef5e-cebf-4668-a5d7-625b4bc23bbd'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:21.170401 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a010ef5e-cebf-4668-a5d7-625b4bc23bbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08bc94fd80244144ae5883c54707e219', 'request_id': 'req-a010ef5e-cebf-4668-a5d7-625b4bc23bbd'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:21.183072 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a010ef5e-cebf-4668-a5d7-625b4bc23bbd admin admin] The token cache is being invalidate because project 08bc94fd80244144ae5883c54707e219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:51:21.183361 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a010ef5e-cebf-4668-a5d7-625b4bc23bbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:21.184036 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a010ef5e-cebf-4668-a5d7-625b4bc23bbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:21.185570 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1297/2589] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:51:21 2022] DELETE /identity/v3/projects/08bc94fd80244144ae5883c54707e219 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:21.189747 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a254d-3e3b-4fe1-8e30-306eb125009e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:21.191224 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cf8a254d-3e3b-4fe1-8e30-306eb125009e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:21.205091 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a254d-3e3b-4fe1-8e30-306eb125009e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:21.263337 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099f00e-e9e2-4f74-a192-1aed25283fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:21.264370 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099f00e-e9e2-4f74-a192-1aed25283fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:21.264659 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099f00e-e9e2-4f74-a192-1aed25283fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:21.264935 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099f00e-e9e2-4f74-a192-1aed25283fc6 admin admin] PATH_INFO: `/v3/users/56e64690bf104eb88a94ac47a641c859` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:21.266341 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099f00e-e9e2-4f74-a192-1aed25283fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e64690bf104eb88a94ac47a641c859)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:21.268481 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099f00e-e9e2-4f74-a192-1aed25283fc6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:21.319359 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6099f00e-e9e2-4f74-a192-1aed25283fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e64690bf104eb88a94ac47a641c859'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:21.326744 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6099f00e-e9e2-4f74-a192-1aed25283fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e64690bf104eb88a94ac47a641c859'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:21.338695 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6099f00e-e9e2-4f74-a192-1aed25283fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e64690bf104eb88a94ac47a641c859'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:21.346714 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6099f00e-e9e2-4f74-a192-1aed25283fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e64690bf104eb88a94ac47a641c859'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:21.347397 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6099f00e-e9e2-4f74-a192-1aed25283fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e64690bf104eb88a94ac47a641c859'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:21.353673 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1293/2590] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:51:21 2022] DELETE /identity/v3/users/56e64690bf104eb88a94ac47a641c859 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:21.526337 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010ef5e-cebf-4668-a5d7-625b4bc23bbd admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:21.527911 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a010ef5e-cebf-4668-a5d7-625b4bc23bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:21.541020 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010ef5e-cebf-4668-a5d7-625b4bc23bbd admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:21.597612 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22e608-481b-4e27-816a-454b6b7d0e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:21.598460 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22e608-481b-4e27-816a-454b6b7d0e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:21.598740 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22e608-481b-4e27-816a-454b6b7d0e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:21.599013 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22e608-481b-4e27-816a-454b6b7d0e20 admin admin] PATH_INFO: `/v3/projects/6a212c4539cf48b19dc8c97b9373be6f` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:21.600257 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22e608-481b-4e27-816a-454b6b7d0e20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a212c4539cf48b19dc8c97b9373be6f)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:21.602132 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22e608-481b-4e27-816a-454b6b7d0e20 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:21.648983 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ca22e608-481b-4e27-816a-454b6b7d0e20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a212c4539cf48b19dc8c97b9373be6f', 'request_id': 'req-ca22e608-481b-4e27-816a-454b6b7d0e20'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:21.657703 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ca22e608-481b-4e27-816a-454b6b7d0e20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a212c4539cf48b19dc8c97b9373be6f', 'request_id': 'req-ca22e608-481b-4e27-816a-454b6b7d0e20'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:21.666011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ca22e608-481b-4e27-816a-454b6b7d0e20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a212c4539cf48b19dc8c97b9373be6f', 'request_id': 'req-ca22e608-481b-4e27-816a-454b6b7d0e20'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:21.681109 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ca22e608-481b-4e27-816a-454b6b7d0e20 admin admin] The token cache is being invalidate because project 6a212c4539cf48b19dc8c97b9373be6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:51:21.681559 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ca22e608-481b-4e27-816a-454b6b7d0e20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:21.682225 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ca22e608-481b-4e27-816a-454b6b7d0e20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:21.684852 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1298/2591] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:51:21 2022] DELETE /identity/v3/projects/6a212c4539cf48b19dc8c97b9373be6f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:23.279813 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099f00e-e9e2-4f74-a192-1aed25283fc6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:23.281281 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6099f00e-e9e2-4f74-a192-1aed25283fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:23.338344 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099f00e-e9e2-4f74-a192-1aed25283fc6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:23.385993 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7568bb-eb9f-46a4-a565-6bfa0a135bdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:23.386633 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7568bb-eb9f-46a4-a565-6bfa0a135bdb service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:23.387585 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7568bb-eb9f-46a4-a565-6bfa0a135bdb service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:23.387776 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7568bb-eb9f-46a4-a565-6bfa0a135bdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:23.389481 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3b7568bb-eb9f-46a4-a565-6bfa0a135bdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:23.448712 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7568bb-eb9f-46a4-a565-6bfa0a135bdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:23.450703 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7568bb-eb9f-46a4-a565-6bfa0a135bdb service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:23.460073 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1294/2592] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:51:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:51:25.169150 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b243d-e001-4b47-885e-43821d47187c None None] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:25.169982 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b243d-e001-4b47-885e-43821d47187c None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:25.170423 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b243d-e001-4b47-885e-43821d47187c None None] PATH_INFO: `/` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:25.172255 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1299/2593] 10.222.0.35 () {54 vars in 921 bytes} [Tue Feb 8 16:51:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 08 16:51:25.179255 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a596f-293a-48fa-b9e1-5dd3bd5191fe None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:25.179813 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a596f-293a-48fa-b9e1-5dd3bd5191fe None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:25.180050 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a596f-293a-48fa-b9e1-5dd3bd5191fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:25.201650 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d80a596f-293a-48fa-b9e1-5dd3bd5191fe None None] MFA Rules not processed for user `ccb02e5d8ef14f8f85bbacfa5b1f5be3`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:25.203277 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d80a596f-293a-48fa-b9e1-5dd3bd5191fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:25.276464 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1295/2594] 10.222.0.35 () {58 vars in 1018 bytes} [Tue Feb 8 16:51:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:25.294020 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b243d-e001-4b47-885e-43821d47187c None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:25.296341 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-fa7b243d-e001-4b47-885e-43821d47187c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:25.360024 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b243d-e001-4b47-885e-43821d47187c None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:25.364089 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdac155-790c-42d9-9b74-089ea81621d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10453496872a45a9867fc6a13a13de49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:25.364877 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdac155-790c-42d9-9b74-089ea81621d9 service glance] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:25.365001 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdac155-790c-42d9-9b74-089ea81621d9 service glance] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:25.365529 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdac155-790c-42d9-9b74-089ea81621d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:25.379208 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdac155-790c-42d9-9b74-089ea81621d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:25.380670 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdac155-790c-42d9-9b74-089ea81621d9 service glance] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:25.392533 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1300/2595] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:51:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:51:27.403384 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5208fc-fc67-4139-8678-b06e754fef9e None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:27.404023 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5208fc-fc67-4139-8678-b06e754fef9e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:27.404023 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5208fc-fc67-4139-8678-b06e754fef9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:27.422844 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-6e5208fc-fc67-4139-8678-b06e754fef9e None None] MFA Rules not processed for user `9761863f36284bd4be1ce29c86b631cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:27.424077 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6e5208fc-fc67-4139-8678-b06e754fef9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:27.482054 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1296/2596] 10.222.0.35 () {58 vars in 1009 bytes} [Tue Feb 8 16:51:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:27.503685 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdac155-790c-42d9-9b74-089ea81621d9 service glance] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:27.505174 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-ffdac155-790c-42d9-9b74-089ea81621d9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:27.573188 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdac155-790c-42d9-9b74-089ea81621d9 service glance] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:27.578833 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dba60-2f95-49d0-8793-6e891a4e9615 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00fd3c05cd8e4167946a1f567df2cc6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:27.579735 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dba60-2f95-49d0-8793-6e891a4e9615 service swift] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:27.580246 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dba60-2f95-49d0-8793-6e891a4e9615 service swift] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:27.580246 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dba60-2f95-49d0-8793-6e891a4e9615 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:27.591015 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91dba60-2f95-49d0-8793-6e891a4e9615 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:27.592338 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91dba60-2f95-49d0-8793-6e891a4e9615 service swift] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:27.602108 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1301/2597] 10.222.0.35 () {60 vars in 1384 bytes} [Tue Feb 8 16:51:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:51:32.282178 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5208fc-fc67-4139-8678-b06e754fef9e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:32.283624 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6e5208fc-fc67-4139-8678-b06e754fef9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:32.295801 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5208fc-fc67-4139-8678-b06e754fef9e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:32.299418 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc66ad-1fab-44a7-8a39-4ac0f739f2cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:32.300090 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc66ad-1fab-44a7-8a39-4ac0f739f2cb service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:32.300372 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc66ad-1fab-44a7-8a39-4ac0f739f2cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:32.300648 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc66ad-1fab-44a7-8a39-4ac0f739f2cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:32.302415 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e6dc66ad-1fab-44a7-8a39-4ac0f739f2cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:32.372023 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc66ad-1fab-44a7-8a39-4ac0f739f2cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:32.374106 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc66ad-1fab-44a7-8a39-4ac0f739f2cb service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:32.389636 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1297/2598] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:51:34.133328 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dba60-2f95-49d0-8793-6e891a4e9615 service swift] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:34.137763 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a91dba60-2f95-49d0-8793-6e891a4e9615 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:34.162877 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dba60-2f95-49d0-8793-6e891a4e9615 service swift] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:34.173018 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0ea3e-c40d-4b13-809b-9aac6e24b1bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:34.175185 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0ea3e-c40d-4b13-809b-9aac6e24b1bd service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:34.180045 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0ea3e-c40d-4b13-809b-9aac6e24b1bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:34.180671 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0ea3e-c40d-4b13-809b-9aac6e24b1bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:34.185605 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5bc0ea3e-c40d-4b13-809b-9aac6e24b1bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:34.227520 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0ea3e-c40d-4b13-809b-9aac6e24b1bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:34.229364 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0ea3e-c40d-4b13-809b-9aac6e24b1bd service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:34.252700 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1302/2599] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:51:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:51:35.586819 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc66ad-1fab-44a7-8a39-4ac0f739f2cb service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:35.596949 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc66ad-1fab-44a7-8a39-4ac0f739f2cb service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:35.604003 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa9a52-e035-405c-b075-5038232eac62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:35.604720 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa9a52-e035-405c-b075-5038232eac62 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:35.605008 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa9a52-e035-405c-b075-5038232eac62 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:35.605322 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa9a52-e035-405c-b075-5038232eac62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:35.607945 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-aafa9a52-e035-405c-b075-5038232eac62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:35.623667 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa9a52-e035-405c-b075-5038232eac62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:35.625148 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa9a52-e035-405c-b075-5038232eac62 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:35.637455 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1298/2600] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:51:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:51:35.949714 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0ea3e-c40d-4b13-809b-9aac6e24b1bd service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:35.951091 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5bc0ea3e-c40d-4b13-809b-9aac6e24b1bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:35.966341 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0ea3e-c40d-4b13-809b-9aac6e24b1bd service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:35.970977 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ac3fd-b89f-4812-9b79-957331c629ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:35.972084 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ac3fd-b89f-4812-9b79-957331c629ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:35.972420 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ac3fd-b89f-4812-9b79-957331c629ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:35.972820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ac3fd-b89f-4812-9b79-957331c629ea admin admin] PATH_INFO: `/v3/users/c5f36415ea7148d79f9fdb9cfac129e0` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:35.989727 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ac3fd-b89f-4812-9b79-957331c629ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f36415ea7148d79f9fdb9cfac129e0)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:35.991717 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ac3fd-b89f-4812-9b79-957331c629ea admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:36.039424 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5b3ac3fd-b89f-4812-9b79-957331c629ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f36415ea7148d79f9fdb9cfac129e0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:36.051593 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5b3ac3fd-b89f-4812-9b79-957331c629ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f36415ea7148d79f9fdb9cfac129e0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:36.059009 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5b3ac3fd-b89f-4812-9b79-957331c629ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f36415ea7148d79f9fdb9cfac129e0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:36.067112 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5b3ac3fd-b89f-4812-9b79-957331c629ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f36415ea7148d79f9fdb9cfac129e0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:36.067722 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5b3ac3fd-b89f-4812-9b79-957331c629ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f36415ea7148d79f9fdb9cfac129e0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:36.073822 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1303/2601] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:51:35 2022] DELETE /identity/v3/users/c5f36415ea7148d79f9fdb9cfac129e0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:36.245172 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa9a52-e035-405c-b075-5038232eac62 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:36.259084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa9a52-e035-405c-b075-5038232eac62 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:36.320798 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4194fe-e56b-4028-aab8-4bee0d26d926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:36.322058 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4194fe-e56b-4028-aab8-4bee0d26d926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:36.322338 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4194fe-e56b-4028-aab8-4bee0d26d926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:36.322705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4194fe-e56b-4028-aab8-4bee0d26d926 admin admin] PATH_INFO: `/v3/projects/2214758b43e6434b8c27d97f7fd1151c` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:36.333317 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4194fe-e56b-4028-aab8-4bee0d26d926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2214758b43e6434b8c27d97f7fd1151c)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:36.335257 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4194fe-e56b-4028-aab8-4bee0d26d926 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:36.379047 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8c4194fe-e56b-4028-aab8-4bee0d26d926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2214758b43e6434b8c27d97f7fd1151c', 'request_id': 'req-8c4194fe-e56b-4028-aab8-4bee0d26d926'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:36.385273 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8c4194fe-e56b-4028-aab8-4bee0d26d926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2214758b43e6434b8c27d97f7fd1151c', 'request_id': 'req-8c4194fe-e56b-4028-aab8-4bee0d26d926'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:36.390542 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8c4194fe-e56b-4028-aab8-4bee0d26d926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2214758b43e6434b8c27d97f7fd1151c', 'request_id': 'req-8c4194fe-e56b-4028-aab8-4bee0d26d926'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:36.402650 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8c4194fe-e56b-4028-aab8-4bee0d26d926 admin admin] The token cache is being invalidate because project 2214758b43e6434b8c27d97f7fd1151c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:51:36.402956 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8c4194fe-e56b-4028-aab8-4bee0d26d926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:36.403700 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8c4194fe-e56b-4028-aab8-4bee0d26d926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:36.405231 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1299/2602] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:51:36 2022] DELETE /identity/v3/projects/2214758b43e6434b8c27d97f7fd1151c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:36.410844 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b45625-a096-49ee-9632-a2c749ce6662 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:36.411130 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b45625-a096-49ee-9632-a2c749ce6662 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:36.411404 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b45625-a096-49ee-9632-a2c749ce6662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:36.430172 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-81b45625-a096-49ee-9632-a2c749ce6662 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:36.431345 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-81b45625-a096-49ee-9632-a2c749ce6662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:36.497220 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1304/2603] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:36.505494 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810f0fd-dcf6-4dac-ab83-66d83fb6ae83 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:36.505779 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810f0fd-dcf6-4dac-ab83-66d83fb6ae83 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:36.506055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810f0fd-dcf6-4dac-ab83-66d83fb6ae83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:36.523712 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2810f0fd-dcf6-4dac-ab83-66d83fb6ae83 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:36.524940 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2810f0fd-dcf6-4dac-ab83-66d83fb6ae83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:36.532720 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1300/2604] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:36.536849 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b45625-a096-49ee-9632-a2c749ce6662 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:36.546659 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b45625-a096-49ee-9632-a2c749ce6662 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:36.551211 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e4abb-2c52-4881-8f86-4ca79a267240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:36.551886 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e4abb-2c52-4881-8f86-4ca79a267240 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:36.552171 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e4abb-2c52-4881-8f86-4ca79a267240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:36.552446 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e4abb-2c52-4881-8f86-4ca79a267240 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:36.553172 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e4abb-2c52-4881-8f86-4ca79a267240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:51:36.553475 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e4abb-2c52-4881-8f86-4ca79a267240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:36.555044 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e4abb-2c52-4881-8f86-4ca79a267240 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:36.567056 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1305/2605] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:51:36.571212 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810f0fd-dcf6-4dac-ab83-66d83fb6ae83 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:36.580983 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810f0fd-dcf6-4dac-ab83-66d83fb6ae83 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:36.585520 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b0dd1-d5d6-430f-9e20-80a310c36b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:36.586155 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b0dd1-d5d6-430f-9e20-80a310c36b96 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:36.586431 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b0dd1-d5d6-430f-9e20-80a310c36b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:36.586701 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b0dd1-d5d6-430f-9e20-80a310c36b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:36.587397 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b0dd1-d5d6-430f-9e20-80a310c36b96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:36.589312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b0dd1-d5d6-430f-9e20-80a310c36b96 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:36.614732 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1301/2606] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:51:36 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:51:36.618936 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e4abb-2c52-4881-8f86-4ca79a267240 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:36.629546 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e4abb-2c52-4881-8f86-4ca79a267240 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:36.683147 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f651d0-f0b5-4f2c-a15b-de5b4c2d1bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:36.684409 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f651d0-f0b5-4f2c-a15b-de5b4c2d1bcb admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:36.684631 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f651d0-f0b5-4f2c-a15b-de5b4c2d1bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:36.684916 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f651d0-f0b5-4f2c-a15b-de5b4c2d1bcb admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:36.685596 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f651d0-f0b5-4f2c-a15b-de5b4c2d1bcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:36.687497 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f651d0-f0b5-4f2c-a15b-de5b4c2d1bcb admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:36.706700 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1306/2607] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:51:36 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:51:36.710676 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b0dd1-d5d6-430f-9e20-80a310c36b96 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:36.720815 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b0dd1-d5d6-430f-9e20-80a310c36b96 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:36.725435 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315594d3-4c9d-4ad1-97f7-910e935562f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:36.726081 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315594d3-4c9d-4ad1-97f7-910e935562f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:36.726365 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315594d3-4c9d-4ad1-97f7-910e935562f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:36.726640 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315594d3-4c9d-4ad1-97f7-910e935562f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:36.727368 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315594d3-4c9d-4ad1-97f7-910e935562f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:36.728976 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315594d3-4c9d-4ad1-97f7-910e935562f4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:36.739036 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1302/2608] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:51:36.742720 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f651d0-f0b5-4f2c-a15b-de5b4c2d1bcb admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:36.753221 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f651d0-f0b5-4f2c-a15b-de5b4c2d1bcb admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:36.757871 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eaecb5-3481-4b77-9006-aeb6430af683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:36.758506 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eaecb5-3481-4b77-9006-aeb6430af683 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:36.758787 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eaecb5-3481-4b77-9006-aeb6430af683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:36.759059 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eaecb5-3481-4b77-9006-aeb6430af683 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:36.759817 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eaecb5-3481-4b77-9006-aeb6430af683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:36.761403 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eaecb5-3481-4b77-9006-aeb6430af683 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:36.770933 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1307/2609] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:51:36.774832 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315594d3-4c9d-4ad1-97f7-910e935562f4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:36.785017 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315594d3-4c9d-4ad1-97f7-910e935562f4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:36.789705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a1542-63b8-4721-af38-bbe8ffd10b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:36.790569 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a1542-63b8-4721-af38-bbe8ffd10b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:36.790850 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a1542-63b8-4721-af38-bbe8ffd10b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:36.791130 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a1542-63b8-4721-af38-bbe8ffd10b4e admin admin] PATH_INFO: `/v3/projects/fd682906e681485bbf81138a8b854dd6/users/57856e78fa314e81959e870ac53bfcaa/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:36.806321 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a1542-63b8-4721-af38-bbe8ffd10b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd682906e681485bbf81138a8b854dd6, user_id=57856e78fa314e81959e870ac53bfcaa, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:36.809944 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a1542-63b8-4721-af38-bbe8ffd10b4e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:36.824097 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1303/2610] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:51:36 2022] PUT /identity/v3/projects/fd682906e681485bbf81138a8b854dd6/users/57856e78fa314e81959e870ac53bfcaa/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:36.834155 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebc225-5e75-4810-89e8-7bf0948d563b None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:36.834447 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebc225-5e75-4810-89e8-7bf0948d563b None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:36.834721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebc225-5e75-4810-89e8-7bf0948d563b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:36.862627 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-64ebc225-5e75-4810-89e8-7bf0948d563b None None] MFA Rules not processed for user `57856e78fa314e81959e870ac53bfcaa`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:36.863879 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-64ebc225-5e75-4810-89e8-7bf0948d563b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:36.930118 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1308/2611] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:36.931274 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a1542-63b8-4721-af38-bbe8ffd10b4e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:36.990942 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a1542-63b8-4721-af38-bbe8ffd10b4e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:36.995561 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb46fbf-e052-47c4-ad98-e72798e885cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:36.996825 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb46fbf-e052-47c4-ad98-e72798e885cc admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:36.997107 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb46fbf-e052-47c4-ad98-e72798e885cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:36.997380 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb46fbf-e052-47c4-ad98-e72798e885cc admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:36.998373 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb46fbf-e052-47c4-ad98-e72798e885cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:37.000280 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb46fbf-e052-47c4-ad98-e72798e885cc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:37.024693 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1304/2612] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:51:36 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:51:37.028980 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebc225-5e75-4810-89e8-7bf0948d563b None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:37.039800 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebc225-5e75-4810-89e8-7bf0948d563b None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:37.094566 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf715fa2-331d-4a09-a49f-157864f44e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:37.095220 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf715fa2-331d-4a09-a49f-157864f44e75 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:37.095496 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf715fa2-331d-4a09-a49f-157864f44e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:37.095820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf715fa2-331d-4a09-a49f-157864f44e75 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:37.096525 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf715fa2-331d-4a09-a49f-157864f44e75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:37.098411 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf715fa2-331d-4a09-a49f-157864f44e75 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:37.117906 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1309/2613] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:51:37 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:51:37.122373 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb46fbf-e052-47c4-ad98-e72798e885cc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:37.132929 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb46fbf-e052-47c4-ad98-e72798e885cc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:37.137872 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f52b0-b949-4e0b-bc5f-719ee581a89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:37.138515 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f52b0-b949-4e0b-bc5f-719ee581a89d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:37.138798 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f52b0-b949-4e0b-bc5f-719ee581a89d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:37.139074 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f52b0-b949-4e0b-bc5f-719ee581a89d admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:37.139842 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f52b0-b949-4e0b-bc5f-719ee581a89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:37.141426 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f52b0-b949-4e0b-bc5f-719ee581a89d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:37.151591 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1305/2614] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:51:37.156332 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf715fa2-331d-4a09-a49f-157864f44e75 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:37.166581 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf715fa2-331d-4a09-a49f-157864f44e75 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:37.171773 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b27455-cab0-4dca-8000-3b0545a32cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:37.172648 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b27455-cab0-4dca-8000-3b0545a32cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:37.172956 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b27455-cab0-4dca-8000-3b0545a32cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:37.173215 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b27455-cab0-4dca-8000-3b0545a32cd5 admin admin] PATH_INFO: `/v3/projects/6d45c882ba5c4e87a5ad0179f8c4992f/users/7cb3d450a3bf42dab644e2f6b14bee3c/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:37.188075 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b27455-cab0-4dca-8000-3b0545a32cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d45c882ba5c4e87a5ad0179f8c4992f, user_id=7cb3d450a3bf42dab644e2f6b14bee3c, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:37.190930 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b27455-cab0-4dca-8000-3b0545a32cd5 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:37.203574 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1310/2615] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:51:37 2022] PUT /identity/v3/projects/6d45c882ba5c4e87a5ad0179f8c4992f/users/7cb3d450a3bf42dab644e2f6b14bee3c/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:37.207651 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f52b0-b949-4e0b-bc5f-719ee581a89d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:37.217560 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f52b0-b949-4e0b-bc5f-719ee581a89d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:37.270993 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492c338-0a29-496a-8fb6-585798b25f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:37.271653 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492c338-0a29-496a-8fb6-585798b25f26 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:37.271964 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492c338-0a29-496a-8fb6-585798b25f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:37.272239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492c338-0a29-496a-8fb6-585798b25f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:37.273243 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492c338-0a29-496a-8fb6-585798b25f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:37.274827 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492c338-0a29-496a-8fb6-585798b25f26 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:37.284464 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1306/2616] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:51:37.288694 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b27455-cab0-4dca-8000-3b0545a32cd5 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:37.299318 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b27455-cab0-4dca-8000-3b0545a32cd5 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:37.304038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041eba1-9e40-4da4-b269-c304fd11e32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:37.304952 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041eba1-9e40-4da4-b269-c304fd11e32a admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:37.305228 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041eba1-9e40-4da4-b269-c304fd11e32a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:37.305499 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041eba1-9e40-4da4-b269-c304fd11e32a admin admin] PATH_INFO: `/v3/projects/6d45c882ba5c4e87a5ad0179f8c4992f/users/7cb3d450a3bf42dab644e2f6b14bee3c/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:37.307495 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041eba1-9e40-4da4-b269-c304fd11e32a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d45c882ba5c4e87a5ad0179f8c4992f, user_id=7cb3d450a3bf42dab644e2f6b14bee3c, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:37.310850 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041eba1-9e40-4da4-b269-c304fd11e32a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:37.320976 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1311/2617] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:51:37 2022] PUT /identity/v3/projects/6d45c882ba5c4e87a5ad0179f8c4992f/users/7cb3d450a3bf42dab644e2f6b14bee3c/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:37.332873 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6f7f0-08a7-47cb-85b4-a6845125e8d7 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:37.333161 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6f7f0-08a7-47cb-85b4-a6845125e8d7 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:37.333435 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6f7f0-08a7-47cb-85b4-a6845125e8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:37.358816 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d8a6f7f0-08a7-47cb-85b4-a6845125e8d7 None None] MFA Rules not processed for user `7cb3d450a3bf42dab644e2f6b14bee3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:37.360055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d8a6f7f0-08a7-47cb-85b4-a6845125e8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:37.424311 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1307/2618] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:37.436263 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041eba1-9e40-4da4-b269-c304fd11e32a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:37.437970 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-4041eba1-9e40-4da4-b269-c304fd11e32a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:37.494085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041eba1-9e40-4da4-b269-c304fd11e32a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:37.498692 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5ffd5-eb15-467c-adab-289620d18614 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:37.499324 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5ffd5-eb15-467c-adab-289620d18614 service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:37.499604 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5ffd5-eb15-467c-adab-289620d18614 service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:37.499911 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5ffd5-eb15-467c-adab-289620d18614 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:37.508773 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5ffd5-eb15-467c-adab-289620d18614 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:37.510190 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5ffd5-eb15-467c-adab-289620d18614 service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:37.519420 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1312/2619] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:51:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:51:37.873778 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6f7f0-08a7-47cb-85b4-a6845125e8d7 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:37.932500 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6f7f0-08a7-47cb-85b4-a6845125e8d7 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:37.937504 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e902ede-c298-4c0e-af21-97a1d6ecc359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:37.938347 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e902ede-c298-4c0e-af21-97a1d6ecc359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:37.938622 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e902ede-c298-4c0e-af21-97a1d6ecc359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:37.938888 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e902ede-c298-4c0e-af21-97a1d6ecc359 admin admin] PATH_INFO: `/v3/users/57856e78fa314e81959e870ac53bfcaa` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:37.940098 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e902ede-c298-4c0e-af21-97a1d6ecc359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57856e78fa314e81959e870ac53bfcaa)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:37.941996 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e902ede-c298-4c0e-af21-97a1d6ecc359 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:37.986257 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5e902ede-c298-4c0e-af21-97a1d6ecc359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57856e78fa314e81959e870ac53bfcaa'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:37.992964 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5e902ede-c298-4c0e-af21-97a1d6ecc359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57856e78fa314e81959e870ac53bfcaa'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:38.005863 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5e902ede-c298-4c0e-af21-97a1d6ecc359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57856e78fa314e81959e870ac53bfcaa'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:38.014728 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5e902ede-c298-4c0e-af21-97a1d6ecc359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57856e78fa314e81959e870ac53bfcaa'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:38.015369 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5e902ede-c298-4c0e-af21-97a1d6ecc359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57856e78fa314e81959e870ac53bfcaa'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:38.021468 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1308/2620] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:51:37 2022] DELETE /identity/v3/users/57856e78fa314e81959e870ac53bfcaa => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:38.026011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5feef-cff6-461a-8c7b-725d9cd34d57 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:38.026298 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5feef-cff6-461a-8c7b-725d9cd34d57 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:38.026577 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5feef-cff6-461a-8c7b-725d9cd34d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:38.044392 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-12d5feef-cff6-461a-8c7b-725d9cd34d57 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:38.045586 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-12d5feef-cff6-461a-8c7b-725d9cd34d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:38.103676 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1313/2621] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:38.113385 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e902ede-c298-4c0e-af21-97a1d6ecc359 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:38.114779 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5e902ede-c298-4c0e-af21-97a1d6ecc359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:38.172079 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e902ede-c298-4c0e-af21-97a1d6ecc359 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:38.175838 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8357b8-9fe0-4c80-828f-97278d42df40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:38.176484 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8357b8-9fe0-4c80-828f-97278d42df40 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:38.176773 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8357b8-9fe0-4c80-828f-97278d42df40 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:38.177049 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8357b8-9fe0-4c80-828f-97278d42df40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:38.186945 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8357b8-9fe0-4c80-828f-97278d42df40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:38.188371 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8357b8-9fe0-4c80-828f-97278d42df40 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:38.197823 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1309/2622] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:51:38.458747 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5feef-cff6-461a-8c7b-725d9cd34d57 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:38.460209 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-12d5feef-cff6-461a-8c7b-725d9cd34d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:38.474179 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5feef-cff6-461a-8c7b-725d9cd34d57 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:38.479096 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a85c8b-2e8d-4116-b580-a414f0e93e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:38.480234 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a85c8b-2e8d-4116-b580-a414f0e93e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:38.480586 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a85c8b-2e8d-4116-b580-a414f0e93e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:38.480863 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a85c8b-2e8d-4116-b580-a414f0e93e2d admin admin] PATH_INFO: `/v3/projects/fd682906e681485bbf81138a8b854dd6` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:38.482061 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a85c8b-2e8d-4116-b580-a414f0e93e2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd682906e681485bbf81138a8b854dd6)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:38.484795 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a85c8b-2e8d-4116-b580-a414f0e93e2d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:38.531999 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-33a85c8b-2e8d-4116-b580-a414f0e93e2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd682906e681485bbf81138a8b854dd6', 'request_id': 'req-33a85c8b-2e8d-4116-b580-a414f0e93e2d'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:38.538023 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-33a85c8b-2e8d-4116-b580-a414f0e93e2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd682906e681485bbf81138a8b854dd6', 'request_id': 'req-33a85c8b-2e8d-4116-b580-a414f0e93e2d'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:38.543400 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-33a85c8b-2e8d-4116-b580-a414f0e93e2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd682906e681485bbf81138a8b854dd6', 'request_id': 'req-33a85c8b-2e8d-4116-b580-a414f0e93e2d'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:38.555709 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-33a85c8b-2e8d-4116-b580-a414f0e93e2d admin admin] The token cache is being invalidate because project fd682906e681485bbf81138a8b854dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:51:38.556089 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-33a85c8b-2e8d-4116-b580-a414f0e93e2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:38.556707 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-33a85c8b-2e8d-4116-b580-a414f0e93e2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:38.558289 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1314/2623] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:51:38 2022] DELETE /identity/v3/projects/fd682906e681485bbf81138a8b854dd6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:38.562621 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8357b8-9fe0-4c80-828f-97278d42df40 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:38.571965 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8357b8-9fe0-4c80-828f-97278d42df40 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:38.626789 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397a584-42fb-492d-a6aa-f505fb02c22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:38.627638 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397a584-42fb-492d-a6aa-f505fb02c22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:38.627958 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397a584-42fb-492d-a6aa-f505fb02c22b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:38.628232 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397a584-42fb-492d-a6aa-f505fb02c22b admin admin] PATH_INFO: `/v3/users/7cb3d450a3bf42dab644e2f6b14bee3c` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:38.629448 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397a584-42fb-492d-a6aa-f505fb02c22b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cb3d450a3bf42dab644e2f6b14bee3c)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:38.631370 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397a584-42fb-492d-a6aa-f505fb02c22b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:38.674295 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c397a584-42fb-492d-a6aa-f505fb02c22b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb3d450a3bf42dab644e2f6b14bee3c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:38.681229 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c397a584-42fb-492d-a6aa-f505fb02c22b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb3d450a3bf42dab644e2f6b14bee3c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:38.692945 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c397a584-42fb-492d-a6aa-f505fb02c22b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb3d450a3bf42dab644e2f6b14bee3c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:38.701505 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c397a584-42fb-492d-a6aa-f505fb02c22b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb3d450a3bf42dab644e2f6b14bee3c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:38.702135 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c397a584-42fb-492d-a6aa-f505fb02c22b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb3d450a3bf42dab644e2f6b14bee3c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:38.708026 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1310/2624] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:51:38 2022] DELETE /identity/v3/users/7cb3d450a3bf42dab644e2f6b14bee3c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:38.969675 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a85c8b-2e8d-4116-b580-a414f0e93e2d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:38.971183 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-33a85c8b-2e8d-4116-b580-a414f0e93e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:38.985641 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a85c8b-2e8d-4116-b580-a414f0e93e2d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:39.041023 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c9581-e56c-4c50-a16d-0b17d2ec42ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:39.041869 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c9581-e56c-4c50-a16d-0b17d2ec42ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:39.042146 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c9581-e56c-4c50-a16d-0b17d2ec42ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:39.042418 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c9581-e56c-4c50-a16d-0b17d2ec42ce admin admin] PATH_INFO: `/v3/projects/6d45c882ba5c4e87a5ad0179f8c4992f` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:39.044166 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c9581-e56c-4c50-a16d-0b17d2ec42ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d45c882ba5c4e87a5ad0179f8c4992f)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:39.046044 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c9581-e56c-4c50-a16d-0b17d2ec42ce admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:39.090168 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-6e6c9581-e56c-4c50-a16d-0b17d2ec42ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d45c882ba5c4e87a5ad0179f8c4992f', 'request_id': 'req-6e6c9581-e56c-4c50-a16d-0b17d2ec42ce'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:39.096014 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-6e6c9581-e56c-4c50-a16d-0b17d2ec42ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d45c882ba5c4e87a5ad0179f8c4992f', 'request_id': 'req-6e6c9581-e56c-4c50-a16d-0b17d2ec42ce'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:39.101182 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-6e6c9581-e56c-4c50-a16d-0b17d2ec42ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d45c882ba5c4e87a5ad0179f8c4992f', 'request_id': 'req-6e6c9581-e56c-4c50-a16d-0b17d2ec42ce'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:39.112805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-6e6c9581-e56c-4c50-a16d-0b17d2ec42ce admin admin] The token cache is being invalidate because project 6d45c882ba5c4e87a5ad0179f8c4992f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:51:39.113091 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-6e6c9581-e56c-4c50-a16d-0b17d2ec42ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:39.113710 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-6e6c9581-e56c-4c50-a16d-0b17d2ec42ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:39.115235 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1315/2625] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:51:38 2022] DELETE /identity/v3/projects/6d45c882ba5c4e87a5ad0179f8c4992f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:39.122025 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf7301-fe04-4ced-b415-b81e3cfe0d6a None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:39.122511 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf7301-fe04-4ced-b415-b81e3cfe0d6a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:39.122622 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf7301-fe04-4ced-b415-b81e3cfe0d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:39.140998 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d8bf7301-fe04-4ced-b415-b81e3cfe0d6a None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:39.142211 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d8bf7301-fe04-4ced-b415-b81e3cfe0d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:39.200360 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1311/2626] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:51:39.208222 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc12fb-e126-4313-abe5-31fcb1f91d57 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:39.208504 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc12fb-e126-4313-abe5-31fcb1f91d57 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:39.208778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc12fb-e126-4313-abe5-31fcb1f91d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:39.227942 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-4efc12fb-e126-4313-abe5-31fcb1f91d57 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:39.229401 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-4efc12fb-e126-4313-abe5-31fcb1f91d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:39.238179 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1316/2627] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:51:39.242369 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf7301-fe04-4ced-b415-b81e3cfe0d6a None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:39.253313 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf7301-fe04-4ced-b415-b81e3cfe0d6a None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:39.257931 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f4cd4-d30f-43c7-a962-2ace187a38c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:39.258579 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f4cd4-d30f-43c7-a962-2ace187a38c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:39.258860 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f4cd4-d30f-43c7-a962-2ace187a38c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:39.259137 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f4cd4-d30f-43c7-a962-2ace187a38c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:39.259899 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f4cd4-d30f-43c7-a962-2ace187a38c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:51:39.260203 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f4cd4-d30f-43c7-a962-2ace187a38c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:39.262286 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f4cd4-d30f-43c7-a962-2ace187a38c5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:39.281058 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1312/2628] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:51:39.285347 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc12fb-e126-4313-abe5-31fcb1f91d57 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:39.295270 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc12fb-e126-4313-abe5-31fcb1f91d57 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:39.299915 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faee703-ee8a-4a34-9d4b-047807a75201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:39.300557 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faee703-ee8a-4a34-9d4b-047807a75201 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:39.300837 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faee703-ee8a-4a34-9d4b-047807a75201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:39.301112 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faee703-ee8a-4a34-9d4b-047807a75201 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:39.301811 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faee703-ee8a-4a34-9d4b-047807a75201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:39.303697 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faee703-ee8a-4a34-9d4b-047807a75201 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:39.330350 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1317/2629] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:51:39 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:51:39.334297 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f4cd4-d30f-43c7-a962-2ace187a38c5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:39.344496 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f4cd4-d30f-43c7-a962-2ace187a38c5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:39.399044 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e696f-b4ef-4eef-a96b-786504897629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:39.399702 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e696f-b4ef-4eef-a96b-786504897629 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:39.400014 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e696f-b4ef-4eef-a96b-786504897629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:39.400286 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e696f-b4ef-4eef-a96b-786504897629 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:39.400984 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e696f-b4ef-4eef-a96b-786504897629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:39.403701 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e696f-b4ef-4eef-a96b-786504897629 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:39.422963 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1313/2630] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:51:39 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:51:39.427029 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faee703-ee8a-4a34-9d4b-047807a75201 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:39.437760 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faee703-ee8a-4a34-9d4b-047807a75201 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:39.442393 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230883c6-5601-4b76-aeb6-b64b828594ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:39.443036 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230883c6-5601-4b76-aeb6-b64b828594ff admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:39.443318 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230883c6-5601-4b76-aeb6-b64b828594ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:39.443596 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230883c6-5601-4b76-aeb6-b64b828594ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:39.444363 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230883c6-5601-4b76-aeb6-b64b828594ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:39.445938 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230883c6-5601-4b76-aeb6-b64b828594ff admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:39.456257 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1318/2631] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:51:39.460047 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e696f-b4ef-4eef-a96b-786504897629 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:39.470689 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e696f-b4ef-4eef-a96b-786504897629 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:39.475279 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db9630-4c63-4094-b672-c6814c5472aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:39.475950 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db9630-4c63-4094-b672-c6814c5472aa admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:39.476227 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db9630-4c63-4094-b672-c6814c5472aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:39.476508 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db9630-4c63-4094-b672-c6814c5472aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:39.477241 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db9630-4c63-4094-b672-c6814c5472aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:39.478865 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db9630-4c63-4094-b672-c6814c5472aa admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:39.489308 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1314/2632] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:51:39.493588 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230883c6-5601-4b76-aeb6-b64b828594ff admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:39.503768 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230883c6-5601-4b76-aeb6-b64b828594ff admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:39.508424 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10abc56-7b85-49ac-94a1-58807375c710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:39.509282 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10abc56-7b85-49ac-94a1-58807375c710 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:39.509563 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10abc56-7b85-49ac-94a1-58807375c710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:39.509841 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10abc56-7b85-49ac-94a1-58807375c710 admin admin] PATH_INFO: `/v3/projects/2aa1b5f0d31542fd9ac5c932acca1b93/users/8581a130d59e465695ab553e14456eed/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:39.524147 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10abc56-7b85-49ac-94a1-58807375c710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa1b5f0d31542fd9ac5c932acca1b93, user_id=8581a130d59e465695ab553e14456eed, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:39.526772 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10abc56-7b85-49ac-94a1-58807375c710 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:39.540162 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1319/2633] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:51:39 2022] PUT /identity/v3/projects/2aa1b5f0d31542fd9ac5c932acca1b93/users/8581a130d59e465695ab553e14456eed/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:51:39.552446 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c28f7-d81e-4b54-93c3-62e48db447a1 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:39.552737 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c28f7-d81e-4b54-93c3-62e48db447a1 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:39.553015 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c28f7-d81e-4b54-93c3-62e48db447a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:39.579319 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-b45c28f7-d81e-4b54-93c3-62e48db447a1 None None] MFA Rules not processed for user `8581a130d59e465695ab553e14456eed`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:39.580675 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b45c28f7-d81e-4b54-93c3-62e48db447a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:39.642368 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1315/2634] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:39.646946 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10abc56-7b85-49ac-94a1-58807375c710 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:39.707058 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10abc56-7b85-49ac-94a1-58807375c710 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:39.711805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431e255-0bc7-4f19-8ad9-f45e597f2ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:39.712485 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431e255-0bc7-4f19-8ad9-f45e597f2ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:39.712766 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431e255-0bc7-4f19-8ad9-f45e597f2ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:39.713042 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431e255-0bc7-4f19-8ad9-f45e597f2ad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:39.713808 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431e255-0bc7-4f19-8ad9-f45e597f2ad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:39.716235 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431e255-0bc7-4f19-8ad9-f45e597f2ad3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:39.740515 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1320/2635] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:51:39 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:51:39.744721 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c28f7-d81e-4b54-93c3-62e48db447a1 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:39.755648 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c28f7-d81e-4b54-93c3-62e48db447a1 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:39.810487 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d36a08-7594-4cf5-9015-83a4c9eb5d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:39.811138 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d36a08-7594-4cf5-9015-83a4c9eb5d1f admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:39.811416 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d36a08-7594-4cf5-9015-83a4c9eb5d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:39.811693 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d36a08-7594-4cf5-9015-83a4c9eb5d1f admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:39.812421 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d36a08-7594-4cf5-9015-83a4c9eb5d1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:39.814324 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d36a08-7594-4cf5-9015-83a4c9eb5d1f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:39.834090 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1316/2636] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:51:39 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:51:39.838127 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431e255-0bc7-4f19-8ad9-f45e597f2ad3 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:39.848987 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431e255-0bc7-4f19-8ad9-f45e597f2ad3 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:39.853600 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4eb39-fef7-4b33-9a10-141d51ea1df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:39.854248 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4eb39-fef7-4b33-9a10-141d51ea1df9 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:39.854532 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4eb39-fef7-4b33-9a10-141d51ea1df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:39.854812 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4eb39-fef7-4b33-9a10-141d51ea1df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:39.855711 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4eb39-fef7-4b33-9a10-141d51ea1df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:39.857310 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4eb39-fef7-4b33-9a10-141d51ea1df9 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:39.867439 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1321/2637] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:51:39.871644 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d36a08-7594-4cf5-9015-83a4c9eb5d1f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:39.881892 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d36a08-7594-4cf5-9015-83a4c9eb5d1f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:39.887033 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61aa418-5e47-49f5-84fe-851ef9b8d3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:39.887927 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aa418-5e47-49f5-84fe-851ef9b8d3d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:39.888208 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aa418-5e47-49f5-84fe-851ef9b8d3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:39.888482 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aa418-5e47-49f5-84fe-851ef9b8d3d8 admin admin] PATH_INFO: `/v3/projects/098262a899ad43b7aad5b80e9b4afb37/users/914fd700b999401bb775f9f8a8e34a7c/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:39.903274 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61aa418-5e47-49f5-84fe-851ef9b8d3d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098262a899ad43b7aad5b80e9b4afb37, user_id=914fd700b999401bb775f9f8a8e34a7c, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:39.905948 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61aa418-5e47-49f5-84fe-851ef9b8d3d8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:39.918332 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1317/2638] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:51:39 2022] PUT /identity/v3/projects/098262a899ad43b7aad5b80e9b4afb37/users/914fd700b999401bb775f9f8a8e34a7c/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:39.922096 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4eb39-fef7-4b33-9a10-141d51ea1df9 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:39.931860 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4eb39-fef7-4b33-9a10-141d51ea1df9 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:39.985481 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4e7da-4e50-4a26-9a08-a85a0e7bbab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:39.986142 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4e7da-4e50-4a26-9a08-a85a0e7bbab3 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:39.986422 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4e7da-4e50-4a26-9a08-a85a0e7bbab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:39.986697 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4e7da-4e50-4a26-9a08-a85a0e7bbab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:39.987425 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4e7da-4e50-4a26-9a08-a85a0e7bbab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:39.989359 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4e7da-4e50-4a26-9a08-a85a0e7bbab3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:39.999712 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1322/2639] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:51:40.003679 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61aa418-5e47-49f5-84fe-851ef9b8d3d8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:40.014441 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61aa418-5e47-49f5-84fe-851ef9b8d3d8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:40.019063 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cac823-c870-4fec-8c48-1fcfb05c6b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:40.020016 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cac823-c870-4fec-8c48-1fcfb05c6b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:40.020297 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cac823-c870-4fec-8c48-1fcfb05c6b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:40.020569 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cac823-c870-4fec-8c48-1fcfb05c6b9c admin admin] PATH_INFO: `/v3/projects/098262a899ad43b7aad5b80e9b4afb37/users/914fd700b999401bb775f9f8a8e34a7c/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:40.022541 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cac823-c870-4fec-8c48-1fcfb05c6b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=098262a899ad43b7aad5b80e9b4afb37, user_id=914fd700b999401bb775f9f8a8e34a7c, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:40.025196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cac823-c870-4fec-8c48-1fcfb05c6b9c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:40.035980 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1318/2640] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:51:40 2022] PUT /identity/v3/projects/098262a899ad43b7aad5b80e9b4afb37/users/914fd700b999401bb775f9f8a8e34a7c/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:40.046449 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56419f-2f64-4b3d-8dda-fc19994085d1 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:40.047038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56419f-2f64-4b3d-8dda-fc19994085d1 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:40.047038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56419f-2f64-4b3d-8dda-fc19994085d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:40.072993 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-fb56419f-2f64-4b3d-8dda-fc19994085d1 None None] MFA Rules not processed for user `914fd700b999401bb775f9f8a8e34a7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:40.074216 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-fb56419f-2f64-4b3d-8dda-fc19994085d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:40.140466 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1323/2641] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:40.151011 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cac823-c870-4fec-8c48-1fcfb05c6b9c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:40.153472 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d5cac823-c870-4fec-8c48-1fcfb05c6b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:40.207203 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cac823-c870-4fec-8c48-1fcfb05c6b9c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:40.210800 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751c44a-4e29-498f-bdaa-27d278c8ba8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:40.211425 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751c44a-4e29-498f-bdaa-27d278c8ba8d service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:40.211701 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751c44a-4e29-498f-bdaa-27d278c8ba8d service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:40.212001 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751c44a-4e29-498f-bdaa-27d278c8ba8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:40.221510 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751c44a-4e29-498f-bdaa-27d278c8ba8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:40.222920 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751c44a-4e29-498f-bdaa-27d278c8ba8d service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:40.232762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1319/2642] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:51:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:51:40.325481 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56419f-2f64-4b3d-8dda-fc19994085d1 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:40.335060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56419f-2f64-4b3d-8dda-fc19994085d1 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:40.339097 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320a7b8-cd29-4603-bed6-5e90aa0378e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:40.340266 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320a7b8-cd29-4603-bed6-5e90aa0378e7 service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:40.340548 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320a7b8-cd29-4603-bed6-5e90aa0378e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:40.340821 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320a7b8-cd29-4603-bed6-5e90aa0378e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:40.397227 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320a7b8-cd29-4603-bed6-5e90aa0378e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:40.398672 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320a7b8-cd29-4603-bed6-5e90aa0378e7 service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:40.407949 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1324/2643] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:51:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:51:42.733312 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751c44a-4e29-498f-bdaa-27d278c8ba8d service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:42.734773 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b751c44a-4e29-498f-bdaa-27d278c8ba8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:42.805221 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751c44a-4e29-498f-bdaa-27d278c8ba8d service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:42.811255 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7f9aa-b57d-404b-a8bb-edc7f7e9e632 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:42.811907 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7f9aa-b57d-404b-a8bb-edc7f7e9e632 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:42.812188 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7f9aa-b57d-404b-a8bb-edc7f7e9e632 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:42.812459 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7f9aa-b57d-404b-a8bb-edc7f7e9e632 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:42.814212 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-29f7f9aa-b57d-404b-a8bb-edc7f7e9e632 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:42.894641 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7f9aa-b57d-404b-a8bb-edc7f7e9e632 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:42.896323 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7f9aa-b57d-404b-a8bb-edc7f7e9e632 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:42.916181 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1320/2644] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:51:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:51:42.992313 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320a7b8-cd29-4603-bed6-5e90aa0378e7 service cinder] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:43.055495 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320a7b8-cd29-4603-bed6-5e90aa0378e7 service cinder] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:43.060703 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc99e0-fec9-4fb0-92bc-27991d6da9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:43.061563 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc99e0-fec9-4fb0-92bc-27991d6da9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:43.061847 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc99e0-fec9-4fb0-92bc-27991d6da9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:43.062125 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc99e0-fec9-4fb0-92bc-27991d6da9fb admin admin] PATH_INFO: `/v3/users/8581a130d59e465695ab553e14456eed` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:43.063331 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc99e0-fec9-4fb0-92bc-27991d6da9fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8581a130d59e465695ab553e14456eed)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:43.065309 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc99e0-fec9-4fb0-92bc-27991d6da9fb admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:43.110693 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-11bc99e0-fec9-4fb0-92bc-27991d6da9fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8581a130d59e465695ab553e14456eed'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:43.122342 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-11bc99e0-fec9-4fb0-92bc-27991d6da9fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8581a130d59e465695ab553e14456eed'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:43.129107 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-11bc99e0-fec9-4fb0-92bc-27991d6da9fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8581a130d59e465695ab553e14456eed'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:43.136042 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-11bc99e0-fec9-4fb0-92bc-27991d6da9fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8581a130d59e465695ab553e14456eed'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:43.136662 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-11bc99e0-fec9-4fb0-92bc-27991d6da9fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8581a130d59e465695ab553e14456eed'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:43.142838 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1325/2645] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:51:42 2022] DELETE /identity/v3/users/8581a130d59e465695ab553e14456eed => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:43.147403 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c16f0-7b1b-4e92-a841-9905d541161e None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:43.147693 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c16f0-7b1b-4e92-a841-9905d541161e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:43.148059 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c16f0-7b1b-4e92-a841-9905d541161e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:43.165652 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-983c16f0-7b1b-4e92-a841-9905d541161e None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:43.166929 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-983c16f0-7b1b-4e92-a841-9905d541161e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:43.353060 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1321/2646] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:43.363119 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc99e0-fec9-4fb0-92bc-27991d6da9fb admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:43.364520 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-11bc99e0-fec9-4fb0-92bc-27991d6da9fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:43.420087 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc99e0-fec9-4fb0-92bc-27991d6da9fb admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:43.423673 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8e10c-d5dc-4042-8573-7fb07327662f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:43.424343 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8e10c-d5dc-4042-8573-7fb07327662f service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:43.424627 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8e10c-d5dc-4042-8573-7fb07327662f service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:43.424905 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8e10c-d5dc-4042-8573-7fb07327662f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:43.433646 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8e10c-d5dc-4042-8573-7fb07327662f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:43.435953 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8e10c-d5dc-4042-8573-7fb07327662f service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:43.445358 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1326/2647] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:51:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:51:43.709567 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c16f0-7b1b-4e92-a841-9905d541161e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:43.711252 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-983c16f0-7b1b-4e92-a841-9905d541161e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:43.724572 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c16f0-7b1b-4e92-a841-9905d541161e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:43.729185 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9756860-b005-4ec8-9761-f295e1b2533a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:43.730033 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9756860-b005-4ec8-9761-f295e1b2533a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:43.730310 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9756860-b005-4ec8-9761-f295e1b2533a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:43.730579 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9756860-b005-4ec8-9761-f295e1b2533a admin admin] PATH_INFO: `/v3/projects/2aa1b5f0d31542fd9ac5c932acca1b93` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:43.732289 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9756860-b005-4ec8-9761-f295e1b2533a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aa1b5f0d31542fd9ac5c932acca1b93)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:43.734211 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9756860-b005-4ec8-9761-f295e1b2533a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:43.781663 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e9756860-b005-4ec8-9761-f295e1b2533a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aa1b5f0d31542fd9ac5c932acca1b93', 'request_id': 'req-e9756860-b005-4ec8-9761-f295e1b2533a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:43.788074 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e9756860-b005-4ec8-9761-f295e1b2533a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aa1b5f0d31542fd9ac5c932acca1b93', 'request_id': 'req-e9756860-b005-4ec8-9761-f295e1b2533a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:43.793610 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e9756860-b005-4ec8-9761-f295e1b2533a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aa1b5f0d31542fd9ac5c932acca1b93', 'request_id': 'req-e9756860-b005-4ec8-9761-f295e1b2533a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:43.805482 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e9756860-b005-4ec8-9761-f295e1b2533a admin admin] The token cache is being invalidate because project 2aa1b5f0d31542fd9ac5c932acca1b93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:51:43.805768 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e9756860-b005-4ec8-9761-f295e1b2533a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:43.806438 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e9756860-b005-4ec8-9761-f295e1b2533a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:43.807984 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1322/2648] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:51:43 2022] DELETE /identity/v3/projects/2aa1b5f0d31542fd9ac5c932acca1b93 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:43.812051 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8e10c-d5dc-4042-8573-7fb07327662f service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:43.821619 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8e10c-d5dc-4042-8573-7fb07327662f service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:43.881239 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372b256-5621-42d3-aae5-4b6102709112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:43.882190 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372b256-5621-42d3-aae5-4b6102709112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:43.882541 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372b256-5621-42d3-aae5-4b6102709112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:43.882910 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372b256-5621-42d3-aae5-4b6102709112 admin admin] PATH_INFO: `/v3/users/914fd700b999401bb775f9f8a8e34a7c` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:43.884366 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372b256-5621-42d3-aae5-4b6102709112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=914fd700b999401bb775f9f8a8e34a7c)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:43.886314 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372b256-5621-42d3-aae5-4b6102709112 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:43.935990 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-3372b256-5621-42d3-aae5-4b6102709112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '914fd700b999401bb775f9f8a8e34a7c'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:43.947677 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-3372b256-5621-42d3-aae5-4b6102709112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '914fd700b999401bb775f9f8a8e34a7c'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:43.955043 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-3372b256-5621-42d3-aae5-4b6102709112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '914fd700b999401bb775f9f8a8e34a7c'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:43.962365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-3372b256-5621-42d3-aae5-4b6102709112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '914fd700b999401bb775f9f8a8e34a7c'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:43.962983 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-3372b256-5621-42d3-aae5-4b6102709112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '914fd700b999401bb775f9f8a8e34a7c'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:43.969977 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1327/2649] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:51:43 2022] DELETE /identity/v3/users/914fd700b999401bb775f9f8a8e34a7c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:51:44.244801 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9756860-b005-4ec8-9761-f295e1b2533a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:44.246379 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e9756860-b005-4ec8-9761-f295e1b2533a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:44.267865 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9756860-b005-4ec8-9761-f295e1b2533a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:44.326465 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44752df-4160-4854-8602-1584c692e9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:44.327313 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44752df-4160-4854-8602-1584c692e9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:44.327594 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44752df-4160-4854-8602-1584c692e9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:44.327916 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44752df-4160-4854-8602-1584c692e9bf admin admin] PATH_INFO: `/v3/projects/098262a899ad43b7aad5b80e9b4afb37` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:44.329101 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44752df-4160-4854-8602-1584c692e9bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=098262a899ad43b7aad5b80e9b4afb37)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:44.331012 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44752df-4160-4854-8602-1584c692e9bf admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:44.374833 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a44752df-4160-4854-8602-1584c692e9bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098262a899ad43b7aad5b80e9b4afb37', 'request_id': 'req-a44752df-4160-4854-8602-1584c692e9bf'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:44.380621 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a44752df-4160-4854-8602-1584c692e9bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098262a899ad43b7aad5b80e9b4afb37', 'request_id': 'req-a44752df-4160-4854-8602-1584c692e9bf'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:44.386017 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a44752df-4160-4854-8602-1584c692e9bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098262a899ad43b7aad5b80e9b4afb37', 'request_id': 'req-a44752df-4160-4854-8602-1584c692e9bf'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:44.397360 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a44752df-4160-4854-8602-1584c692e9bf admin admin] The token cache is being invalidate because project 098262a899ad43b7aad5b80e9b4afb37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:51:44.397650 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a44752df-4160-4854-8602-1584c692e9bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:44.398266 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a44752df-4160-4854-8602-1584c692e9bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:44.399769 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1323/2650] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:51:44 2022] DELETE /identity/v3/projects/098262a899ad43b7aad5b80e9b4afb37 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:44.405992 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457fa05-4043-49dc-b038-21cf9a6031f3 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:44.406499 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457fa05-4043-49dc-b038-21cf9a6031f3 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:44.406609 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457fa05-4043-49dc-b038-21cf9a6031f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:44.423964 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-9457fa05-4043-49dc-b038-21cf9a6031f3 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:44.425139 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-9457fa05-4043-49dc-b038-21cf9a6031f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:44.482319 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1328/2651] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:51:44.490231 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51c2fd-8d2b-41d0-ade5-2fe372932f9a None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:44.490525 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51c2fd-8d2b-41d0-ade5-2fe372932f9a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:44.490796 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51c2fd-8d2b-41d0-ade5-2fe372932f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:44.509930 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-4d51c2fd-8d2b-41d0-ade5-2fe372932f9a None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:44.511128 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4d51c2fd-8d2b-41d0-ade5-2fe372932f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:44.519534 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1324/2652] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:44.523968 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457fa05-4043-49dc-b038-21cf9a6031f3 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:44.534327 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457fa05-4043-49dc-b038-21cf9a6031f3 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:44.539027 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d26b6b-820a-4b0f-9b01-ff143641f216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:44.539678 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d26b6b-820a-4b0f-9b01-ff143641f216 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:44.539987 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d26b6b-820a-4b0f-9b01-ff143641f216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:44.540263 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d26b6b-820a-4b0f-9b01-ff143641f216 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:44.541025 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d26b6b-820a-4b0f-9b01-ff143641f216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:51:44.541333 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d26b6b-820a-4b0f-9b01-ff143641f216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:44.542916 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d26b6b-820a-4b0f-9b01-ff143641f216 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:44.555187 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1329/2653] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:51:44.560533 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51c2fd-8d2b-41d0-ade5-2fe372932f9a None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:44.569581 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51c2fd-8d2b-41d0-ade5-2fe372932f9a None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:44.574182 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff9ccb-a416-4c1c-a8c4-d4b13ebe02e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:44.574816 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff9ccb-a416-4c1c-a8c4-d4b13ebe02e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:44.575095 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff9ccb-a416-4c1c-a8c4-d4b13ebe02e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:44.575366 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff9ccb-a416-4c1c-a8c4-d4b13ebe02e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:44.576109 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff9ccb-a416-4c1c-a8c4-d4b13ebe02e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:44.577994 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff9ccb-a416-4c1c-a8c4-d4b13ebe02e6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:44.602764 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1325/2654] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:51:44 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:51:44.607576 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d26b6b-820a-4b0f-9b01-ff143641f216 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:44.617493 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d26b6b-820a-4b0f-9b01-ff143641f216 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:44.672376 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b65e3a-863c-453e-b9d2-e58b758706d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:44.672979 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b65e3a-863c-453e-b9d2-e58b758706d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:44.673265 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b65e3a-863c-453e-b9d2-e58b758706d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:44.673543 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b65e3a-863c-453e-b9d2-e58b758706d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:44.674286 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b65e3a-863c-453e-b9d2-e58b758706d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:44.676210 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b65e3a-863c-453e-b9d2-e58b758706d0 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:44.698061 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1330/2655] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:51:44 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:51:44.702439 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff9ccb-a416-4c1c-a8c4-d4b13ebe02e6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:44.712415 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff9ccb-a416-4c1c-a8c4-d4b13ebe02e6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:44.717697 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d24e7f-4f89-473c-ae5a-3f53133d8a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:44.718335 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d24e7f-4f89-473c-ae5a-3f53133d8a7d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:44.718615 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d24e7f-4f89-473c-ae5a-3f53133d8a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:44.718888 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d24e7f-4f89-473c-ae5a-3f53133d8a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:44.719646 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d24e7f-4f89-473c-ae5a-3f53133d8a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:44.721250 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d24e7f-4f89-473c-ae5a-3f53133d8a7d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:44.731789 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1326/2656] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:51:44.735697 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b65e3a-863c-453e-b9d2-e58b758706d0 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:44.745439 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b65e3a-863c-453e-b9d2-e58b758706d0 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:44.750628 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6a681-cd49-4f37-870d-5f7d85f3eb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:44.751265 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6a681-cd49-4f37-870d-5f7d85f3eb01 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:44.751547 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6a681-cd49-4f37-870d-5f7d85f3eb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:44.751849 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6a681-cd49-4f37-870d-5f7d85f3eb01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:44.752582 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6a681-cd49-4f37-870d-5f7d85f3eb01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:44.754139 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6a681-cd49-4f37-870d-5f7d85f3eb01 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:44.764182 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1331/2657] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:51:44.767911 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d24e7f-4f89-473c-ae5a-3f53133d8a7d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:44.777357 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d24e7f-4f89-473c-ae5a-3f53133d8a7d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:44.782455 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6131f15-26d5-459e-b0f1-f9dc583f128e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:44.783310 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6131f15-26d5-459e-b0f1-f9dc583f128e admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:44.783586 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6131f15-26d5-459e-b0f1-f9dc583f128e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:44.783896 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6131f15-26d5-459e-b0f1-f9dc583f128e admin admin] PATH_INFO: `/v3/projects/ba45cd1735664db78e23027702bca049/users/72ed9cb86ed8406195a51831894d62a3/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:44.798298 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6131f15-26d5-459e-b0f1-f9dc583f128e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba45cd1735664db78e23027702bca049, user_id=72ed9cb86ed8406195a51831894d62a3, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:44.801061 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6131f15-26d5-459e-b0f1-f9dc583f128e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:44.813127 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1327/2658] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:51:44 2022] PUT /identity/v3/projects/ba45cd1735664db78e23027702bca049/users/72ed9cb86ed8406195a51831894d62a3/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:44.824196 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66663c06-686e-436f-bbff-9e039fbe8d35 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:44.824485 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66663c06-686e-436f-bbff-9e039fbe8d35 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:44.824799 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66663c06-686e-436f-bbff-9e039fbe8d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:44.852063 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-66663c06-686e-436f-bbff-9e039fbe8d35 None None] MFA Rules not processed for user `72ed9cb86ed8406195a51831894d62a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:44.853277 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-66663c06-686e-436f-bbff-9e039fbe8d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:44.918215 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1332/2659] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:44.923460 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6131f15-26d5-459e-b0f1-f9dc583f128e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:44.982091 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6131f15-26d5-459e-b0f1-f9dc583f128e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:44.986763 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcec06-8150-447c-bb53-d005099a9dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:44.987402 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcec06-8150-447c-bb53-d005099a9dbe admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:44.987685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcec06-8150-447c-bb53-d005099a9dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:44.988002 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcec06-8150-447c-bb53-d005099a9dbe admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:44.988705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bcec06-8150-447c-bb53-d005099a9dbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:44.990654 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bcec06-8150-447c-bb53-d005099a9dbe admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:45.015660 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1328/2660] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:51:44 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:51:45.019670 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66663c06-686e-436f-bbff-9e039fbe8d35 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:45.030949 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66663c06-686e-436f-bbff-9e039fbe8d35 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:45.083257 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fff99-e30d-4bb7-b392-604b216a9429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:45.083945 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fff99-e30d-4bb7-b392-604b216a9429 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:45.084240 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fff99-e30d-4bb7-b392-604b216a9429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:45.084519 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fff99-e30d-4bb7-b392-604b216a9429 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:45.085227 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fff99-e30d-4bb7-b392-604b216a9429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:45.087122 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fff99-e30d-4bb7-b392-604b216a9429 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:45.105495 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1333/2661] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:51:45 2022] POST /identity/v3/users => generated 300 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:51:45.109639 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcec06-8150-447c-bb53-d005099a9dbe admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:45.119582 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcec06-8150-447c-bb53-d005099a9dbe admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:45.124535 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cea41-94dd-450d-9e0f-11de5f28777f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:45.125171 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cea41-94dd-450d-9e0f-11de5f28777f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:45.125448 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cea41-94dd-450d-9e0f-11de5f28777f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:45.125723 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cea41-94dd-450d-9e0f-11de5f28777f admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:45.126436 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cea41-94dd-450d-9e0f-11de5f28777f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:45.128036 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cea41-94dd-450d-9e0f-11de5f28777f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:45.138572 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1329/2662] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:51:45.142539 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fff99-e30d-4bb7-b392-604b216a9429 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:45.152295 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fff99-e30d-4bb7-b392-604b216a9429 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:45.157593 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2438b6-8023-4ab2-b441-8830d430dc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:45.158479 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2438b6-8023-4ab2-b441-8830d430dc83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:45.159392 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2438b6-8023-4ab2-b441-8830d430dc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:45.159675 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2438b6-8023-4ab2-b441-8830d430dc83 admin admin] PATH_INFO: `/v3/projects/dde09c7527134611969537755880c5ba/users/aea0def157644e239631ccfe63589a72/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:45.174233 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2438b6-8023-4ab2-b441-8830d430dc83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde09c7527134611969537755880c5ba, user_id=aea0def157644e239631ccfe63589a72, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:45.176833 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2438b6-8023-4ab2-b441-8830d430dc83 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:45.191256 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1334/2663] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:51:45 2022] PUT /identity/v3/projects/dde09c7527134611969537755880c5ba/users/aea0def157644e239631ccfe63589a72/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:45.195425 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cea41-94dd-450d-9e0f-11de5f28777f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:45.205826 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cea41-94dd-450d-9e0f-11de5f28777f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:45.259208 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d915fcf-60ee-4312-905f-6ee8f2501920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:45.259887 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d915fcf-60ee-4312-905f-6ee8f2501920 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:45.260171 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d915fcf-60ee-4312-905f-6ee8f2501920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:45.260440 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d915fcf-60ee-4312-905f-6ee8f2501920 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:45.261165 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d915fcf-60ee-4312-905f-6ee8f2501920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:45.263257 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d915fcf-60ee-4312-905f-6ee8f2501920 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:45.273149 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1330/2664] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:51:45.277174 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2438b6-8023-4ab2-b441-8830d430dc83 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:45.287939 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2438b6-8023-4ab2-b441-8830d430dc83 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:45.292509 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f5c66-3abd-424c-a075-3cc092b3cce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:45.293353 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f5c66-3abd-424c-a075-3cc092b3cce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:45.293658 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f5c66-3abd-424c-a075-3cc092b3cce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:45.293934 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f5c66-3abd-424c-a075-3cc092b3cce3 admin admin] PATH_INFO: `/v3/projects/dde09c7527134611969537755880c5ba/users/aea0def157644e239631ccfe63589a72/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:45.295948 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f5c66-3abd-424c-a075-3cc092b3cce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde09c7527134611969537755880c5ba, user_id=aea0def157644e239631ccfe63589a72, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:45.298556 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f5c66-3abd-424c-a075-3cc092b3cce3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:45.310446 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1335/2665] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:51:45 2022] PUT /identity/v3/projects/dde09c7527134611969537755880c5ba/users/aea0def157644e239631ccfe63589a72/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:45.320461 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de465e6-976b-4f80-a180-0113d7ce4cb5 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:45.320755 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de465e6-976b-4f80-a180-0113d7ce4cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:45.321175 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de465e6-976b-4f80-a180-0113d7ce4cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:45.349065 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-4de465e6-976b-4f80-a180-0113d7ce4cb5 None None] MFA Rules not processed for user `aea0def157644e239631ccfe63589a72`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:45.350259 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4de465e6-976b-4f80-a180-0113d7ce4cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:45.416169 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1331/2666] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:45.427610 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f5c66-3abd-424c-a075-3cc092b3cce3 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:45.428939 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-495f5c66-3abd-424c-a075-3cc092b3cce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:45.487676 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f5c66-3abd-424c-a075-3cc092b3cce3 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:45.491383 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcce17-8a31-4f02-9c14-62c9c07f1acb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:45.492051 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcce17-8a31-4f02-9c14-62c9c07f1acb service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:45.492330 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcce17-8a31-4f02-9c14-62c9c07f1acb service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:45.492603 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcce17-8a31-4f02-9c14-62c9c07f1acb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:45.502746 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fcce17-8a31-4f02-9c14-62c9c07f1acb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:45.504199 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fcce17-8a31-4f02-9c14-62c9c07f1acb service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:45.513417 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1336/2667] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:51:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:51:45.513578 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2e669-117b-445c-836c-2b114deff98c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:45.513773 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2e669-117b-445c-836c-2b114deff98c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:45.514083 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2e669-117b-445c-836c-2b114deff98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:45.533719 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-91e2e669-117b-445c-836c-2b114deff98c None None] MFA Rules not processed for user `9761863f36284bd4be1ce29c86b631cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:45.535151 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-91e2e669-117b-445c-836c-2b114deff98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:45.598449 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1332/2668] 10.222.0.35 () {58 vars in 967 bytes} [Tue Feb 8 16:51:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:51:45.611664 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcce17-8a31-4f02-9c14-62c9c07f1acb service cinder] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:45.613242 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-46fcce17-8a31-4f02-9c14-62c9c07f1acb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:45.639387 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2e669-117b-445c-836c-2b114deff98c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:45.681752 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcce17-8a31-4f02-9c14-62c9c07f1acb service cinder] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:45.687361 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c84704-a09d-46bf-bc13-8ce4e4b1346d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00fd3c05cd8e4167946a1f567df2cc6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:45.688032 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c84704-a09d-46bf-bc13-8ce4e4b1346d service swift] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:45.688306 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c84704-a09d-46bf-bc13-8ce4e4b1346d service swift] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:45.688575 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c84704-a09d-46bf-bc13-8ce4e4b1346d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:45.697229 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c84704-a09d-46bf-bc13-8ce4e4b1346d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:45.698825 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c84704-a09d-46bf-bc13-8ce4e4b1346d service swift] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:45.701065 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2e669-117b-445c-836c-2b114deff98c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:45.705616 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd18ad9-c01e-4b69-9a5f-0bcdc06160db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:45.706460 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd18ad9-c01e-4b69-9a5f-0bcdc06160db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:45.706736 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd18ad9-c01e-4b69-9a5f-0bcdc06160db admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:45.707005 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd18ad9-c01e-4b69-9a5f-0bcdc06160db admin admin] PATH_INFO: `/v3/users/72ed9cb86ed8406195a51831894d62a3` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:45.707585 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1337/2669] 10.222.0.35 () {60 vars in 1384 bytes} [Tue Feb 8 16:51:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 08 16:51:45.708588 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd18ad9-c01e-4b69-9a5f-0bcdc06160db admin admin] RBAC: Authorizing `identity:delete_user(user_id=72ed9cb86ed8406195a51831894d62a3)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:45.710503 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd18ad9-c01e-4b69-9a5f-0bcdc06160db admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:45.760263 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-fdd18ad9-c01e-4b69-9a5f-0bcdc06160db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72ed9cb86ed8406195a51831894d62a3'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:45.767658 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-fdd18ad9-c01e-4b69-9a5f-0bcdc06160db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72ed9cb86ed8406195a51831894d62a3'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:45.780103 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-fdd18ad9-c01e-4b69-9a5f-0bcdc06160db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72ed9cb86ed8406195a51831894d62a3'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:45.788216 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-fdd18ad9-c01e-4b69-9a5f-0bcdc06160db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72ed9cb86ed8406195a51831894d62a3'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:45.788902 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-fdd18ad9-c01e-4b69-9a5f-0bcdc06160db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72ed9cb86ed8406195a51831894d62a3'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:45.796448 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1333/2670] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:51:45 2022] DELETE /identity/v3/users/72ed9cb86ed8406195a51831894d62a3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:51:45.800964 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1afc3-4553-4101-abbb-da12c936c794 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:45.801329 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1afc3-4553-4101-abbb-da12c936c794 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:45.801524 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1afc3-4553-4101-abbb-da12c936c794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:45.818721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-74d1afc3-4553-4101-abbb-da12c936c794 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:45.819969 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-74d1afc3-4553-4101-abbb-da12c936c794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:45.882669 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1338/2671] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:45.893036 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd18ad9-c01e-4b69-9a5f-0bcdc06160db admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:45.894534 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-fdd18ad9-c01e-4b69-9a5f-0bcdc06160db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:45.952389 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd18ad9-c01e-4b69-9a5f-0bcdc06160db admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:45.955931 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4f5e1-6889-4af1-8319-3c12030aeb8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:45.956566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4f5e1-6889-4af1-8319-3c12030aeb8f service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:45.956843 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4f5e1-6889-4af1-8319-3c12030aeb8f service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:45.957111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4f5e1-6889-4af1-8319-3c12030aeb8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:45.966519 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4f5e1-6889-4af1-8319-3c12030aeb8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:45.968013 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4f5e1-6889-4af1-8319-3c12030aeb8f service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:45.979276 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1334/2672] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:51:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:51:46.244001 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1afc3-4553-4101-abbb-da12c936c794 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:46.245526 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-74d1afc3-4553-4101-abbb-da12c936c794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:46.267531 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1afc3-4553-4101-abbb-da12c936c794 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:46.273164 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cdbfe-10f0-42db-9ba0-02759cf40363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:46.274048 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cdbfe-10f0-42db-9ba0-02759cf40363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:46.274329 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cdbfe-10f0-42db-9ba0-02759cf40363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:46.274603 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cdbfe-10f0-42db-9ba0-02759cf40363 admin admin] PATH_INFO: `/v3/projects/ba45cd1735664db78e23027702bca049` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:46.275841 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cdbfe-10f0-42db-9ba0-02759cf40363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba45cd1735664db78e23027702bca049)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:46.278256 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cdbfe-10f0-42db-9ba0-02759cf40363 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:46.325502 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5c6cdbfe-10f0-42db-9ba0-02759cf40363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba45cd1735664db78e23027702bca049', 'request_id': 'req-5c6cdbfe-10f0-42db-9ba0-02759cf40363'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:46.331458 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5c6cdbfe-10f0-42db-9ba0-02759cf40363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba45cd1735664db78e23027702bca049', 'request_id': 'req-5c6cdbfe-10f0-42db-9ba0-02759cf40363'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:46.336884 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5c6cdbfe-10f0-42db-9ba0-02759cf40363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba45cd1735664db78e23027702bca049', 'request_id': 'req-5c6cdbfe-10f0-42db-9ba0-02759cf40363'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:46.349241 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5c6cdbfe-10f0-42db-9ba0-02759cf40363 admin admin] The token cache is being invalidate because project ba45cd1735664db78e23027702bca049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:51:46.349520 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5c6cdbfe-10f0-42db-9ba0-02759cf40363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:46.350131 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5c6cdbfe-10f0-42db-9ba0-02759cf40363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:46.351676 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1339/2673] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:51:46 2022] DELETE /identity/v3/projects/ba45cd1735664db78e23027702bca049 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:46.355540 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4f5e1-6889-4af1-8319-3c12030aeb8f service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:46.365525 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4f5e1-6889-4af1-8319-3c12030aeb8f service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:46.419882 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa106f-2cfe-416d-ad93-7c3cea10bc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:46.420728 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa106f-2cfe-416d-ad93-7c3cea10bc8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:46.421003 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa106f-2cfe-416d-ad93-7c3cea10bc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:46.421274 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa106f-2cfe-416d-ad93-7c3cea10bc8f admin admin] PATH_INFO: `/v3/users/aea0def157644e239631ccfe63589a72` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:46.422570 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa106f-2cfe-416d-ad93-7c3cea10bc8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aea0def157644e239631ccfe63589a72)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:46.424526 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa106f-2cfe-416d-ad93-7c3cea10bc8f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:46.468465 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d2fa106f-2cfe-416d-ad93-7c3cea10bc8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aea0def157644e239631ccfe63589a72'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:46.474898 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d2fa106f-2cfe-416d-ad93-7c3cea10bc8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aea0def157644e239631ccfe63589a72'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:46.486768 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d2fa106f-2cfe-416d-ad93-7c3cea10bc8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aea0def157644e239631ccfe63589a72'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:46.494374 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d2fa106f-2cfe-416d-ad93-7c3cea10bc8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aea0def157644e239631ccfe63589a72'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:46.495211 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d2fa106f-2cfe-416d-ad93-7c3cea10bc8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aea0def157644e239631ccfe63589a72'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:46.502511 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1335/2674] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:51:46 2022] DELETE /identity/v3/users/aea0def157644e239631ccfe63589a72 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:46.781830 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cdbfe-10f0-42db-9ba0-02759cf40363 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:46.783292 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5c6cdbfe-10f0-42db-9ba0-02759cf40363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:46.796405 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cdbfe-10f0-42db-9ba0-02759cf40363 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:46.857075 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21b942-4279-4757-b7ae-44ae554dd6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:46.857910 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21b942-4279-4757-b7ae-44ae554dd6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:46.858186 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21b942-4279-4757-b7ae-44ae554dd6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:46.858455 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21b942-4279-4757-b7ae-44ae554dd6ea admin admin] PATH_INFO: `/v3/projects/dde09c7527134611969537755880c5ba` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:46.859634 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21b942-4279-4757-b7ae-44ae554dd6ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=dde09c7527134611969537755880c5ba)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:46.861544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21b942-4279-4757-b7ae-44ae554dd6ea admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:46.905950 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ab21b942-4279-4757-b7ae-44ae554dd6ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dde09c7527134611969537755880c5ba', 'request_id': 'req-ab21b942-4279-4757-b7ae-44ae554dd6ea'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:46.911845 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ab21b942-4279-4757-b7ae-44ae554dd6ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dde09c7527134611969537755880c5ba', 'request_id': 'req-ab21b942-4279-4757-b7ae-44ae554dd6ea'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:46.917020 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ab21b942-4279-4757-b7ae-44ae554dd6ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dde09c7527134611969537755880c5ba', 'request_id': 'req-ab21b942-4279-4757-b7ae-44ae554dd6ea'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:46.930689 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ab21b942-4279-4757-b7ae-44ae554dd6ea admin admin] The token cache is being invalidate because project dde09c7527134611969537755880c5ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:51:46.930974 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ab21b942-4279-4757-b7ae-44ae554dd6ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:46.931606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ab21b942-4279-4757-b7ae-44ae554dd6ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:46.933162 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1340/2675] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:51:46 2022] DELETE /identity/v3/projects/dde09c7527134611969537755880c5ba => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:46.939390 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015096a1-792b-43d4-af55-b2d6aae33b24 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:46.939924 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015096a1-792b-43d4-af55-b2d6aae33b24 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:46.940045 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015096a1-792b-43d4-af55-b2d6aae33b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:46.958239 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-015096a1-792b-43d4-af55-b2d6aae33b24 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:46.959424 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-015096a1-792b-43d4-af55-b2d6aae33b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:47.017165 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1336/2676] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:47.025283 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f99e36-9bf6-48ea-98d3-8d4d4c5d5b85 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:47.025527 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f99e36-9bf6-48ea-98d3-8d4d4c5d5b85 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:47.025802 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f99e36-9bf6-48ea-98d3-8d4d4c5d5b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:47.043614 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-c0f99e36-9bf6-48ea-98d3-8d4d4c5d5b85 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:47.045008 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-c0f99e36-9bf6-48ea-98d3-8d4d4c5d5b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:47.052861 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1341/2677] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:47.056865 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015096a1-792b-43d4-af55-b2d6aae33b24 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:47.066947 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015096a1-792b-43d4-af55-b2d6aae33b24 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:47.071532 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db9eca-dac3-41a0-868a-0f9da07906e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:47.072206 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db9eca-dac3-41a0-868a-0f9da07906e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:47.072484 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db9eca-dac3-41a0-868a-0f9da07906e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:47.072756 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db9eca-dac3-41a0-868a-0f9da07906e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:47.073494 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db9eca-dac3-41a0-868a-0f9da07906e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:51:47.073800 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db9eca-dac3-41a0-868a-0f9da07906e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:47.076049 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db9eca-dac3-41a0-868a-0f9da07906e1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:47.087162 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1337/2678] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:51:47.093184 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f99e36-9bf6-48ea-98d3-8d4d4c5d5b85 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:47.102193 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f99e36-9bf6-48ea-98d3-8d4d4c5d5b85 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:47.106868 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b29afd-e93b-4890-98b4-fef0b5953bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:47.107501 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b29afd-e93b-4890-98b4-fef0b5953bfd admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:47.107812 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b29afd-e93b-4890-98b4-fef0b5953bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:47.108091 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b29afd-e93b-4890-98b4-fef0b5953bfd admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:47.108799 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b29afd-e93b-4890-98b4-fef0b5953bfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:47.110684 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b29afd-e93b-4890-98b4-fef0b5953bfd admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:47.135995 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1342/2679] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:51:47 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:51:47.140796 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db9eca-dac3-41a0-868a-0f9da07906e1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:47.150745 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db9eca-dac3-41a0-868a-0f9da07906e1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:47.204793 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea3819-d518-4162-a4c0-08c9c65c6c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:47.205452 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea3819-d518-4162-a4c0-08c9c65c6c3f admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:47.205730 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea3819-d518-4162-a4c0-08c9c65c6c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:47.206031 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea3819-d518-4162-a4c0-08c9c65c6c3f admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:47.206903 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea3819-d518-4162-a4c0-08c9c65c6c3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:47.208657 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea3819-d518-4162-a4c0-08c9c65c6c3f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:47.227088 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1338/2680] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:51:47 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:51:47.231609 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b29afd-e93b-4890-98b4-fef0b5953bfd admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:47.241652 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b29afd-e93b-4890-98b4-fef0b5953bfd admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:47.246247 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6db651-de12-4d15-a191-c800f522b4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:47.247621 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6db651-de12-4d15-a191-c800f522b4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:47.248197 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6db651-de12-4d15-a191-c800f522b4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:47.248475 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6db651-de12-4d15-a191-c800f522b4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:47.249209 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6db651-de12-4d15-a191-c800f522b4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:47.250779 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6db651-de12-4d15-a191-c800f522b4c3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:47.260779 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1343/2681] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:51:47.264651 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea3819-d518-4162-a4c0-08c9c65c6c3f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:47.274448 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea3819-d518-4162-a4c0-08c9c65c6c3f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:47.279198 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6138772-966c-4e94-b8c5-d8265d7cd43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:47.279808 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6138772-966c-4e94-b8c5-d8265d7cd43c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:47.280090 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6138772-966c-4e94-b8c5-d8265d7cd43c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:47.280362 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6138772-966c-4e94-b8c5-d8265d7cd43c admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:47.281083 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6138772-966c-4e94-b8c5-d8265d7cd43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:47.282647 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6138772-966c-4e94-b8c5-d8265d7cd43c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:47.294319 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1339/2682] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:51:47.298694 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6db651-de12-4d15-a191-c800f522b4c3 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:47.308533 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6db651-de12-4d15-a191-c800f522b4c3 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:47.313820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2954fe-2e24-46ed-9837-2bab91c33cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:47.314684 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2954fe-2e24-46ed-9837-2bab91c33cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:47.314959 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2954fe-2e24-46ed-9837-2bab91c33cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:47.315227 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2954fe-2e24-46ed-9837-2bab91c33cdd admin admin] PATH_INFO: `/v3/projects/4dbadbcb229c473d9fbb438178d8c164/users/6c380271b9d045a4a2417ac8474dd9ed/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:47.329301 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2954fe-2e24-46ed-9837-2bab91c33cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dbadbcb229c473d9fbb438178d8c164, user_id=6c380271b9d045a4a2417ac8474dd9ed, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:47.331955 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2954fe-2e24-46ed-9837-2bab91c33cdd admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:47.345108 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1344/2683] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:51:47 2022] PUT /identity/v3/projects/4dbadbcb229c473d9fbb438178d8c164/users/6c380271b9d045a4a2417ac8474dd9ed/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:51:47.355054 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89839995-6893-4857-903a-ef8b4147557a None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:47.355334 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89839995-6893-4857-903a-ef8b4147557a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:47.355606 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89839995-6893-4857-903a-ef8b4147557a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:47.382209 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-89839995-6893-4857-903a-ef8b4147557a None None] MFA Rules not processed for user `6c380271b9d045a4a2417ac8474dd9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:47.383449 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-89839995-6893-4857-903a-ef8b4147557a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:47.444298 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1340/2684] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:47.448706 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2954fe-2e24-46ed-9837-2bab91c33cdd admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:47.508303 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2954fe-2e24-46ed-9837-2bab91c33cdd admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:47.512924 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c4950-aa25-42af-b177-11ed7d05cd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:47.513563 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c4950-aa25-42af-b177-11ed7d05cd38 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:47.513847 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c4950-aa25-42af-b177-11ed7d05cd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:47.514125 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c4950-aa25-42af-b177-11ed7d05cd38 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:47.514835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c4950-aa25-42af-b177-11ed7d05cd38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:47.516771 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c4950-aa25-42af-b177-11ed7d05cd38 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:47.540639 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1345/2685] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:51:47 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:51:47.545700 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89839995-6893-4857-903a-ef8b4147557a None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:47.556316 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89839995-6893-4857-903a-ef8b4147557a None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:47.613627 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3145d-f8a1-46a6-8cc5-eb79a980e30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:47.614294 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3145d-f8a1-46a6-8cc5-eb79a980e30e admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:47.614578 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3145d-f8a1-46a6-8cc5-eb79a980e30e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:47.614852 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3145d-f8a1-46a6-8cc5-eb79a980e30e admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:47.615546 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3145d-f8a1-46a6-8cc5-eb79a980e30e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:47.617491 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3145d-f8a1-46a6-8cc5-eb79a980e30e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:47.639994 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1341/2686] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:51:47 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:51:47.643986 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c4950-aa25-42af-b177-11ed7d05cd38 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:47.654950 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c4950-aa25-42af-b177-11ed7d05cd38 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:47.659636 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d6e2c-a540-4287-8aa9-e0764a1232f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:47.660320 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d6e2c-a540-4287-8aa9-e0764a1232f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:47.660602 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d6e2c-a540-4287-8aa9-e0764a1232f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:47.660906 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d6e2c-a540-4287-8aa9-e0764a1232f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:47.661640 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d6e2c-a540-4287-8aa9-e0764a1232f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:47.663221 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d6e2c-a540-4287-8aa9-e0764a1232f1 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:47.674573 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1346/2687] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:51:47.678841 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3145d-f8a1-46a6-8cc5-eb79a980e30e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:47.688871 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3145d-f8a1-46a6-8cc5-eb79a980e30e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:47.693518 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc40cb8-352e-456e-9d80-7849ddd6f942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:47.694392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc40cb8-352e-456e-9d80-7849ddd6f942 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:47.694682 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc40cb8-352e-456e-9d80-7849ddd6f942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:47.694958 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc40cb8-352e-456e-9d80-7849ddd6f942 admin admin] PATH_INFO: `/v3/projects/335a6459bd6b4917b39f330d9bbf42c4/users/6b15e25e98594a618e1f59abbc57c306/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:47.710631 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc40cb8-352e-456e-9d80-7849ddd6f942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=335a6459bd6b4917b39f330d9bbf42c4, user_id=6b15e25e98594a618e1f59abbc57c306, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:47.713309 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc40cb8-352e-456e-9d80-7849ddd6f942 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:47.727040 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1342/2688] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:51:47 2022] PUT /identity/v3/projects/335a6459bd6b4917b39f330d9bbf42c4/users/6b15e25e98594a618e1f59abbc57c306/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:47.731858 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d6e2c-a540-4287-8aa9-e0764a1232f1 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:47.741957 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d6e2c-a540-4287-8aa9-e0764a1232f1 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:47.799589 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978f0fe-a2bd-409f-abb1-d88c741c546c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:47.800332 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978f0fe-a2bd-409f-abb1-d88c741c546c admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:47.800478 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978f0fe-a2bd-409f-abb1-d88c741c546c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:47.800754 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978f0fe-a2bd-409f-abb1-d88c741c546c admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:47.801501 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978f0fe-a2bd-409f-abb1-d88c741c546c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:47.803120 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978f0fe-a2bd-409f-abb1-d88c741c546c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:47.814362 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1347/2689] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:51:47.818747 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc40cb8-352e-456e-9d80-7849ddd6f942 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:47.829845 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc40cb8-352e-456e-9d80-7849ddd6f942 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:47.834715 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827c3ea-03df-4176-ba00-8d375917c744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:47.835735 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827c3ea-03df-4176-ba00-8d375917c744 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:47.836111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827c3ea-03df-4176-ba00-8d375917c744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:47.836459 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827c3ea-03df-4176-ba00-8d375917c744 admin admin] PATH_INFO: `/v3/projects/335a6459bd6b4917b39f330d9bbf42c4/users/6b15e25e98594a618e1f59abbc57c306/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:47.838588 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827c3ea-03df-4176-ba00-8d375917c744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=335a6459bd6b4917b39f330d9bbf42c4, user_id=6b15e25e98594a618e1f59abbc57c306, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:47.842072 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827c3ea-03df-4176-ba00-8d375917c744 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:47.855867 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1343/2690] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:51:47 2022] PUT /identity/v3/projects/335a6459bd6b4917b39f330d9bbf42c4/users/6b15e25e98594a618e1f59abbc57c306/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:47.864874 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5fb99-5c62-4212-8f75-3074efdbf0d5 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:47.865310 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5fb99-5c62-4212-8f75-3074efdbf0d5 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:47.865591 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5fb99-5c62-4212-8f75-3074efdbf0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:47.894887 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-a6f5fb99-5c62-4212-8f75-3074efdbf0d5 None None] MFA Rules not processed for user `6b15e25e98594a618e1f59abbc57c306`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:47.896152 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a6f5fb99-5c62-4212-8f75-3074efdbf0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:47.977469 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1348/2691] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:47.989247 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827c3ea-03df-4176-ba00-8d375917c744 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:47.990976 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b827c3ea-03df-4176-ba00-8d375917c744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:48.049748 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827c3ea-03df-4176-ba00-8d375917c744 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:48.053565 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04c46f-05fc-45aa-ad86-202968359d62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:48.054210 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04c46f-05fc-45aa-ad86-202968359d62 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:48.054491 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04c46f-05fc-45aa-ad86-202968359d62 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:48.054766 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04c46f-05fc-45aa-ad86-202968359d62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:48.110175 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04c46f-05fc-45aa-ad86-202968359d62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:48.111611 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04c46f-05fc-45aa-ad86-202968359d62 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:48.120423 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1344/2692] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:51:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:51:52.238570 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5fb99-5c62-4212-8f75-3074efdbf0d5 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:52.239995 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a6f5fb99-5c62-4212-8f75-3074efdbf0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:52.253783 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5fb99-5c62-4212-8f75-3074efdbf0d5 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:52.257631 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11adf4-a2dd-494e-b702-b86233d59290 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:52.258662 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11adf4-a2dd-494e-b702-b86233d59290 service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:52.259069 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11adf4-a2dd-494e-b702-b86233d59290 service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:52.259359 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11adf4-a2dd-494e-b702-b86233d59290 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:52.270011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11adf4-a2dd-494e-b702-b86233d59290 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:52.271450 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11adf4-a2dd-494e-b702-b86233d59290 service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:52.281206 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1349/2693] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:51:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:51:57.090138 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04c46f-05fc-45aa-ad86-202968359d62 service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:57.149420 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04c46f-05fc-45aa-ad86-202968359d62 service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:57.153949 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563525d-95e1-47c8-97db-73bf61f2304a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:57.154790 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563525d-95e1-47c8-97db-73bf61f2304a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:57.155068 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563525d-95e1-47c8-97db-73bf61f2304a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:57.155339 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563525d-95e1-47c8-97db-73bf61f2304a admin admin] PATH_INFO: `/v3/users/6c380271b9d045a4a2417ac8474dd9ed` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:57.156542 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563525d-95e1-47c8-97db-73bf61f2304a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c380271b9d045a4a2417ac8474dd9ed)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:57.158582 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563525d-95e1-47c8-97db-73bf61f2304a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:57.202201 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f563525d-95e1-47c8-97db-73bf61f2304a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c380271b9d045a4a2417ac8474dd9ed'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:57.209235 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f563525d-95e1-47c8-97db-73bf61f2304a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c380271b9d045a4a2417ac8474dd9ed'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:57.220253 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f563525d-95e1-47c8-97db-73bf61f2304a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c380271b9d045a4a2417ac8474dd9ed'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:57.227533 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f563525d-95e1-47c8-97db-73bf61f2304a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c380271b9d045a4a2417ac8474dd9ed'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:57.228214 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f563525d-95e1-47c8-97db-73bf61f2304a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c380271b9d045a4a2417ac8474dd9ed'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:57.233924 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1345/2694] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:51:57 2022] DELETE /identity/v3/users/6c380271b9d045a4a2417ac8474dd9ed => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:57.238500 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb5de8-b3b9-463b-9569-b40dd48c00fa None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:57.239051 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb5de8-b3b9-463b-9569-b40dd48c00fa None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:57.239051 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb5de8-b3b9-463b-9569-b40dd48c00fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:57.382457 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-46bb5de8-b3b9-463b-9569-b40dd48c00fa None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:57.383581 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-46bb5de8-b3b9-463b-9569-b40dd48c00fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:57.439478 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1350/2695] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:57.449778 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563525d-95e1-47c8-97db-73bf61f2304a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:57.451154 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f563525d-95e1-47c8-97db-73bf61f2304a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:57.507184 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563525d-95e1-47c8-97db-73bf61f2304a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:57.510742 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b1073-513d-42a5-b28d-9e3efafc9406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:57.511372 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b1073-513d-42a5-b28d-9e3efafc9406 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:57.511654 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b1073-513d-42a5-b28d-9e3efafc9406 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:57.511965 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b1073-513d-42a5-b28d-9e3efafc9406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:57.521307 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b1073-513d-42a5-b28d-9e3efafc9406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:57.522744 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b1073-513d-42a5-b28d-9e3efafc9406 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:57.532452 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1346/2696] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:51:57.791588 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb5de8-b3b9-463b-9569-b40dd48c00fa None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:57.793946 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-46bb5de8-b3b9-463b-9569-b40dd48c00fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:57.815482 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb5de8-b3b9-463b-9569-b40dd48c00fa None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:57.822838 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061e28f-300e-4006-8762-f6cc166386a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:57.823674 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061e28f-300e-4006-8762-f6cc166386a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:57.824007 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061e28f-300e-4006-8762-f6cc166386a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:57.824279 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061e28f-300e-4006-8762-f6cc166386a5 admin admin] PATH_INFO: `/v3/projects/4dbadbcb229c473d9fbb438178d8c164` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:57.825461 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061e28f-300e-4006-8762-f6cc166386a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dbadbcb229c473d9fbb438178d8c164)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:57.827334 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061e28f-300e-4006-8762-f6cc166386a5 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:57.877337 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5061e28f-300e-4006-8762-f6cc166386a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dbadbcb229c473d9fbb438178d8c164', 'request_id': 'req-5061e28f-300e-4006-8762-f6cc166386a5'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:57.884263 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5061e28f-300e-4006-8762-f6cc166386a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dbadbcb229c473d9fbb438178d8c164', 'request_id': 'req-5061e28f-300e-4006-8762-f6cc166386a5'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:57.889766 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5061e28f-300e-4006-8762-f6cc166386a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dbadbcb229c473d9fbb438178d8c164', 'request_id': 'req-5061e28f-300e-4006-8762-f6cc166386a5'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:57.902045 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5061e28f-300e-4006-8762-f6cc166386a5 admin admin] The token cache is being invalidate because project 4dbadbcb229c473d9fbb438178d8c164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:51:57.902336 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5061e28f-300e-4006-8762-f6cc166386a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:57.902960 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5061e28f-300e-4006-8762-f6cc166386a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:57.904494 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1351/2697] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:51:57 2022] DELETE /identity/v3/projects/4dbadbcb229c473d9fbb438178d8c164 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:57.908594 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b1073-513d-42a5-b28d-9e3efafc9406 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:57.918391 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b1073-513d-42a5-b28d-9e3efafc9406 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:57.973932 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a8b98-c01a-4efb-bf7a-40de7270f8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:57.974800 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a8b98-c01a-4efb-bf7a-40de7270f8b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:57.975080 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a8b98-c01a-4efb-bf7a-40de7270f8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:57.975352 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a8b98-c01a-4efb-bf7a-40de7270f8b8 admin admin] PATH_INFO: `/v3/users/6b15e25e98594a618e1f59abbc57c306` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:57.976601 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a8b98-c01a-4efb-bf7a-40de7270f8b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b15e25e98594a618e1f59abbc57c306)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:57.978540 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a8b98-c01a-4efb-bf7a-40de7270f8b8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:58.023188 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-397a8b98-c01a-4efb-bf7a-40de7270f8b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b15e25e98594a618e1f59abbc57c306'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:58.029659 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-397a8b98-c01a-4efb-bf7a-40de7270f8b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b15e25e98594a618e1f59abbc57c306'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:58.041510 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-397a8b98-c01a-4efb-bf7a-40de7270f8b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b15e25e98594a618e1f59abbc57c306'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:58.049845 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-397a8b98-c01a-4efb-bf7a-40de7270f8b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b15e25e98594a618e1f59abbc57c306'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:58.051069 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-397a8b98-c01a-4efb-bf7a-40de7270f8b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b15e25e98594a618e1f59abbc57c306'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:58.056948 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1347/2698] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:51:57 2022] DELETE /identity/v3/users/6b15e25e98594a618e1f59abbc57c306 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:58.321599 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061e28f-300e-4006-8762-f6cc166386a5 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:58.323054 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5061e28f-300e-4006-8762-f6cc166386a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:58.338770 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061e28f-300e-4006-8762-f6cc166386a5 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:58.394526 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7daf98-4d3b-40ec-8167-0f3a412e6063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:58.395367 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7daf98-4d3b-40ec-8167-0f3a412e6063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:58.395645 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7daf98-4d3b-40ec-8167-0f3a412e6063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:58.395940 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7daf98-4d3b-40ec-8167-0f3a412e6063 admin admin] PATH_INFO: `/v3/projects/335a6459bd6b4917b39f330d9bbf42c4` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:58.397157 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7daf98-4d3b-40ec-8167-0f3a412e6063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=335a6459bd6b4917b39f330d9bbf42c4)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:58.399025 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7daf98-4d3b-40ec-8167-0f3a412e6063 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:58.443504 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ef7daf98-4d3b-40ec-8167-0f3a412e6063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '335a6459bd6b4917b39f330d9bbf42c4', 'request_id': 'req-ef7daf98-4d3b-40ec-8167-0f3a412e6063'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:58.450144 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ef7daf98-4d3b-40ec-8167-0f3a412e6063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '335a6459bd6b4917b39f330d9bbf42c4', 'request_id': 'req-ef7daf98-4d3b-40ec-8167-0f3a412e6063'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:58.455347 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ef7daf98-4d3b-40ec-8167-0f3a412e6063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '335a6459bd6b4917b39f330d9bbf42c4', 'request_id': 'req-ef7daf98-4d3b-40ec-8167-0f3a412e6063'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:58.467711 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ef7daf98-4d3b-40ec-8167-0f3a412e6063 admin admin] The token cache is being invalidate because project 335a6459bd6b4917b39f330d9bbf42c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:51:58.468020 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ef7daf98-4d3b-40ec-8167-0f3a412e6063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:58.468663 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ef7daf98-4d3b-40ec-8167-0f3a412e6063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:58.470420 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1352/2699] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:51:58 2022] DELETE /identity/v3/projects/335a6459bd6b4917b39f330d9bbf42c4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:58.477050 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfa18d-f4e1-4b79-9666-7bd562815ac2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:58.477523 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfa18d-f4e1-4b79-9666-7bd562815ac2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:58.477523 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfa18d-f4e1-4b79-9666-7bd562815ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:58.495175 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-bddfa18d-f4e1-4b79-9666-7bd562815ac2 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:58.496400 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-bddfa18d-f4e1-4b79-9666-7bd562815ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:58.557746 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1348/2700] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:58.568466 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829de103-ec9f-457f-b528-423b88bd09a3 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:58.568746 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829de103-ec9f-457f-b528-423b88bd09a3 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:58.569018 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829de103-ec9f-457f-b528-423b88bd09a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:58.587444 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-829de103-ec9f-457f-b528-423b88bd09a3 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:58.588757 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-829de103-ec9f-457f-b528-423b88bd09a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:58.596871 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1353/2701] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:58.601313 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfa18d-f4e1-4b79-9666-7bd562815ac2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:58.611695 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfa18d-f4e1-4b79-9666-7bd562815ac2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:58.617594 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f901f-963a-4311-859e-db42e80092d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:58.618238 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f901f-963a-4311-859e-db42e80092d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:58.618518 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f901f-963a-4311-859e-db42e80092d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:58.618790 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f901f-963a-4311-859e-db42e80092d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:58.619636 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f901f-963a-4311-859e-db42e80092d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:51:58.620208 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f901f-963a-4311-859e-db42e80092d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:58.623136 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f901f-963a-4311-859e-db42e80092d4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:58.642709 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1349/2702] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:51:58.649001 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829de103-ec9f-457f-b528-423b88bd09a3 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:58.658591 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829de103-ec9f-457f-b528-423b88bd09a3 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:58.664034 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7e125-b3e8-4c55-9a3c-97a8797dd26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:58.664681 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7e125-b3e8-4c55-9a3c-97a8797dd26e admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:58.664963 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7e125-b3e8-4c55-9a3c-97a8797dd26e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:58.665240 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7e125-b3e8-4c55-9a3c-97a8797dd26e admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:58.665947 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7e125-b3e8-4c55-9a3c-97a8797dd26e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:58.667999 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7e125-b3e8-4c55-9a3c-97a8797dd26e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:58.695055 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1354/2703] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:51:58 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:51:58.699735 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f901f-963a-4311-859e-db42e80092d4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:58.709941 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f901f-963a-4311-859e-db42e80092d4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:58.764322 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ce871-10aa-4910-9715-40322be95442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:58.764967 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ce871-10aa-4910-9715-40322be95442 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:58.765242 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ce871-10aa-4910-9715-40322be95442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:58.765509 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ce871-10aa-4910-9715-40322be95442 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:58.766200 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ce871-10aa-4910-9715-40322be95442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:58.768114 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ce871-10aa-4910-9715-40322be95442 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:58.787347 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1350/2704] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:51:58 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:51:58.791489 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7e125-b3e8-4c55-9a3c-97a8797dd26e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:58.802682 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7e125-b3e8-4c55-9a3c-97a8797dd26e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:58.807210 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb451891-aa32-4db9-89ab-045d8dff18c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:58.807881 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb451891-aa32-4db9-89ab-045d8dff18c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:58.808163 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb451891-aa32-4db9-89ab-045d8dff18c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:58.808464 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb451891-aa32-4db9-89ab-045d8dff18c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:58.809186 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb451891-aa32-4db9-89ab-045d8dff18c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:58.810742 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb451891-aa32-4db9-89ab-045d8dff18c6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:58.821038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1355/2705] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:51:58.824839 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ce871-10aa-4910-9715-40322be95442 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:58.834687 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ce871-10aa-4910-9715-40322be95442 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:58.839309 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a51c6a-e836-4ccd-bb4c-0f9c8ce05111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:58.839970 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a51c6a-e836-4ccd-bb4c-0f9c8ce05111 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:58.840247 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a51c6a-e836-4ccd-bb4c-0f9c8ce05111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:58.840515 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a51c6a-e836-4ccd-bb4c-0f9c8ce05111 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:58.841262 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a51c6a-e836-4ccd-bb4c-0f9c8ce05111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:58.842811 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a51c6a-e836-4ccd-bb4c-0f9c8ce05111 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:58.852944 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1351/2706] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:51:58.856965 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb451891-aa32-4db9-89ab-045d8dff18c6 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:58.867152 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb451891-aa32-4db9-89ab-045d8dff18c6 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:58.871771 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d47ca-79db-4b8a-b6b3-a2e254e3b24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:58.872623 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d47ca-79db-4b8a-b6b3-a2e254e3b24b admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:58.873165 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d47ca-79db-4b8a-b6b3-a2e254e3b24b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:58.873437 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d47ca-79db-4b8a-b6b3-a2e254e3b24b admin admin] PATH_INFO: `/v3/projects/b6fcf2a6f9c4411099e9b3e2d2dab48a/users/918795cc7e6e425a8bea6d47d8fe27c6/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:58.887270 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d47ca-79db-4b8a-b6b3-a2e254e3b24b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6fcf2a6f9c4411099e9b3e2d2dab48a, user_id=918795cc7e6e425a8bea6d47d8fe27c6, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:58.889906 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d47ca-79db-4b8a-b6b3-a2e254e3b24b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:58.902305 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1356/2707] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:51:58 2022] PUT /identity/v3/projects/b6fcf2a6f9c4411099e9b3e2d2dab48a/users/918795cc7e6e425a8bea6d47d8fe27c6/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:58.914251 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da415d77-eb63-46df-8837-596e01042449 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:58.914570 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da415d77-eb63-46df-8837-596e01042449 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:58.914852 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da415d77-eb63-46df-8837-596e01042449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:58.941442 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-da415d77-eb63-46df-8837-596e01042449 None None] MFA Rules not processed for user `918795cc7e6e425a8bea6d47d8fe27c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:58.942645 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-da415d77-eb63-46df-8837-596e01042449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:59.004344 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1352/2708] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:59.015408 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d47ca-79db-4b8a-b6b3-a2e254e3b24b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:59.017124 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d54d47ca-79db-4b8a-b6b3-a2e254e3b24b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:59.071504 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d47ca-79db-4b8a-b6b3-a2e254e3b24b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:59.075201 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21bca0-f36e-44a3-ac3a-460580afc1d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:59.075857 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21bca0-f36e-44a3-ac3a-460580afc1d4 service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:59.076141 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21bca0-f36e-44a3-ac3a-460580afc1d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:59.076416 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21bca0-f36e-44a3-ac3a-460580afc1d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:59.085099 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21bca0-f36e-44a3-ac3a-460580afc1d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:59.086513 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21bca0-f36e-44a3-ac3a-460580afc1d4 service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:59.094960 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1357/2709] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:51:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:51:59.113749 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da415d77-eb63-46df-8837-596e01042449 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:59.172640 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da415d77-eb63-46df-8837-596e01042449 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:59.177982 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49ccae-83f9-443a-aa10-91e9ca413e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:59.178835 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49ccae-83f9-443a-aa10-91e9ca413e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:59.179108 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49ccae-83f9-443a-aa10-91e9ca413e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:59.179377 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49ccae-83f9-443a-aa10-91e9ca413e12 admin admin] PATH_INFO: `/v3/users/918795cc7e6e425a8bea6d47d8fe27c6` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:59.180603 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49ccae-83f9-443a-aa10-91e9ca413e12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=918795cc7e6e425a8bea6d47d8fe27c6)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:59.182493 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49ccae-83f9-443a-aa10-91e9ca413e12 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:59.226386 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6a49ccae-83f9-443a-aa10-91e9ca413e12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '918795cc7e6e425a8bea6d47d8fe27c6'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:59.233546 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6a49ccae-83f9-443a-aa10-91e9ca413e12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '918795cc7e6e425a8bea6d47d8fe27c6'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:59.245203 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6a49ccae-83f9-443a-aa10-91e9ca413e12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '918795cc7e6e425a8bea6d47d8fe27c6'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:59.252454 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6a49ccae-83f9-443a-aa10-91e9ca413e12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '918795cc7e6e425a8bea6d47d8fe27c6'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:59.253722 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6a49ccae-83f9-443a-aa10-91e9ca413e12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '918795cc7e6e425a8bea6d47d8fe27c6'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:59.259883 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1353/2710] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:51:59 2022] DELETE /identity/v3/users/918795cc7e6e425a8bea6d47d8fe27c6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:59.267470 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f264f5e-dad3-4cdb-b969-6ae03bd37e93 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:59.267781 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f264f5e-dad3-4cdb-b969-6ae03bd37e93 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:59.268071 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f264f5e-dad3-4cdb-b969-6ae03bd37e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:59.285251 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-5f264f5e-dad3-4cdb-b969-6ae03bd37e93 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:59.286423 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5f264f5e-dad3-4cdb-b969-6ae03bd37e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:59.343352 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1358/2711] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:59.353392 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49ccae-83f9-443a-aa10-91e9ca413e12 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:59.354752 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6a49ccae-83f9-443a-aa10-91e9ca413e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:59.408555 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49ccae-83f9-443a-aa10-91e9ca413e12 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:59.412775 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae9ae7-429a-4656-8d43-a0bc7167edae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:59.413401 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae9ae7-429a-4656-8d43-a0bc7167edae service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:59.413679 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae9ae7-429a-4656-8d43-a0bc7167edae service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:59.413951 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae9ae7-429a-4656-8d43-a0bc7167edae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:59.422607 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae9ae7-429a-4656-8d43-a0bc7167edae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:59.424050 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae9ae7-429a-4656-8d43-a0bc7167edae service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:59.433231 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1354/2712] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:51:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:51:59.687606 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f264f5e-dad3-4cdb-b969-6ae03bd37e93 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:59.689089 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5f264f5e-dad3-4cdb-b969-6ae03bd37e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:59.704005 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f264f5e-dad3-4cdb-b969-6ae03bd37e93 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:59.709670 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83382bda-859c-4ec7-8c1e-7a245e1ed2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:59.710543 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83382bda-859c-4ec7-8c1e-7a245e1ed2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:59.710821 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83382bda-859c-4ec7-8c1e-7a245e1ed2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:59.711090 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83382bda-859c-4ec7-8c1e-7a245e1ed2d9 admin admin] PATH_INFO: `/v3/projects/b6fcf2a6f9c4411099e9b3e2d2dab48a` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:59.712408 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83382bda-859c-4ec7-8c1e-7a245e1ed2d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6fcf2a6f9c4411099e9b3e2d2dab48a)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:59.714574 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83382bda-859c-4ec7-8c1e-7a245e1ed2d9 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:59.760569 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-83382bda-859c-4ec7-8c1e-7a245e1ed2d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6fcf2a6f9c4411099e9b3e2d2dab48a', 'request_id': 'req-83382bda-859c-4ec7-8c1e-7a245e1ed2d9'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:59.766371 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-83382bda-859c-4ec7-8c1e-7a245e1ed2d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6fcf2a6f9c4411099e9b3e2d2dab48a', 'request_id': 'req-83382bda-859c-4ec7-8c1e-7a245e1ed2d9'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:59.772295 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-83382bda-859c-4ec7-8c1e-7a245e1ed2d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6fcf2a6f9c4411099e9b3e2d2dab48a', 'request_id': 'req-83382bda-859c-4ec7-8c1e-7a245e1ed2d9'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:59.783448 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-83382bda-859c-4ec7-8c1e-7a245e1ed2d9 admin admin] The token cache is being invalidate because project b6fcf2a6f9c4411099e9b3e2d2dab48a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:51:59.783765 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-83382bda-859c-4ec7-8c1e-7a245e1ed2d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:59.784408 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-83382bda-859c-4ec7-8c1e-7a245e1ed2d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:51:59.786001 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1359/2713] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:51:59 2022] DELETE /identity/v3/projects/b6fcf2a6f9c4411099e9b3e2d2dab48a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:51:59.791547 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8a207-d961-4582-9a96-3cef607bc6ca None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:59.792057 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8a207-d961-4582-9a96-3cef607bc6ca None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:59.792166 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8a207-d961-4582-9a96-3cef607bc6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:59.810276 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-daa8a207-d961-4582-9a96-3cef607bc6ca None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:59.811521 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-daa8a207-d961-4582-9a96-3cef607bc6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:59.867660 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1355/2714] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:59.875861 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c3ab9-790f-4db7-b667-38013c249b33 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:59.876148 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c3ab9-790f-4db7-b667-38013c249b33 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:59.876426 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c3ab9-790f-4db7-b667-38013c249b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:59.895230 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-544c3ab9-790f-4db7-b667-38013c249b33 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:51:59.896482 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-544c3ab9-790f-4db7-b667-38013c249b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:51:59.904787 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1360/2715] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:51:59.909338 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8a207-d961-4582-9a96-3cef607bc6ca None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:59.918926 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8a207-d961-4582-9a96-3cef607bc6ca None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:59.923425 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb000fa-6917-4fd8-95b5-228b0b269649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:59.924088 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb000fa-6917-4fd8-95b5-228b0b269649 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:59.924484 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb000fa-6917-4fd8-95b5-228b0b269649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:59.924757 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb000fa-6917-4fd8-95b5-228b0b269649 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:59.926068 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb000fa-6917-4fd8-95b5-228b0b269649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:51:59.926366 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb000fa-6917-4fd8-95b5-228b0b269649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:59.927960 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb000fa-6917-4fd8-95b5-228b0b269649 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:59.939119 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1356/2716] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:51:59.944044 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c3ab9-790f-4db7-b667-38013c249b33 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:51:59.952976 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c3ab9-790f-4db7-b667-38013c249b33 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:51:59.957742 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a6f44-85ca-4abc-9814-4a5b29ced1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:51:59.958448 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a6f44-85ca-4abc-9814-4a5b29ced1b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:51:59.958731 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a6f44-85ca-4abc-9814-4a5b29ced1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:51:59.959003 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a6f44-85ca-4abc-9814-4a5b29ced1b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:51:59.959709 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a6f44-85ca-4abc-9814-4a5b29ced1b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:51:59.961599 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a6f44-85ca-4abc-9814-4a5b29ced1b6 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:51:59.986921 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1361/2717] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:51:59 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:51:59.991513 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb000fa-6917-4fd8-95b5-228b0b269649 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:00.001579 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb000fa-6917-4fd8-95b5-228b0b269649 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:00.059874 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9418d42-bb73-4af0-b802-8b33f2c2f83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:00.060541 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9418d42-bb73-4af0-b802-8b33f2c2f83e admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:00.060827 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9418d42-bb73-4af0-b802-8b33f2c2f83e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:00.061103 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9418d42-bb73-4af0-b802-8b33f2c2f83e admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:00.061800 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9418d42-bb73-4af0-b802-8b33f2c2f83e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:00.063710 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9418d42-bb73-4af0-b802-8b33f2c2f83e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:00.087338 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1357/2718] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:51:59 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:52:00.091493 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a6f44-85ca-4abc-9814-4a5b29ced1b6 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:00.101602 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a6f44-85ca-4abc-9814-4a5b29ced1b6 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:00.106253 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d2f6b-6727-4e6b-bd59-f2f869f4b80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:00.106911 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d2f6b-6727-4e6b-bd59-f2f869f4b80b admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:00.107192 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d2f6b-6727-4e6b-bd59-f2f869f4b80b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:00.107462 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d2f6b-6727-4e6b-bd59-f2f869f4b80b admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:00.108222 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d2f6b-6727-4e6b-bd59-f2f869f4b80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:00.109780 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d2f6b-6727-4e6b-bd59-f2f869f4b80b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:00.120165 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1362/2719] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:52:00.124215 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9418d42-bb73-4af0-b802-8b33f2c2f83e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:00.134862 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9418d42-bb73-4af0-b802-8b33f2c2f83e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:00.139448 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691e668-9730-4222-a1c9-052db2d53b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:00.140118 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691e668-9730-4222-a1c9-052db2d53b13 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:00.140394 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691e668-9730-4222-a1c9-052db2d53b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:00.140671 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691e668-9730-4222-a1c9-052db2d53b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:00.141397 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691e668-9730-4222-a1c9-052db2d53b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:00.142964 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691e668-9730-4222-a1c9-052db2d53b13 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:00.152842 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1358/2720] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:52:00.156659 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d2f6b-6727-4e6b-bd59-f2f869f4b80b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:00.167234 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d2f6b-6727-4e6b-bd59-f2f869f4b80b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:00.171869 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99d106-a7ca-4b23-97bb-c4ce8ec91034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:00.172721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99d106-a7ca-4b23-97bb-c4ce8ec91034 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:00.172998 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99d106-a7ca-4b23-97bb-c4ce8ec91034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:00.173268 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99d106-a7ca-4b23-97bb-c4ce8ec91034 admin admin] PATH_INFO: `/v3/projects/f87bae17184e45aa824ec42861050dff/users/d0c33594a81b442fa550d83a5ecfa929/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:00.188346 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99d106-a7ca-4b23-97bb-c4ce8ec91034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87bae17184e45aa824ec42861050dff, user_id=d0c33594a81b442fa550d83a5ecfa929, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:00.191159 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99d106-a7ca-4b23-97bb-c4ce8ec91034 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:00.203659 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1363/2721] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:52:00 2022] PUT /identity/v3/projects/f87bae17184e45aa824ec42861050dff/users/d0c33594a81b442fa550d83a5ecfa929/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:52:00.214645 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada56667-1fa5-4ae5-9a7e-342beee4a22a None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:00.214917 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada56667-1fa5-4ae5-9a7e-342beee4a22a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:00.215194 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada56667-1fa5-4ae5-9a7e-342beee4a22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:00.243725 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ada56667-1fa5-4ae5-9a7e-342beee4a22a None None] MFA Rules not processed for user `d0c33594a81b442fa550d83a5ecfa929`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:52:00.244995 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ada56667-1fa5-4ae5-9a7e-342beee4a22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:00.313013 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1359/2722] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:52:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:52:00.318138 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99d106-a7ca-4b23-97bb-c4ce8ec91034 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:00.376488 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99d106-a7ca-4b23-97bb-c4ce8ec91034 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:00.381143 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d2b01-6eca-49b0-a499-b3f2bd685957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:00.381783 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d2b01-6eca-49b0-a499-b3f2bd685957 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:00.382062 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d2b01-6eca-49b0-a499-b3f2bd685957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:00.382332 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d2b01-6eca-49b0-a499-b3f2bd685957 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:00.383031 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d2b01-6eca-49b0-a499-b3f2bd685957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:00.384942 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d2b01-6eca-49b0-a499-b3f2bd685957 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:00.408846 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1364/2723] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:52:00 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:52:00.413650 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada56667-1fa5-4ae5-9a7e-342beee4a22a None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:00.424328 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada56667-1fa5-4ae5-9a7e-342beee4a22a None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:00.478945 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f46ee0-bdf1-41a8-a91b-7898c7bd75fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:00.479599 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f46ee0-bdf1-41a8-a91b-7898c7bd75fc admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:00.479918 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f46ee0-bdf1-41a8-a91b-7898c7bd75fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:00.480190 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f46ee0-bdf1-41a8-a91b-7898c7bd75fc admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:00.480888 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f46ee0-bdf1-41a8-a91b-7898c7bd75fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:00.482794 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f46ee0-bdf1-41a8-a91b-7898c7bd75fc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:00.502666 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1360/2724] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:52:00 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:52:00.507004 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d2b01-6eca-49b0-a499-b3f2bd685957 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:00.517214 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d2b01-6eca-49b0-a499-b3f2bd685957 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:00.521936 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d0a1c-98d9-4ce8-869b-8076dee98f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:00.522577 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d0a1c-98d9-4ce8-869b-8076dee98f2a admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:00.522858 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d0a1c-98d9-4ce8-869b-8076dee98f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:00.523135 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d0a1c-98d9-4ce8-869b-8076dee98f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:00.523909 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d0a1c-98d9-4ce8-869b-8076dee98f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:00.525479 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d0a1c-98d9-4ce8-869b-8076dee98f2a admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:00.536090 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1365/2725] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:52:00.540175 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f46ee0-bdf1-41a8-a91b-7898c7bd75fc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:00.550522 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f46ee0-bdf1-41a8-a91b-7898c7bd75fc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:00.555210 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95c618-a1f4-4fc8-8326-375455009f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:00.556144 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95c618-a1f4-4fc8-8326-375455009f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:00.556428 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95c618-a1f4-4fc8-8326-375455009f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:00.556702 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95c618-a1f4-4fc8-8326-375455009f89 admin admin] PATH_INFO: `/v3/projects/3a9a6dd76dc54d0fbe1e1346d3b54ae2/users/a40bf1ec718e439cb82df4224fac0269/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:00.572683 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95c618-a1f4-4fc8-8326-375455009f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a9a6dd76dc54d0fbe1e1346d3b54ae2, user_id=a40bf1ec718e439cb82df4224fac0269, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:00.575253 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95c618-a1f4-4fc8-8326-375455009f89 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:00.589764 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1361/2726] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:52:00 2022] PUT /identity/v3/projects/3a9a6dd76dc54d0fbe1e1346d3b54ae2/users/a40bf1ec718e439cb82df4224fac0269/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:52:00.594014 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d0a1c-98d9-4ce8-869b-8076dee98f2a admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:00.604665 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d0a1c-98d9-4ce8-869b-8076dee98f2a admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:00.660777 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f2fae-0db4-4a22-b9eb-81cb0bed71b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:00.661429 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f2fae-0db4-4a22-b9eb-81cb0bed71b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:00.661712 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f2fae-0db4-4a22-b9eb-81cb0bed71b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:00.661988 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f2fae-0db4-4a22-b9eb-81cb0bed71b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:00.662725 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f2fae-0db4-4a22-b9eb-81cb0bed71b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:00.664339 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f2fae-0db4-4a22-b9eb-81cb0bed71b3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:00.681038 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1366/2727] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:52:00.685135 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95c618-a1f4-4fc8-8326-375455009f89 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:00.695443 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95c618-a1f4-4fc8-8326-375455009f89 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:00.701010 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0d2a0-2c02-4a1a-a403-0477d2fa896c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:00.701878 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0d2a0-2c02-4a1a-a403-0477d2fa896c admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:00.702154 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0d2a0-2c02-4a1a-a403-0477d2fa896c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:00.702426 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0d2a0-2c02-4a1a-a403-0477d2fa896c admin admin] PATH_INFO: `/v3/projects/3a9a6dd76dc54d0fbe1e1346d3b54ae2/users/a40bf1ec718e439cb82df4224fac0269/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:00.704517 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0d2a0-2c02-4a1a-a403-0477d2fa896c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a9a6dd76dc54d0fbe1e1346d3b54ae2, user_id=a40bf1ec718e439cb82df4224fac0269, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:00.707673 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0d2a0-2c02-4a1a-a403-0477d2fa896c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:00.718521 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1362/2728] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:52:00 2022] PUT /identity/v3/projects/3a9a6dd76dc54d0fbe1e1346d3b54ae2/users/a40bf1ec718e439cb82df4224fac0269/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:52:00.729778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c0ab7-44de-481c-ad08-477b9e9a1115 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:00.730063 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c0ab7-44de-481c-ad08-477b9e9a1115 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:00.730342 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c0ab7-44de-481c-ad08-477b9e9a1115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:00.758452 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-4b3c0ab7-44de-481c-ad08-477b9e9a1115 None None] MFA Rules not processed for user `a40bf1ec718e439cb82df4224fac0269`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:52:00.760163 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-4b3c0ab7-44de-481c-ad08-477b9e9a1115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:00.830712 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1367/2729] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:52:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:52:00.842484 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0d2a0-2c02-4a1a-a403-0477d2fa896c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:00.844319 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-26c0d2a0-2c02-4a1a-a403-0477d2fa896c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:00.901385 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0d2a0-2c02-4a1a-a403-0477d2fa896c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:00.905463 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05caad68-0904-4dcb-afaa-2bdd46ccdcc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:00.906120 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05caad68-0904-4dcb-afaa-2bdd46ccdcc9 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:00.906408 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05caad68-0904-4dcb-afaa-2bdd46ccdcc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:00.906673 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05caad68-0904-4dcb-afaa-2bdd46ccdcc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:00.974109 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05caad68-0904-4dcb-afaa-2bdd46ccdcc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:00.975557 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05caad68-0904-4dcb-afaa-2bdd46ccdcc9 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:00.986369 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1363/2730] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:52:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:52:03.514993 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c0ab7-44de-481c-ad08-477b9e9a1115 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:03.574279 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c0ab7-44de-481c-ad08-477b9e9a1115 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:03.579023 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda396f2-f526-4079-8bdf-4a4c497b3b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:03.579899 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda396f2-f526-4079-8bdf-4a4c497b3b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:03.580180 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda396f2-f526-4079-8bdf-4a4c497b3b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:03.580454 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda396f2-f526-4079-8bdf-4a4c497b3b07 admin admin] PATH_INFO: `/v3/users/d0c33594a81b442fa550d83a5ecfa929` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:03.582190 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda396f2-f526-4079-8bdf-4a4c497b3b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0c33594a81b442fa550d83a5ecfa929)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:03.584160 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda396f2-f526-4079-8bdf-4a4c497b3b07 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:03.628536 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-cda396f2-f526-4079-8bdf-4a4c497b3b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0c33594a81b442fa550d83a5ecfa929'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:03.639645 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-cda396f2-f526-4079-8bdf-4a4c497b3b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0c33594a81b442fa550d83a5ecfa929'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:03.646653 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-cda396f2-f526-4079-8bdf-4a4c497b3b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0c33594a81b442fa550d83a5ecfa929'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:03.653723 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-cda396f2-f526-4079-8bdf-4a4c497b3b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0c33594a81b442fa550d83a5ecfa929'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:03.654339 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-cda396f2-f526-4079-8bdf-4a4c497b3b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0c33594a81b442fa550d83a5ecfa929'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:03.660598 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1368/2731] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:52:03 2022] DELETE /identity/v3/users/d0c33594a81b442fa550d83a5ecfa929 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:52:03.665121 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb947b95-6c8a-4b16-a9af-ccb4c7f68ed1 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:03.665623 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb947b95-6c8a-4b16-a9af-ccb4c7f68ed1 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:03.665728 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb947b95-6c8a-4b16-a9af-ccb4c7f68ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:03.682577 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-cb947b95-6c8a-4b16-a9af-ccb4c7f68ed1 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:52:03.683801 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cb947b95-6c8a-4b16-a9af-ccb4c7f68ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:03.741773 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1364/2732] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:52:03.751556 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda396f2-f526-4079-8bdf-4a4c497b3b07 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:03.753632 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-cda396f2-f526-4079-8bdf-4a4c497b3b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:03.807503 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda396f2-f526-4079-8bdf-4a4c497b3b07 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:03.811148 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630b8cb-413a-45a4-b2e7-099fb7457a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:03.811792 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630b8cb-413a-45a4-b2e7-099fb7457a7d service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:03.812078 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630b8cb-413a-45a4-b2e7-099fb7457a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:03.812355 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630b8cb-413a-45a4-b2e7-099fb7457a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:03.822227 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630b8cb-413a-45a4-b2e7-099fb7457a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:03.823639 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630b8cb-413a-45a4-b2e7-099fb7457a7d service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:03.833017 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1369/2733] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:52:04.089258 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb947b95-6c8a-4b16-a9af-ccb4c7f68ed1 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:04.090764 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cb947b95-6c8a-4b16-a9af-ccb4c7f68ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:04.103955 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb947b95-6c8a-4b16-a9af-ccb4c7f68ed1 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:04.108719 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b43707-55be-41d8-ab94-992b1d732223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:04.109973 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b43707-55be-41d8-ab94-992b1d732223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:04.109973 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b43707-55be-41d8-ab94-992b1d732223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:04.110217 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b43707-55be-41d8-ab94-992b1d732223 admin admin] PATH_INFO: `/v3/projects/f87bae17184e45aa824ec42861050dff` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:04.111770 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b43707-55be-41d8-ab94-992b1d732223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f87bae17184e45aa824ec42861050dff)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:04.114476 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b43707-55be-41d8-ab94-992b1d732223 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:04.160801 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-04b43707-55be-41d8-ab94-992b1d732223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f87bae17184e45aa824ec42861050dff', 'request_id': 'req-04b43707-55be-41d8-ab94-992b1d732223'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:04.166801 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-04b43707-55be-41d8-ab94-992b1d732223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f87bae17184e45aa824ec42861050dff', 'request_id': 'req-04b43707-55be-41d8-ab94-992b1d732223'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:04.172044 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-04b43707-55be-41d8-ab94-992b1d732223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f87bae17184e45aa824ec42861050dff', 'request_id': 'req-04b43707-55be-41d8-ab94-992b1d732223'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:04.184525 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-04b43707-55be-41d8-ab94-992b1d732223 admin admin] The token cache is being invalidate because project f87bae17184e45aa824ec42861050dff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:52:04.184813 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-04b43707-55be-41d8-ab94-992b1d732223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:04.185432 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-04b43707-55be-41d8-ab94-992b1d732223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:04.186962 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1365/2734] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:52:04 2022] DELETE /identity/v3/projects/f87bae17184e45aa824ec42861050dff => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:52:04.191413 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630b8cb-413a-45a4-b2e7-099fb7457a7d service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:04.200820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630b8cb-413a-45a4-b2e7-099fb7457a7d service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:04.255288 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76add178-9907-47cc-a03a-a1ca2ba1a367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:04.256161 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76add178-9907-47cc-a03a-a1ca2ba1a367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:04.256446 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76add178-9907-47cc-a03a-a1ca2ba1a367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:04.256724 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76add178-9907-47cc-a03a-a1ca2ba1a367 admin admin] PATH_INFO: `/v3/users/a40bf1ec718e439cb82df4224fac0269` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:04.257909 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76add178-9907-47cc-a03a-a1ca2ba1a367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a40bf1ec718e439cb82df4224fac0269)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:04.259831 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76add178-9907-47cc-a03a-a1ca2ba1a367 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:04.304216 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-76add178-9907-47cc-a03a-a1ca2ba1a367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a40bf1ec718e439cb82df4224fac0269'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:04.316440 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-76add178-9907-47cc-a03a-a1ca2ba1a367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a40bf1ec718e439cb82df4224fac0269'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:04.322993 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-76add178-9907-47cc-a03a-a1ca2ba1a367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a40bf1ec718e439cb82df4224fac0269'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:04.330029 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-76add178-9907-47cc-a03a-a1ca2ba1a367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a40bf1ec718e439cb82df4224fac0269'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:04.330732 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-76add178-9907-47cc-a03a-a1ca2ba1a367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a40bf1ec718e439cb82df4224fac0269'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:04.337014 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1370/2735] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:52:04 2022] DELETE /identity/v3/users/a40bf1ec718e439cb82df4224fac0269 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:52:04.593002 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b43707-55be-41d8-ab94-992b1d732223 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:04.594500 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-04b43707-55be-41d8-ab94-992b1d732223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:04.608164 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b43707-55be-41d8-ab94-992b1d732223 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:04.664287 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28c4d4-90e8-4810-9d14-5a5a0ff9be75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:04.665131 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28c4d4-90e8-4810-9d14-5a5a0ff9be75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:04.665708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28c4d4-90e8-4810-9d14-5a5a0ff9be75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:04.665708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28c4d4-90e8-4810-9d14-5a5a0ff9be75 admin admin] PATH_INFO: `/v3/projects/3a9a6dd76dc54d0fbe1e1346d3b54ae2` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:04.666839 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28c4d4-90e8-4810-9d14-5a5a0ff9be75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a9a6dd76dc54d0fbe1e1346d3b54ae2)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:04.668843 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28c4d4-90e8-4810-9d14-5a5a0ff9be75 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:04.714316 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6a28c4d4-90e8-4810-9d14-5a5a0ff9be75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a9a6dd76dc54d0fbe1e1346d3b54ae2', 'request_id': 'req-6a28c4d4-90e8-4810-9d14-5a5a0ff9be75'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:04.720315 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6a28c4d4-90e8-4810-9d14-5a5a0ff9be75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a9a6dd76dc54d0fbe1e1346d3b54ae2', 'request_id': 'req-6a28c4d4-90e8-4810-9d14-5a5a0ff9be75'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:04.726034 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6a28c4d4-90e8-4810-9d14-5a5a0ff9be75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a9a6dd76dc54d0fbe1e1346d3b54ae2', 'request_id': 'req-6a28c4d4-90e8-4810-9d14-5a5a0ff9be75'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:04.738560 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6a28c4d4-90e8-4810-9d14-5a5a0ff9be75 admin admin] The token cache is being invalidate because project 3a9a6dd76dc54d0fbe1e1346d3b54ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:52:04.738862 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6a28c4d4-90e8-4810-9d14-5a5a0ff9be75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:04.739474 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6a28c4d4-90e8-4810-9d14-5a5a0ff9be75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:04.741622 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1366/2736] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:52:04 2022] DELETE /identity/v3/projects/3a9a6dd76dc54d0fbe1e1346d3b54ae2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:52:04.747461 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33158fa-b2a3-4177-b774-ab8b89fce831 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:04.748227 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33158fa-b2a3-4177-b774-ab8b89fce831 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:04.748344 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33158fa-b2a3-4177-b774-ab8b89fce831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:04.766346 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-e33158fa-b2a3-4177-b774-ab8b89fce831 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:52:04.767537 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-e33158fa-b2a3-4177-b774-ab8b89fce831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:04.823389 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1371/2737] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:52:04.832713 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e92904-39d3-469f-b973-c53778b08461 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:04.833002 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e92904-39d3-469f-b973-c53778b08461 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:04.833276 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e92904-39d3-469f-b973-c53778b08461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:04.851345 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c6e92904-39d3-469f-b973-c53778b08461 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:52:04.852511 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c6e92904-39d3-469f-b973-c53778b08461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:04.860365 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1367/2738] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:52:04.864672 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33158fa-b2a3-4177-b774-ab8b89fce831 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:04.874448 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33158fa-b2a3-4177-b774-ab8b89fce831 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:04.880064 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739807d8-2d02-4bdb-8c4f-eac0427d8d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:04.880702 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739807d8-2d02-4bdb-8c4f-eac0427d8d69 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:04.880985 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739807d8-2d02-4bdb-8c4f-eac0427d8d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:04.881263 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739807d8-2d02-4bdb-8c4f-eac0427d8d69 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:04.881993 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739807d8-2d02-4bdb-8c4f-eac0427d8d69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:52:04.882298 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739807d8-2d02-4bdb-8c4f-eac0427d8d69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:04.883948 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739807d8-2d02-4bdb-8c4f-eac0427d8d69 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:04.895895 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1372/2739] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:52:04.900258 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e92904-39d3-469f-b973-c53778b08461 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:04.909607 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e92904-39d3-469f-b973-c53778b08461 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:04.914421 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c05bd2-8612-4990-aaae-68ca129efda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:04.915120 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c05bd2-8612-4990-aaae-68ca129efda9 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:04.915449 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c05bd2-8612-4990-aaae-68ca129efda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:04.915722 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c05bd2-8612-4990-aaae-68ca129efda9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:04.916595 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c05bd2-8612-4990-aaae-68ca129efda9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:04.918572 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c05bd2-8612-4990-aaae-68ca129efda9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:04.944543 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1368/2740] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:52:04 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:52:04.948608 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739807d8-2d02-4bdb-8c4f-eac0427d8d69 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:04.960756 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739807d8-2d02-4bdb-8c4f-eac0427d8d69 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:05.033000 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837b36d-5b8f-4a0b-b6eb-7d1421c09578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:05.033745 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837b36d-5b8f-4a0b-b6eb-7d1421c09578 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:05.034634 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837b36d-5b8f-4a0b-b6eb-7d1421c09578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:05.035101 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837b36d-5b8f-4a0b-b6eb-7d1421c09578 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:05.037775 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837b36d-5b8f-4a0b-b6eb-7d1421c09578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:05.038069 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837b36d-5b8f-4a0b-b6eb-7d1421c09578 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:05.060431 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1373/2741] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:52:04 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:52:05.064721 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c05bd2-8612-4990-aaae-68ca129efda9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:05.076079 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c05bd2-8612-4990-aaae-68ca129efda9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:05.081515 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafdb51-5518-4fa7-a009-d67ed1f49089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:05.082196 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafdb51-5518-4fa7-a009-d67ed1f49089 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:05.082563 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafdb51-5518-4fa7-a009-d67ed1f49089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:05.082846 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafdb51-5518-4fa7-a009-d67ed1f49089 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:05.083614 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafdb51-5518-4fa7-a009-d67ed1f49089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:05.085404 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafdb51-5518-4fa7-a009-d67ed1f49089 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:05.098884 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1369/2742] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:52:05.103091 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837b36d-5b8f-4a0b-b6eb-7d1421c09578 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:05.113600 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837b36d-5b8f-4a0b-b6eb-7d1421c09578 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:05.118733 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8168de-ab71-4272-b57b-7620de1090ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:05.119376 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8168de-ab71-4272-b57b-7620de1090ca admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:05.119653 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8168de-ab71-4272-b57b-7620de1090ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:05.119959 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8168de-ab71-4272-b57b-7620de1090ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:05.120689 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8168de-ab71-4272-b57b-7620de1090ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:05.122283 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8168de-ab71-4272-b57b-7620de1090ca admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:05.132408 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1374/2743] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:52:05.136941 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafdb51-5518-4fa7-a009-d67ed1f49089 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:05.147447 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafdb51-5518-4fa7-a009-d67ed1f49089 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:05.152632 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d6d37-884a-4d6d-8f4f-5dabd2b8b541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:05.153490 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d6d37-884a-4d6d-8f4f-5dabd2b8b541 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:05.153774 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d6d37-884a-4d6d-8f4f-5dabd2b8b541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:05.154041 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d6d37-884a-4d6d-8f4f-5dabd2b8b541 admin admin] PATH_INFO: `/v3/projects/945bb23f210246a4af11b1e363ecb8ad/users/051440e4a8744b10be1c700d1c712c77/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:05.170001 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d6d37-884a-4d6d-8f4f-5dabd2b8b541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=945bb23f210246a4af11b1e363ecb8ad, user_id=051440e4a8744b10be1c700d1c712c77, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:05.172771 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d6d37-884a-4d6d-8f4f-5dabd2b8b541 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:05.186507 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1370/2744] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:52:05 2022] PUT /identity/v3/projects/945bb23f210246a4af11b1e363ecb8ad/users/051440e4a8744b10be1c700d1c712c77/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:52:05.198159 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0d337-e54a-4107-9be6-190650a2f967 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:05.198159 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0d337-e54a-4107-9be6-190650a2f967 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:05.198159 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0d337-e54a-4107-9be6-190650a2f967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:05.232948 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-2db0d337-e54a-4107-9be6-190650a2f967 None None] MFA Rules not processed for user `051440e4a8744b10be1c700d1c712c77`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:52:05.234208 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-2db0d337-e54a-4107-9be6-190650a2f967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:05.304881 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1375/2745] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:52:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:52:05.309662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d6d37-884a-4d6d-8f4f-5dabd2b8b541 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:05.369544 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d6d37-884a-4d6d-8f4f-5dabd2b8b541 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:05.374377 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2997b5f-ce0a-49e1-8c70-5a3555137b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:05.375017 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2997b5f-ce0a-49e1-8c70-5a3555137b53 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:05.375296 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2997b5f-ce0a-49e1-8c70-5a3555137b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:05.375567 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2997b5f-ce0a-49e1-8c70-5a3555137b53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:05.376330 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2997b5f-ce0a-49e1-8c70-5a3555137b53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:05.378390 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2997b5f-ce0a-49e1-8c70-5a3555137b53 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:05.402503 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1371/2746] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:52:05 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:52:05.406580 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0d337-e54a-4107-9be6-190650a2f967 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:05.417995 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0d337-e54a-4107-9be6-190650a2f967 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:05.471564 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93146db-0581-4e1d-9123-0b5c1521fc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:05.472329 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93146db-0581-4e1d-9123-0b5c1521fc82 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:05.472612 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93146db-0581-4e1d-9123-0b5c1521fc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:05.472891 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93146db-0581-4e1d-9123-0b5c1521fc82 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:05.473628 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93146db-0581-4e1d-9123-0b5c1521fc82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:05.475519 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93146db-0581-4e1d-9123-0b5c1521fc82 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:05.495172 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1376/2747] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:52:05 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:52:05.499129 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2997b5f-ce0a-49e1-8c70-5a3555137b53 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:05.509714 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2997b5f-ce0a-49e1-8c70-5a3555137b53 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:05.514450 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de37c2a-8b03-4940-90c4-04ac7071c5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:05.515084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de37c2a-8b03-4940-90c4-04ac7071c5be admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:05.515362 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de37c2a-8b03-4940-90c4-04ac7071c5be admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:05.515636 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de37c2a-8b03-4940-90c4-04ac7071c5be admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:05.516391 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de37c2a-8b03-4940-90c4-04ac7071c5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:05.517975 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de37c2a-8b03-4940-90c4-04ac7071c5be admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:05.528685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1372/2748] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:52:05.532644 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93146db-0581-4e1d-9123-0b5c1521fc82 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:05.542339 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93146db-0581-4e1d-9123-0b5c1521fc82 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:05.546867 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d3b40-6371-4c03-a6ee-0f74c70676af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:05.547515 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d3b40-6371-4c03-a6ee-0f74c70676af admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:05.547833 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d3b40-6371-4c03-a6ee-0f74c70676af admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:05.548117 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d3b40-6371-4c03-a6ee-0f74c70676af admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:05.548855 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d3b40-6371-4c03-a6ee-0f74c70676af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:05.550796 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d3b40-6371-4c03-a6ee-0f74c70676af admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:05.560204 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1377/2749] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:52:05.564168 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de37c2a-8b03-4940-90c4-04ac7071c5be admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:05.574508 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de37c2a-8b03-4940-90c4-04ac7071c5be admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:05.579066 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bac0eb-5023-46ff-a163-2ebbaf1b4af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:05.579969 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bac0eb-5023-46ff-a163-2ebbaf1b4af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:05.580254 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bac0eb-5023-46ff-a163-2ebbaf1b4af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:05.580530 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bac0eb-5023-46ff-a163-2ebbaf1b4af5 admin admin] PATH_INFO: `/v3/projects/811334186a48414786fa55b89e5bda43/users/4e808953c9d14e618f09f80c26ba0320/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:05.596999 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bac0eb-5023-46ff-a163-2ebbaf1b4af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=811334186a48414786fa55b89e5bda43, user_id=4e808953c9d14e618f09f80c26ba0320, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:05.599640 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bac0eb-5023-46ff-a163-2ebbaf1b4af5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:05.613454 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1373/2750] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:52:05 2022] PUT /identity/v3/projects/811334186a48414786fa55b89e5bda43/users/4e808953c9d14e618f09f80c26ba0320/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:52:05.624167 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a196f2-0655-4754-9d83-9709a738800c None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:05.624394 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a196f2-0655-4754-9d83-9709a738800c None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:05.624673 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a196f2-0655-4754-9d83-9709a738800c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:05.651365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-75a196f2-0655-4754-9d83-9709a738800c None None] MFA Rules not processed for user `4e808953c9d14e618f09f80c26ba0320`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:52:05.652593 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-75a196f2-0655-4754-9d83-9709a738800c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:05.715054 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1378/2751] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:52:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:52:05.719704 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bac0eb-5023-46ff-a163-2ebbaf1b4af5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:05.779258 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bac0eb-5023-46ff-a163-2ebbaf1b4af5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:05.783936 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99741b6-aa9a-405d-b926-de9dc8d5086c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:05.784585 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99741b6-aa9a-405d-b926-de9dc8d5086c admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:05.784868 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99741b6-aa9a-405d-b926-de9dc8d5086c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:05.785146 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99741b6-aa9a-405d-b926-de9dc8d5086c admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:05.785851 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99741b6-aa9a-405d-b926-de9dc8d5086c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:05.787733 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99741b6-aa9a-405d-b926-de9dc8d5086c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:05.811933 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1374/2752] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:52:05 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:52:05.816538 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a196f2-0655-4754-9d83-9709a738800c None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:05.827069 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a196f2-0655-4754-9d83-9709a738800c None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:05.880953 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe70840-78aa-4809-b7cd-bf865d6cdeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:05.881543 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe70840-78aa-4809-b7cd-bf865d6cdeee admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:05.881821 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe70840-78aa-4809-b7cd-bf865d6cdeee admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:05.882095 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe70840-78aa-4809-b7cd-bf865d6cdeee admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:05.882830 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe70840-78aa-4809-b7cd-bf865d6cdeee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:05.884850 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe70840-78aa-4809-b7cd-bf865d6cdeee admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:05.903711 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1379/2753] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:52:05 2022] POST /identity/v3/users => generated 299 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:52:05.907691 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99741b6-aa9a-405d-b926-de9dc8d5086c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:05.917803 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99741b6-aa9a-405d-b926-de9dc8d5086c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:05.922369 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6889ec-bd4e-4a8d-b499-f682b27086a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:05.923007 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6889ec-bd4e-4a8d-b499-f682b27086a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:05.923285 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6889ec-bd4e-4a8d-b499-f682b27086a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:05.923560 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6889ec-bd4e-4a8d-b499-f682b27086a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:05.924319 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6889ec-bd4e-4a8d-b499-f682b27086a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:05.926655 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6889ec-bd4e-4a8d-b499-f682b27086a2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:05.937053 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1375/2754] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:52:05.941811 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe70840-78aa-4809-b7cd-bf865d6cdeee admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:05.951366 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe70840-78aa-4809-b7cd-bf865d6cdeee admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:05.955964 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff36d4-1bfa-49c1-8402-0650f4b6337d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:05.956957 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff36d4-1bfa-49c1-8402-0650f4b6337d admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:05.957235 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff36d4-1bfa-49c1-8402-0650f4b6337d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:05.957507 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff36d4-1bfa-49c1-8402-0650f4b6337d admin admin] PATH_INFO: `/v3/projects/eeb9d59640814d83a3894f3f6bbd9eca/users/a973fce29add47b1b021566dbd4f8b16/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:05.971189 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff36d4-1bfa-49c1-8402-0650f4b6337d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb9d59640814d83a3894f3f6bbd9eca, user_id=a973fce29add47b1b021566dbd4f8b16, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:05.973971 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff36d4-1bfa-49c1-8402-0650f4b6337d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:05.986329 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1380/2755] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:52:05 2022] PUT /identity/v3/projects/eeb9d59640814d83a3894f3f6bbd9eca/users/a973fce29add47b1b021566dbd4f8b16/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:52:05.990992 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6889ec-bd4e-4a8d-b499-f682b27086a2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:06.000899 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6889ec-bd4e-4a8d-b499-f682b27086a2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:06.053767 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f501c-b980-43c8-afeb-4395ae9e8819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:06.054447 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f501c-b980-43c8-afeb-4395ae9e8819 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:06.054730 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f501c-b980-43c8-afeb-4395ae9e8819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:06.055007 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f501c-b980-43c8-afeb-4395ae9e8819 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:06.055740 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f501c-b980-43c8-afeb-4395ae9e8819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:06.057357 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f501c-b980-43c8-afeb-4395ae9e8819 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:06.067426 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1376/2756] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:52:06.071567 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff36d4-1bfa-49c1-8402-0650f4b6337d admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:06.082068 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff36d4-1bfa-49c1-8402-0650f4b6337d admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:06.086570 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b1ea5-2107-4b13-90b1-48561e510bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:06.087426 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b1ea5-2107-4b13-90b1-48561e510bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:06.087705 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b1ea5-2107-4b13-90b1-48561e510bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:06.088029 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b1ea5-2107-4b13-90b1-48561e510bcb admin admin] PATH_INFO: `/v3/projects/eeb9d59640814d83a3894f3f6bbd9eca/users/a973fce29add47b1b021566dbd4f8b16/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:06.090002 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b1ea5-2107-4b13-90b1-48561e510bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb9d59640814d83a3894f3f6bbd9eca, user_id=a973fce29add47b1b021566dbd4f8b16, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:06.092641 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b1ea5-2107-4b13-90b1-48561e510bcb admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:06.103040 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1381/2757] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:52:06 2022] PUT /identity/v3/projects/eeb9d59640814d83a3894f3f6bbd9eca/users/a973fce29add47b1b021566dbd4f8b16/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:52:06.114377 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fec2b-ef5f-4ece-8775-da39c452b3ee None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:06.114666 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fec2b-ef5f-4ece-8775-da39c452b3ee None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:06.114942 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fec2b-ef5f-4ece-8775-da39c452b3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:06.141216 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-b51fec2b-ef5f-4ece-8775-da39c452b3ee None None] MFA Rules not processed for user `a973fce29add47b1b021566dbd4f8b16`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:52:06.142347 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b51fec2b-ef5f-4ece-8775-da39c452b3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:06.206539 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1377/2758] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:52:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:52:06.217516 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b1ea5-2107-4b13-90b1-48561e510bcb admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:06.219177 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-1a2b1ea5-2107-4b13-90b1-48561e510bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:06.286814 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b1ea5-2107-4b13-90b1-48561e510bcb admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:06.290721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7765564-b052-4cf3-bdcd-50971d4da32c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:06.291356 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7765564-b052-4cf3-bdcd-50971d4da32c service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:06.291633 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7765564-b052-4cf3-bdcd-50971d4da32c service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:06.291935 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7765564-b052-4cf3-bdcd-50971d4da32c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:06.345980 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7765564-b052-4cf3-bdcd-50971d4da32c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:06.347960 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7765564-b052-4cf3-bdcd-50971d4da32c service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:06.356730 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1382/2759] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:52:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:52:07.816813 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fec2b-ef5f-4ece-8775-da39c452b3ee None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:07.818252 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b51fec2b-ef5f-4ece-8775-da39c452b3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:07.829867 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fec2b-ef5f-4ece-8775-da39c452b3ee None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:07.833710 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4b1d6-935c-4d18-85ac-9752220376f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:07.834340 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4b1d6-935c-4d18-85ac-9752220376f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:07.834620 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4b1d6-935c-4d18-85ac-9752220376f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:07.834892 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4b1d6-935c-4d18-85ac-9752220376f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:07.889387 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4b1d6-935c-4d18-85ac-9752220376f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:07.890742 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4b1d6-935c-4d18-85ac-9752220376f0 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:07.899938 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1378/2760] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:52:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:52:08.385987 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7765564-b052-4cf3-bdcd-50971d4da32c service cinder] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:08.395165 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7765564-b052-4cf3-bdcd-50971d4da32c service cinder] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:08.398913 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a7ddf-3ad2-4b3a-919b-34f91fd95e8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:08.399478 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a7ddf-3ad2-4b3a-919b-34f91fd95e8d service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:08.399778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a7ddf-3ad2-4b3a-919b-34f91fd95e8d service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:08.400062 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a7ddf-3ad2-4b3a-919b-34f91fd95e8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:08.408908 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a7ddf-3ad2-4b3a-919b-34f91fd95e8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:08.411094 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a7ddf-3ad2-4b3a-919b-34f91fd95e8d service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:08.420442 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1383/2761] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:52:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:52:12.262359 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4b1d6-935c-4d18-85ac-9752220376f0 service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:12.323304 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4b1d6-935c-4d18-85ac-9752220376f0 service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:12.327868 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf2e31-c8bf-4c15-b55e-85a9203990a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:12.328723 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf2e31-c8bf-4c15-b55e-85a9203990a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:12.328999 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf2e31-c8bf-4c15-b55e-85a9203990a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:12.329270 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf2e31-c8bf-4c15-b55e-85a9203990a9 admin admin] PATH_INFO: `/v3/users/051440e4a8744b10be1c700d1c712c77` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:12.330465 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf2e31-c8bf-4c15-b55e-85a9203990a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=051440e4a8744b10be1c700d1c712c77)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:12.332746 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf2e31-c8bf-4c15-b55e-85a9203990a9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:12.379122 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-fcdf2e31-c8bf-4c15-b55e-85a9203990a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '051440e4a8744b10be1c700d1c712c77'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:12.385750 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-fcdf2e31-c8bf-4c15-b55e-85a9203990a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '051440e4a8744b10be1c700d1c712c77'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:12.398088 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-fcdf2e31-c8bf-4c15-b55e-85a9203990a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '051440e4a8744b10be1c700d1c712c77'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:12.405581 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-fcdf2e31-c8bf-4c15-b55e-85a9203990a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '051440e4a8744b10be1c700d1c712c77'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:12.406202 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-fcdf2e31-c8bf-4c15-b55e-85a9203990a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '051440e4a8744b10be1c700d1c712c77'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:12.412368 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1379/2762] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:52:12 2022] DELETE /identity/v3/users/051440e4a8744b10be1c700d1c712c77 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:52:12.416963 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2a258-bbe4-46a5-93c5-f3446122eb0f None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:12.417813 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2a258-bbe4-46a5-93c5-f3446122eb0f None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:12.417813 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2a258-bbe4-46a5-93c5-f3446122eb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:12.434921 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-b4f2a258-bbe4-46a5-93c5-f3446122eb0f None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:52:12.436378 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-b4f2a258-bbe4-46a5-93c5-f3446122eb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:12.494894 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1384/2763] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:52:12.505448 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf2e31-c8bf-4c15-b55e-85a9203990a9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:12.506952 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-fcdf2e31-c8bf-4c15-b55e-85a9203990a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:12.562516 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf2e31-c8bf-4c15-b55e-85a9203990a9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:12.566779 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbedae5-a6b0-4a01-885b-c25c984e1030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:12.567408 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbedae5-a6b0-4a01-885b-c25c984e1030 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:12.567685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbedae5-a6b0-4a01-885b-c25c984e1030 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:12.567985 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbedae5-a6b0-4a01-885b-c25c984e1030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:12.576694 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbedae5-a6b0-4a01-885b-c25c984e1030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:12.578102 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbedae5-a6b0-4a01-885b-c25c984e1030 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:12.587253 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1380/2764] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:52:12.858865 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2a258-bbe4-46a5-93c5-f3446122eb0f None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:12.860303 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-b4f2a258-bbe4-46a5-93c5-f3446122eb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:12.872851 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2a258-bbe4-46a5-93c5-f3446122eb0f None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:12.877656 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ec98d-0089-44f9-af40-68dda62e0ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:12.879417 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ec98d-0089-44f9-af40-68dda62e0ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:12.880043 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ec98d-0089-44f9-af40-68dda62e0ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:12.880320 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ec98d-0089-44f9-af40-68dda62e0ca2 admin admin] PATH_INFO: `/v3/projects/945bb23f210246a4af11b1e363ecb8ad` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:12.881552 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ec98d-0089-44f9-af40-68dda62e0ca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=945bb23f210246a4af11b1e363ecb8ad)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:12.883565 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ec98d-0089-44f9-af40-68dda62e0ca2 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:12.929627 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a06ec98d-0089-44f9-af40-68dda62e0ca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '945bb23f210246a4af11b1e363ecb8ad', 'request_id': 'req-a06ec98d-0089-44f9-af40-68dda62e0ca2'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:12.935627 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a06ec98d-0089-44f9-af40-68dda62e0ca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '945bb23f210246a4af11b1e363ecb8ad', 'request_id': 'req-a06ec98d-0089-44f9-af40-68dda62e0ca2'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:12.941528 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a06ec98d-0089-44f9-af40-68dda62e0ca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '945bb23f210246a4af11b1e363ecb8ad', 'request_id': 'req-a06ec98d-0089-44f9-af40-68dda62e0ca2'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:12.953088 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a06ec98d-0089-44f9-af40-68dda62e0ca2 admin admin] The token cache is being invalidate because project 945bb23f210246a4af11b1e363ecb8ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:52:12.953375 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a06ec98d-0089-44f9-af40-68dda62e0ca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:12.953983 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-a06ec98d-0089-44f9-af40-68dda62e0ca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:12.955543 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1385/2765] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:52:12 2022] DELETE /identity/v3/projects/945bb23f210246a4af11b1e363ecb8ad => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:52:12.959961 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbedae5-a6b0-4a01-885b-c25c984e1030 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:12.969853 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbedae5-a6b0-4a01-885b-c25c984e1030 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:13.028190 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea416d38-bfe0-4a9d-90cd-38c06fe85071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:13.029042 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea416d38-bfe0-4a9d-90cd-38c06fe85071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:13.029335 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea416d38-bfe0-4a9d-90cd-38c06fe85071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:13.029587 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea416d38-bfe0-4a9d-90cd-38c06fe85071 admin admin] PATH_INFO: `/v3/users/4e808953c9d14e618f09f80c26ba0320` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:13.030759 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea416d38-bfe0-4a9d-90cd-38c06fe85071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e808953c9d14e618f09f80c26ba0320)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:13.032691 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea416d38-bfe0-4a9d-90cd-38c06fe85071 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:13.076096 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ea416d38-bfe0-4a9d-90cd-38c06fe85071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e808953c9d14e618f09f80c26ba0320'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:13.083616 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ea416d38-bfe0-4a9d-90cd-38c06fe85071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e808953c9d14e618f09f80c26ba0320'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:13.094994 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ea416d38-bfe0-4a9d-90cd-38c06fe85071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e808953c9d14e618f09f80c26ba0320'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:13.102111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ea416d38-bfe0-4a9d-90cd-38c06fe85071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e808953c9d14e618f09f80c26ba0320'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:13.102754 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ea416d38-bfe0-4a9d-90cd-38c06fe85071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e808953c9d14e618f09f80c26ba0320'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:13.108526 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1381/2766] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:52:12 2022] DELETE /identity/v3/users/4e808953c9d14e618f09f80c26ba0320 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:52:13.367648 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ec98d-0089-44f9-af40-68dda62e0ca2 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:13.369117 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-a06ec98d-0089-44f9-af40-68dda62e0ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:13.382273 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ec98d-0089-44f9-af40-68dda62e0ca2 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:13.439092 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f7dd1-5114-40a4-9a7e-8a90356ef7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:13.439980 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f7dd1-5114-40a4-9a7e-8a90356ef7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:13.440263 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f7dd1-5114-40a4-9a7e-8a90356ef7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:13.440535 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f7dd1-5114-40a4-9a7e-8a90356ef7aa admin admin] PATH_INFO: `/v3/projects/811334186a48414786fa55b89e5bda43` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:13.442370 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f7dd1-5114-40a4-9a7e-8a90356ef7aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=811334186a48414786fa55b89e5bda43)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:13.444308 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f7dd1-5114-40a4-9a7e-8a90356ef7aa admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:13.486795 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-431f7dd1-5114-40a4-9a7e-8a90356ef7aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '811334186a48414786fa55b89e5bda43', 'request_id': 'req-431f7dd1-5114-40a4-9a7e-8a90356ef7aa'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:13.493241 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-431f7dd1-5114-40a4-9a7e-8a90356ef7aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '811334186a48414786fa55b89e5bda43', 'request_id': 'req-431f7dd1-5114-40a4-9a7e-8a90356ef7aa'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:13.498501 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-431f7dd1-5114-40a4-9a7e-8a90356ef7aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '811334186a48414786fa55b89e5bda43', 'request_id': 'req-431f7dd1-5114-40a4-9a7e-8a90356ef7aa'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:13.510780 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-431f7dd1-5114-40a4-9a7e-8a90356ef7aa admin admin] The token cache is being invalidate because project 811334186a48414786fa55b89e5bda43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:52:13.511089 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-431f7dd1-5114-40a4-9a7e-8a90356ef7aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:13.511721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-431f7dd1-5114-40a4-9a7e-8a90356ef7aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:13.513254 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1386/2767] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:52:13 2022] DELETE /identity/v3/projects/811334186a48414786fa55b89e5bda43 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:52:13.517273 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea416d38-bfe0-4a9d-90cd-38c06fe85071 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:13.518755 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ea416d38-bfe0-4a9d-90cd-38c06fe85071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:13.531668 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea416d38-bfe0-4a9d-90cd-38c06fe85071 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:13.587661 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe71cb-e479-4d35-b65e-488f60224106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:13.588555 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe71cb-e479-4d35-b65e-488f60224106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:13.588833 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe71cb-e479-4d35-b65e-488f60224106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:13.589104 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe71cb-e479-4d35-b65e-488f60224106 admin admin] PATH_INFO: `/v3/users/a973fce29add47b1b021566dbd4f8b16` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:13.590289 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe71cb-e479-4d35-b65e-488f60224106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a973fce29add47b1b021566dbd4f8b16)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:13.592227 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe71cb-e479-4d35-b65e-488f60224106 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:13.636712 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1dfe71cb-e479-4d35-b65e-488f60224106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a973fce29add47b1b021566dbd4f8b16'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:13.643198 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1dfe71cb-e479-4d35-b65e-488f60224106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a973fce29add47b1b021566dbd4f8b16'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:13.654575 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1dfe71cb-e479-4d35-b65e-488f60224106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a973fce29add47b1b021566dbd4f8b16'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:13.662087 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1dfe71cb-e479-4d35-b65e-488f60224106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a973fce29add47b1b021566dbd4f8b16'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:13.662736 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1dfe71cb-e479-4d35-b65e-488f60224106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a973fce29add47b1b021566dbd4f8b16'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:13.668567 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1382/2768] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:52:13 2022] DELETE /identity/v3/users/a973fce29add47b1b021566dbd4f8b16 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:52:13.929237 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f7dd1-5114-40a4-9a7e-8a90356ef7aa admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:13.930814 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-431f7dd1-5114-40a4-9a7e-8a90356ef7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:13.944340 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f7dd1-5114-40a4-9a7e-8a90356ef7aa admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:14.005863 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94379ea6-be49-4833-a89c-73bb6ae38654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:14.006712 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94379ea6-be49-4833-a89c-73bb6ae38654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:14.007004 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94379ea6-be49-4833-a89c-73bb6ae38654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:14.007282 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94379ea6-be49-4833-a89c-73bb6ae38654 admin admin] PATH_INFO: `/v3/projects/eeb9d59640814d83a3894f3f6bbd9eca` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:14.008503 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94379ea6-be49-4833-a89c-73bb6ae38654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb9d59640814d83a3894f3f6bbd9eca)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:14.010393 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94379ea6-be49-4833-a89c-73bb6ae38654 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:14.059066 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-94379ea6-be49-4833-a89c-73bb6ae38654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb9d59640814d83a3894f3f6bbd9eca', 'request_id': 'req-94379ea6-be49-4833-a89c-73bb6ae38654'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:14.065022 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-94379ea6-be49-4833-a89c-73bb6ae38654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb9d59640814d83a3894f3f6bbd9eca', 'request_id': 'req-94379ea6-be49-4833-a89c-73bb6ae38654'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:14.070366 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-94379ea6-be49-4833-a89c-73bb6ae38654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb9d59640814d83a3894f3f6bbd9eca', 'request_id': 'req-94379ea6-be49-4833-a89c-73bb6ae38654'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:14.082696 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-94379ea6-be49-4833-a89c-73bb6ae38654 admin admin] The token cache is being invalidate because project eeb9d59640814d83a3894f3f6bbd9eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:52:14.082980 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-94379ea6-be49-4833-a89c-73bb6ae38654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:14.083685 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-94379ea6-be49-4833-a89c-73bb6ae38654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:14.085254 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1387/2769] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:52:13 2022] DELETE /identity/v3/projects/eeb9d59640814d83a3894f3f6bbd9eca => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:52:14.091143 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0ab51-4674-44b6-8f84-0a446c929d55 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:14.091426 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0ab51-4674-44b6-8f84-0a446c929d55 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:14.091698 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0ab51-4674-44b6-8f84-0a446c929d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:14.109374 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c3c0ab51-4674-44b6-8f84-0a446c929d55 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:52:14.110725 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c3c0ab51-4674-44b6-8f84-0a446c929d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:14.168369 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1383/2770] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:52:14.176863 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2ba9b-9eb6-49ac-9a19-f47a354b27f7 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:14.177146 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2ba9b-9eb6-49ac-9a19-f47a354b27f7 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:14.177420 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2ba9b-9eb6-49ac-9a19-f47a354b27f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:14.195925 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-36e2ba9b-9eb6-49ac-9a19-f47a354b27f7 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:52:14.197156 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-36e2ba9b-9eb6-49ac-9a19-f47a354b27f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:14.205034 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1388/2771] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:52:14.209579 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0ab51-4674-44b6-8f84-0a446c929d55 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:14.219055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0ab51-4674-44b6-8f84-0a446c929d55 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:14.224070 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05703ee5-36bf-4a1c-9665-7ca06e588291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:14.224718 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05703ee5-36bf-4a1c-9665-7ca06e588291 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:14.224998 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05703ee5-36bf-4a1c-9665-7ca06e588291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:14.225271 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05703ee5-36bf-4a1c-9665-7ca06e588291 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:14.226003 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05703ee5-36bf-4a1c-9665-7ca06e588291 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:52:14.226306 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05703ee5-36bf-4a1c-9665-7ca06e588291 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:14.228005 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05703ee5-36bf-4a1c-9665-7ca06e588291 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:14.240076 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1384/2772] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:52:14.244341 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2ba9b-9eb6-49ac-9a19-f47a354b27f7 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:14.254228 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2ba9b-9eb6-49ac-9a19-f47a354b27f7 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:14.259324 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb561e2-3d93-4489-95e7-4c2be537b3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:14.260001 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb561e2-3d93-4489-95e7-4c2be537b3fe admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:14.260286 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb561e2-3d93-4489-95e7-4c2be537b3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:14.260559 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb561e2-3d93-4489-95e7-4c2be537b3fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:14.261270 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb561e2-3d93-4489-95e7-4c2be537b3fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:14.263164 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb561e2-3d93-4489-95e7-4c2be537b3fe admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:14.289575 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1389/2773] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:52:14 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:52:14.293655 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05703ee5-36bf-4a1c-9665-7ca06e588291 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:14.304002 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05703ee5-36bf-4a1c-9665-7ca06e588291 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:14.359920 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d4aa3-5593-4bdf-a356-3fa2c9715fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:14.360583 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d4aa3-5593-4bdf-a356-3fa2c9715fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:14.360861 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d4aa3-5593-4bdf-a356-3fa2c9715fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:14.361130 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d4aa3-5593-4bdf-a356-3fa2c9715fb1 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:14.361819 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d4aa3-5593-4bdf-a356-3fa2c9715fb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:14.363946 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d4aa3-5593-4bdf-a356-3fa2c9715fb1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:14.383088 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1385/2774] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:52:14 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:52:14.387357 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb561e2-3d93-4489-95e7-4c2be537b3fe admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:14.398416 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb561e2-3d93-4489-95e7-4c2be537b3fe admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:14.403003 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e77e0d-9d7e-46de-add6-1ba94d4117cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:14.403647 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e77e0d-9d7e-46de-add6-1ba94d4117cb admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:14.403968 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e77e0d-9d7e-46de-add6-1ba94d4117cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:14.404247 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e77e0d-9d7e-46de-add6-1ba94d4117cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:14.405011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e77e0d-9d7e-46de-add6-1ba94d4117cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:14.406580 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e77e0d-9d7e-46de-add6-1ba94d4117cb admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:14.417683 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1390/2775] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:52:14.421533 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d4aa3-5593-4bdf-a356-3fa2c9715fb1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:14.431414 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d4aa3-5593-4bdf-a356-3fa2c9715fb1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:14.436145 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48646692-fcc5-4a29-a181-9ce7b05dc34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:14.436788 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48646692-fcc5-4a29-a181-9ce7b05dc34a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:14.437072 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48646692-fcc5-4a29-a181-9ce7b05dc34a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:14.437348 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48646692-fcc5-4a29-a181-9ce7b05dc34a admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:14.438079 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48646692-fcc5-4a29-a181-9ce7b05dc34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:14.439659 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48646692-fcc5-4a29-a181-9ce7b05dc34a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:14.450062 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1386/2776] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:52:14.453981 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e77e0d-9d7e-46de-add6-1ba94d4117cb admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:14.464284 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e77e0d-9d7e-46de-add6-1ba94d4117cb admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:14.468860 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dba31d-7075-4096-b12f-b31d73e9a027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:14.469707 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dba31d-7075-4096-b12f-b31d73e9a027 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:14.469981 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dba31d-7075-4096-b12f-b31d73e9a027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:14.470252 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dba31d-7075-4096-b12f-b31d73e9a027 admin admin] PATH_INFO: `/v3/projects/72a20f042866488a9b399e738852b333/users/2b323216ceb84feebe8610c194366250/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:14.484016 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dba31d-7075-4096-b12f-b31d73e9a027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a20f042866488a9b399e738852b333, user_id=2b323216ceb84feebe8610c194366250, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:14.486597 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dba31d-7075-4096-b12f-b31d73e9a027 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:14.499248 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1391/2777] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:52:14 2022] PUT /identity/v3/projects/72a20f042866488a9b399e738852b333/users/2b323216ceb84feebe8610c194366250/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:52:14.509805 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27afe0-9319-406b-a13b-cd8b81dba2d7 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:14.510114 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27afe0-9319-406b-a13b-cd8b81dba2d7 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:14.510412 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27afe0-9319-406b-a13b-cd8b81dba2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:14.536839 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-4d27afe0-9319-406b-a13b-cd8b81dba2d7 None None] MFA Rules not processed for user `2b323216ceb84feebe8610c194366250`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:52:14.538049 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4d27afe0-9319-406b-a13b-cd8b81dba2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:14.600824 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1387/2778] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:52:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:52:14.611365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dba31d-7075-4096-b12f-b31d73e9a027 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:14.613063 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-47dba31d-7075-4096-b12f-b31d73e9a027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:14.668202 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dba31d-7075-4096-b12f-b31d73e9a027 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:14.671786 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438b6fd-17a3-422b-8781-b5d339909680 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:14.672419 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438b6fd-17a3-422b-8781-b5d339909680 service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:14.672694 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438b6fd-17a3-422b-8781-b5d339909680 service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:14.672964 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438b6fd-17a3-422b-8781-b5d339909680 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:14.681252 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438b6fd-17a3-422b-8781-b5d339909680 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:14.682661 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438b6fd-17a3-422b-8781-b5d339909680 service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:14.691608 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1392/2779] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:52:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:52:36.946908 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27afe0-9319-406b-a13b-cd8b81dba2d7 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:37.012566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27afe0-9319-406b-a13b-cd8b81dba2d7 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:37.017049 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a6f90-4bca-4436-98fb-4dec99f3b237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:37.017913 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a6f90-4bca-4436-98fb-4dec99f3b237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:37.018193 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a6f90-4bca-4436-98fb-4dec99f3b237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:37.018467 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a6f90-4bca-4436-98fb-4dec99f3b237 admin admin] PATH_INFO: `/v3/users/2b323216ceb84feebe8610c194366250` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:37.019674 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a6f90-4bca-4436-98fb-4dec99f3b237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b323216ceb84feebe8610c194366250)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:37.021741 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a6f90-4bca-4436-98fb-4dec99f3b237 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:37.067226 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2d0a6f90-4bca-4436-98fb-4dec99f3b237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b323216ceb84feebe8610c194366250'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:37.073863 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2d0a6f90-4bca-4436-98fb-4dec99f3b237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b323216ceb84feebe8610c194366250'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:37.085388 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2d0a6f90-4bca-4436-98fb-4dec99f3b237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b323216ceb84feebe8610c194366250'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:37.092206 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2d0a6f90-4bca-4436-98fb-4dec99f3b237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b323216ceb84feebe8610c194366250'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:37.092832 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2d0a6f90-4bca-4436-98fb-4dec99f3b237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b323216ceb84feebe8610c194366250'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:37.099771 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1388/2780] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:52:36 2022] DELETE /identity/v3/users/2b323216ceb84feebe8610c194366250 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:52:37.104271 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e887b-db7e-4429-96f1-fa592149df0e None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:37.104790 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e887b-db7e-4429-96f1-fa592149df0e None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:37.104899 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e887b-db7e-4429-96f1-fa592149df0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:37.122320 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-e79e887b-db7e-4429-96f1-fa592149df0e None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:52:37.123785 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-e79e887b-db7e-4429-96f1-fa592149df0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:37.180467 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1393/2781] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:52:37.189962 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a6f90-4bca-4436-98fb-4dec99f3b237 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:37.191350 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2d0a6f90-4bca-4436-98fb-4dec99f3b237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:37.250844 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a6f90-4bca-4436-98fb-4dec99f3b237 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:37.254526 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee3329-37ea-4ac9-8ca1-2d1f1ce27172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:37.255154 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee3329-37ea-4ac9-8ca1-2d1f1ce27172 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:37.255438 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee3329-37ea-4ac9-8ca1-2d1f1ce27172 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:37.255717 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee3329-37ea-4ac9-8ca1-2d1f1ce27172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:37.264925 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee3329-37ea-4ac9-8ca1-2d1f1ce27172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:37.266382 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee3329-37ea-4ac9-8ca1-2d1f1ce27172 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:37.276719 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1389/2782] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:52:37.528151 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e887b-db7e-4429-96f1-fa592149df0e None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:37.529559 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-e79e887b-db7e-4429-96f1-fa592149df0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:37.541749 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e887b-db7e-4429-96f1-fa592149df0e None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:37.547779 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1976d-8089-4b37-847b-b5bbe6537153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:37.548622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1976d-8089-4b37-847b-b5bbe6537153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:37.548901 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1976d-8089-4b37-847b-b5bbe6537153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:37.549177 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1976d-8089-4b37-847b-b5bbe6537153 admin admin] PATH_INFO: `/v3/projects/72a20f042866488a9b399e738852b333` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:37.550363 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1976d-8089-4b37-847b-b5bbe6537153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a20f042866488a9b399e738852b333)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:37.552326 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1976d-8089-4b37-847b-b5bbe6537153 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:37.599610 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-6cc1976d-8089-4b37-847b-b5bbe6537153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a20f042866488a9b399e738852b333', 'request_id': 'req-6cc1976d-8089-4b37-847b-b5bbe6537153'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:37.605509 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-6cc1976d-8089-4b37-847b-b5bbe6537153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a20f042866488a9b399e738852b333', 'request_id': 'req-6cc1976d-8089-4b37-847b-b5bbe6537153'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:37.611060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-6cc1976d-8089-4b37-847b-b5bbe6537153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a20f042866488a9b399e738852b333', 'request_id': 'req-6cc1976d-8089-4b37-847b-b5bbe6537153'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:37.623857 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-6cc1976d-8089-4b37-847b-b5bbe6537153 admin admin] The token cache is being invalidate because project 72a20f042866488a9b399e738852b333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:52:37.624140 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-6cc1976d-8089-4b37-847b-b5bbe6537153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:37.624757 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-6cc1976d-8089-4b37-847b-b5bbe6537153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:52:37.626263 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1394/2783] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:52:37 2022] DELETE /identity/v3/projects/72a20f042866488a9b399e738852b333 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:52:49.594262 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee3329-37ea-4ac9-8ca1-2d1f1ce27172 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:49.603641 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee3329-37ea-4ac9-8ca1-2d1f1ce27172 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:49.651030 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3de8c-3945-4991-8c02-72de48fac4d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:49.651660 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3de8c-3945-4991-8c02-72de48fac4d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:49.651976 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3de8c-3945-4991-8c02-72de48fac4d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:49.652255 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3de8c-3945-4991-8c02-72de48fac4d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:49.654034 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-28c3de8c-3945-4991-8c02-72de48fac4d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:49.663708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3de8c-3945-4991-8c02-72de48fac4d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:49.665195 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3de8c-3945-4991-8c02-72de48fac4d8 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:49.672956 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1390/2784] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:52:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:52:59.667696 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1976d-8089-4b37-847b-b5bbe6537153 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:52:59.669287 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-6cc1976d-8089-4b37-847b-b5bbe6537153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:59.754111 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1976d-8089-4b37-847b-b5bbe6537153 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:52:59.762158 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92380a2-a979-4ca4-b6b3-2bbc76029a51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:52:59.762858 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92380a2-a979-4ca4-b6b3-2bbc76029a51 service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:52:59.763140 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92380a2-a979-4ca4-b6b3-2bbc76029a51 service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:52:59.763411 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92380a2-a979-4ca4-b6b3-2bbc76029a51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:52:59.765295 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-f92380a2-a979-4ca4-b6b3-2bbc76029a51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:52:59.780007 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92380a2-a979-4ca4-b6b3-2bbc76029a51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:52:59.781602 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92380a2-a979-4ca4-b6b3-2bbc76029a51 service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:52:59.795628 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1395/2785] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:52:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:53:03.586485 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3de8c-3945-4991-8c02-72de48fac4d8 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:03.587970 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-28c3de8c-3945-4991-8c02-72de48fac4d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:03.599205 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3de8c-3945-4991-8c02-72de48fac4d8 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:03.603147 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b74a1f-a697-4c70-a5e3-30eec83ed6dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:03.603803 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b74a1f-a697-4c70-a5e3-30eec83ed6dc service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:03.604093 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b74a1f-a697-4c70-a5e3-30eec83ed6dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:03.604372 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b74a1f-a697-4c70-a5e3-30eec83ed6dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:03.606111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-82b74a1f-a697-4c70-a5e3-30eec83ed6dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:03.666383 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b74a1f-a697-4c70-a5e3-30eec83ed6dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:03.667831 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b74a1f-a697-4c70-a5e3-30eec83ed6dc service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:03.678403 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1391/2786] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:53:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:53:06.854762 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92380a2-a979-4ca4-b6b3-2bbc76029a51 service nova] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:06.856245 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-f92380a2-a979-4ca4-b6b3-2bbc76029a51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:06.871682 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92380a2-a979-4ca4-b6b3-2bbc76029a51 service nova] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:06.876815 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d237cf-04bb-42c7-b063-f0992451938e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:06.877735 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d237cf-04bb-42c7-b063-f0992451938e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:06.878079 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d237cf-04bb-42c7-b063-f0992451938e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:06.878569 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d237cf-04bb-42c7-b063-f0992451938e admin admin] PATH_INFO: `/v3/users/c858d129681846aba9e366c37c2213a0` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:06.880111 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d237cf-04bb-42c7-b063-f0992451938e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c858d129681846aba9e366c37c2213a0)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:06.882017 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d237cf-04bb-42c7-b063-f0992451938e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:06.928522 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-05d237cf-04bb-42c7-b063-f0992451938e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c858d129681846aba9e366c37c2213a0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:06.939740 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-05d237cf-04bb-42c7-b063-f0992451938e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c858d129681846aba9e366c37c2213a0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:06.947007 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-05d237cf-04bb-42c7-b063-f0992451938e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c858d129681846aba9e366c37c2213a0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:06.954092 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-05d237cf-04bb-42c7-b063-f0992451938e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c858d129681846aba9e366c37c2213a0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:06.955102 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-05d237cf-04bb-42c7-b063-f0992451938e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c858d129681846aba9e366c37c2213a0'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:06.961196 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1396/2787] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:53:06 2022] DELETE /identity/v3/users/c858d129681846aba9e366c37c2213a0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:07.127046 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b74a1f-a697-4c70-a5e3-30eec83ed6dc service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:07.137848 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b74a1f-a697-4c70-a5e3-30eec83ed6dc service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:07.194264 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc58bc4-4d9b-415e-8793-1b9a266f529c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:07.195114 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc58bc4-4d9b-415e-8793-1b9a266f529c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:07.195450 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc58bc4-4d9b-415e-8793-1b9a266f529c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:07.195741 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc58bc4-4d9b-415e-8793-1b9a266f529c admin admin] PATH_INFO: `/v3/projects/23325df6a88748fc9261e22c093ac67e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:07.196972 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc58bc4-4d9b-415e-8793-1b9a266f529c admin admin] RBAC: Authorizing `identity:delete_project(project_id=23325df6a88748fc9261e22c093ac67e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:07.198874 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc58bc4-4d9b-415e-8793-1b9a266f529c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:07.245125 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9dc58bc4-4d9b-415e-8793-1b9a266f529c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23325df6a88748fc9261e22c093ac67e', 'request_id': 'req-9dc58bc4-4d9b-415e-8793-1b9a266f529c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:07.251217 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9dc58bc4-4d9b-415e-8793-1b9a266f529c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23325df6a88748fc9261e22c093ac67e', 'request_id': 'req-9dc58bc4-4d9b-415e-8793-1b9a266f529c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:07.257449 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9dc58bc4-4d9b-415e-8793-1b9a266f529c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23325df6a88748fc9261e22c093ac67e', 'request_id': 'req-9dc58bc4-4d9b-415e-8793-1b9a266f529c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:07.272174 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9dc58bc4-4d9b-415e-8793-1b9a266f529c admin admin] The token cache is being invalidate because project 23325df6a88748fc9261e22c093ac67e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:53:07.272460 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9dc58bc4-4d9b-415e-8793-1b9a266f529c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:07.273063 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9dc58bc4-4d9b-415e-8793-1b9a266f529c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:07.274622 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1392/2788] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:53:07 2022] DELETE /identity/v3/projects/23325df6a88748fc9261e22c093ac67e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:07.280428 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459aecb-135e-4e11-930a-5bd2234ebf31 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:07.280716 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459aecb-135e-4e11-930a-5bd2234ebf31 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:07.280993 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459aecb-135e-4e11-930a-5bd2234ebf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:07.298626 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-8459aecb-135e-4e11-930a-5bd2234ebf31 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:07.299877 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-8459aecb-135e-4e11-930a-5bd2234ebf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:07.366587 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1397/2789] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:07.374804 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0a811-6995-4704-a479-61f56a0a2caa None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:07.375097 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0a811-6995-4704-a479-61f56a0a2caa None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:07.375396 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0a811-6995-4704-a479-61f56a0a2caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:07.393228 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-eff0a811-6995-4704-a479-61f56a0a2caa None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:07.394452 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-eff0a811-6995-4704-a479-61f56a0a2caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:07.402566 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1393/2790] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:07.406628 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459aecb-135e-4e11-930a-5bd2234ebf31 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:07.416954 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459aecb-135e-4e11-930a-5bd2234ebf31 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:07.424622 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ac407-5ce1-41fb-ab3e-47b85cd0faa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:07.425736 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ac407-5ce1-41fb-ab3e-47b85cd0faa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:07.426861 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ac407-5ce1-41fb-ab3e-47b85cd0faa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:07.427363 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ac407-5ce1-41fb-ab3e-47b85cd0faa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:07.428782 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ac407-5ce1-41fb-ab3e-47b85cd0faa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:53:07.429335 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ac407-5ce1-41fb-ab3e-47b85cd0faa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:07.432399 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ac407-5ce1-41fb-ab3e-47b85cd0faa3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:07.445628 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1398/2791] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:53:07.449827 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0a811-6995-4704-a479-61f56a0a2caa None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:07.459548 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0a811-6995-4704-a479-61f56a0a2caa None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:07.464121 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe96223-6e73-416b-bbc5-e7ceba27db49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:07.464745 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe96223-6e73-416b-bbc5-e7ceba27db49 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:07.465017 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe96223-6e73-416b-bbc5-e7ceba27db49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:07.465283 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe96223-6e73-416b-bbc5-e7ceba27db49 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:07.465979 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe96223-6e73-416b-bbc5-e7ceba27db49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:07.467872 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe96223-6e73-416b-bbc5-e7ceba27db49 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:07.491657 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1394/2792] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:53:07 2022] POST /identity/v3/projects => generated 373 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:53:07.495806 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ac407-5ce1-41fb-ab3e-47b85cd0faa3 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:07.506226 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ac407-5ce1-41fb-ab3e-47b85cd0faa3 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:07.559004 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce748c-8158-458a-b4a7-9d8a197e47b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:07.559653 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce748c-8158-458a-b4a7-9d8a197e47b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:07.559970 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce748c-8158-458a-b4a7-9d8a197e47b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:07.560246 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce748c-8158-458a-b4a7-9d8a197e47b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:07.560934 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce748c-8158-458a-b4a7-9d8a197e47b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:07.562820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce748c-8158-458a-b4a7-9d8a197e47b8 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:07.582158 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1399/2793] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:53:07 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:53:07.586901 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe96223-6e73-416b-bbc5-e7ceba27db49 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:07.596917 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe96223-6e73-416b-bbc5-e7ceba27db49 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:07.601630 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895eda8-51d3-4ca0-8bfb-defe8f423e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:07.602274 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895eda8-51d3-4ca0-8bfb-defe8f423e0d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:07.602557 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895eda8-51d3-4ca0-8bfb-defe8f423e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:07.602829 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895eda8-51d3-4ca0-8bfb-defe8f423e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:07.603558 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895eda8-51d3-4ca0-8bfb-defe8f423e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:07.605163 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895eda8-51d3-4ca0-8bfb-defe8f423e0d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:07.615496 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1395/2794] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:53:07.619309 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce748c-8158-458a-b4a7-9d8a197e47b8 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:07.629864 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce748c-8158-458a-b4a7-9d8a197e47b8 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:07.634499 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4d113-714a-4ac5-8787-d8999f98032d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:07.635137 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4d113-714a-4ac5-8787-d8999f98032d admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:07.635420 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4d113-714a-4ac5-8787-d8999f98032d admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:07.635693 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4d113-714a-4ac5-8787-d8999f98032d admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:07.636457 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4d113-714a-4ac5-8787-d8999f98032d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:07.638011 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4d113-714a-4ac5-8787-d8999f98032d admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:07.648146 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1400/2795] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:53:07.651981 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895eda8-51d3-4ca0-8bfb-defe8f423e0d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:07.661739 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895eda8-51d3-4ca0-8bfb-defe8f423e0d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:07.666208 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce86d83-8ecc-4af1-b8a1-94f6463e59d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:07.667065 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce86d83-8ecc-4af1-b8a1-94f6463e59d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:07.667346 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce86d83-8ecc-4af1-b8a1-94f6463e59d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:07.667620 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce86d83-8ecc-4af1-b8a1-94f6463e59d6 admin admin] PATH_INFO: `/v3/projects/26c710a0b2144a4986f846f3b7edc533/users/1e0b50672fa04d2e925568ae3352d4ba/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:07.682878 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce86d83-8ecc-4af1-b8a1-94f6463e59d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c710a0b2144a4986f846f3b7edc533, user_id=1e0b50672fa04d2e925568ae3352d4ba, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:07.685612 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce86d83-8ecc-4af1-b8a1-94f6463e59d6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:07.698308 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1396/2796] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:53:07 2022] PUT /identity/v3/projects/26c710a0b2144a4986f846f3b7edc533/users/1e0b50672fa04d2e925568ae3352d4ba/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:53:07.712245 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f02cc-d490-4535-af1d-9f271d17ef67 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:07.714469 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f02cc-d490-4535-af1d-9f271d17ef67 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:07.714469 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f02cc-d490-4535-af1d-9f271d17ef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:07.742300 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-271f02cc-d490-4535-af1d-9f271d17ef67 None None] MFA Rules not processed for user `1e0b50672fa04d2e925568ae3352d4ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:07.743502 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-271f02cc-d490-4535-af1d-9f271d17ef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:07.804707 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1401/2797] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:07.815734 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce86d83-8ecc-4af1-b8a1-94f6463e59d6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:07.817505 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-8ce86d83-8ecc-4af1-b8a1-94f6463e59d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:07.887685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce86d83-8ecc-4af1-b8a1-94f6463e59d6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:07.893193 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0c15a-a5fd-4e4d-9569-010608e4f2a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:07.893850 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0c15a-a5fd-4e4d-9569-010608e4f2a7 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:07.894127 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0c15a-a5fd-4e4d-9569-010608e4f2a7 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:07.894398 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0c15a-a5fd-4e4d-9569-010608e4f2a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:07.902625 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0c15a-a5fd-4e4d-9569-010608e4f2a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:07.904223 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0c15a-a5fd-4e4d-9569-010608e4f2a7 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:07.913572 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1397/2798] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:53:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:53:10.554909 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f02cc-d490-4535-af1d-9f271d17ef67 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:10.613346 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f02cc-d490-4535-af1d-9f271d17ef67 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:10.617979 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2058f-cafa-4d60-b97a-eb521e76c573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:10.618816 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2058f-cafa-4d60-b97a-eb521e76c573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:10.619093 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2058f-cafa-4d60-b97a-eb521e76c573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:10.619364 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2058f-cafa-4d60-b97a-eb521e76c573 admin admin] PATH_INFO: `/v3/users/1e0b50672fa04d2e925568ae3352d4ba` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:10.620564 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2058f-cafa-4d60-b97a-eb521e76c573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e0b50672fa04d2e925568ae3352d4ba)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:10.622478 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2058f-cafa-4d60-b97a-eb521e76c573 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:10.666091 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5da2058f-cafa-4d60-b97a-eb521e76c573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e0b50672fa04d2e925568ae3352d4ba'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:10.678500 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5da2058f-cafa-4d60-b97a-eb521e76c573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e0b50672fa04d2e925568ae3352d4ba'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:10.684998 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5da2058f-cafa-4d60-b97a-eb521e76c573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e0b50672fa04d2e925568ae3352d4ba'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:10.692599 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5da2058f-cafa-4d60-b97a-eb521e76c573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e0b50672fa04d2e925568ae3352d4ba'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:10.693210 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5da2058f-cafa-4d60-b97a-eb521e76c573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e0b50672fa04d2e925568ae3352d4ba'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:10.698886 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1402/2799] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:53:10 2022] DELETE /identity/v3/users/1e0b50672fa04d2e925568ae3352d4ba => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:10.703786 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3e9a2-42c0-41c4-895f-b86743f9db95 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:10.704276 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3e9a2-42c0-41c4-895f-b86743f9db95 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:10.704385 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3e9a2-42c0-41c4-895f-b86743f9db95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:10.721164 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-3ee3e9a2-42c0-41c4-895f-b86743f9db95 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:10.722394 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3ee3e9a2-42c0-41c4-895f-b86743f9db95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:10.784648 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1398/2800] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:10.794714 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2058f-cafa-4d60-b97a-eb521e76c573 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:10.796106 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5da2058f-cafa-4d60-b97a-eb521e76c573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:10.851335 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2058f-cafa-4d60-b97a-eb521e76c573 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:10.854874 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b738654-e62a-4748-b9be-02f78a5e72da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:10.855493 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b738654-e62a-4748-b9be-02f78a5e72da service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:10.855824 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b738654-e62a-4748-b9be-02f78a5e72da service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:10.856097 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b738654-e62a-4748-b9be-02f78a5e72da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:10.865469 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b738654-e62a-4748-b9be-02f78a5e72da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:10.866879 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b738654-e62a-4748-b9be-02f78a5e72da service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:10.876495 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1403/2801] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:53:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:53:11.137884 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3e9a2-42c0-41c4-895f-b86743f9db95 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:11.139462 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3ee3e9a2-42c0-41c4-895f-b86743f9db95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:11.152524 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3e9a2-42c0-41c4-895f-b86743f9db95 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:11.159356 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e906f-ee84-478d-9f5d-1197cb5acf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:11.160250 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e906f-ee84-478d-9f5d-1197cb5acf9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:11.161168 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e906f-ee84-478d-9f5d-1197cb5acf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:11.161536 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e906f-ee84-478d-9f5d-1197cb5acf9b admin admin] PATH_INFO: `/v3/projects/26c710a0b2144a4986f846f3b7edc533` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:11.163122 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e906f-ee84-478d-9f5d-1197cb5acf9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=26c710a0b2144a4986f846f3b7edc533)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:11.165066 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e906f-ee84-478d-9f5d-1197cb5acf9b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:11.210502 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-240e906f-ee84-478d-9f5d-1197cb5acf9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26c710a0b2144a4986f846f3b7edc533', 'request_id': 'req-240e906f-ee84-478d-9f5d-1197cb5acf9b'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:11.216415 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-240e906f-ee84-478d-9f5d-1197cb5acf9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26c710a0b2144a4986f846f3b7edc533', 'request_id': 'req-240e906f-ee84-478d-9f5d-1197cb5acf9b'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:11.221610 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-240e906f-ee84-478d-9f5d-1197cb5acf9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26c710a0b2144a4986f846f3b7edc533', 'request_id': 'req-240e906f-ee84-478d-9f5d-1197cb5acf9b'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:11.234071 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-240e906f-ee84-478d-9f5d-1197cb5acf9b admin admin] The token cache is being invalidate because project 26c710a0b2144a4986f846f3b7edc533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:53:11.234357 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-240e906f-ee84-478d-9f5d-1197cb5acf9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:11.234987 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-240e906f-ee84-478d-9f5d-1197cb5acf9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:11.236532 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1399/2802] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:53:11 2022] DELETE /identity/v3/projects/26c710a0b2144a4986f846f3b7edc533 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:11.244316 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe31df7-53ea-4a68-be2c-803d8016f689 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:11.244678 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe31df7-53ea-4a68-be2c-803d8016f689 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:11.244959 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe31df7-53ea-4a68-be2c-803d8016f689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:11.262385 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-3fe31df7-53ea-4a68-be2c-803d8016f689 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:11.263571 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-3fe31df7-53ea-4a68-be2c-803d8016f689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:11.320079 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1404/2803] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:11.328050 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e4db7-c0ab-4cb3-b309-b3e10a264b29 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:11.328344 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e4db7-c0ab-4cb3-b309-b3e10a264b29 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:11.328650 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e4db7-c0ab-4cb3-b309-b3e10a264b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:11.346656 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e98e4db7-c0ab-4cb3-b309-b3e10a264b29 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:11.348414 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e98e4db7-c0ab-4cb3-b309-b3e10a264b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:11.356535 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1400/2804] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:53:11.360744 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe31df7-53ea-4a68-be2c-803d8016f689 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:11.370987 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe31df7-53ea-4a68-be2c-803d8016f689 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:11.375804 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b905a50-0af2-4f8e-9ff9-7c3666c5fffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:11.376447 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b905a50-0af2-4f8e-9ff9-7c3666c5fffd admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:11.376726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b905a50-0af2-4f8e-9ff9-7c3666c5fffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:11.377001 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b905a50-0af2-4f8e-9ff9-7c3666c5fffd admin admin] PATH_INFO: `/v3/domains` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:11.377728 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b905a50-0af2-4f8e-9ff9-7c3666c5fffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79340) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:53:11.378028 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b905a50-0af2-4f8e-9ff9-7c3666c5fffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:11.380211 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b905a50-0af2-4f8e-9ff9-7c3666c5fffd admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:11.391549 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1405/2805] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:53:11.396792 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e4db7-c0ab-4cb3-b309-b3e10a264b29 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:11.405856 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e4db7-c0ab-4cb3-b309-b3e10a264b29 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:11.410829 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546fab6-1bb0-43b8-963b-dd0500dd28dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:11.411596 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546fab6-1bb0-43b8-963b-dd0500dd28dd admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:11.411920 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546fab6-1bb0-43b8-963b-dd0500dd28dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:11.412197 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546fab6-1bb0-43b8-963b-dd0500dd28dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:11.412906 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546fab6-1bb0-43b8-963b-dd0500dd28dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:11.414798 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546fab6-1bb0-43b8-963b-dd0500dd28dd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:11.439762 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1401/2806] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:53:11 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:53:11.444602 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b905a50-0af2-4f8e-9ff9-7c3666c5fffd admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:11.454317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b905a50-0af2-4f8e-9ff9-7c3666c5fffd admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:11.509987 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7644498-489b-451d-855e-6e3cd138a139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:11.510646 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7644498-489b-451d-855e-6e3cd138a139 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:11.510925 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7644498-489b-451d-855e-6e3cd138a139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:11.511198 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7644498-489b-451d-855e-6e3cd138a139 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:11.511938 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7644498-489b-451d-855e-6e3cd138a139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:11.513835 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7644498-489b-451d-855e-6e3cd138a139 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:11.533649 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1406/2807] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:53:11 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:53:11.537748 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546fab6-1bb0-43b8-963b-dd0500dd28dd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:11.548086 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546fab6-1bb0-43b8-963b-dd0500dd28dd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:11.553468 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7c79c-3917-46be-8512-9b2b5c4a76a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:11.554117 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7c79c-3917-46be-8512-9b2b5c4a76a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:11.554395 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7c79c-3917-46be-8512-9b2b5c4a76a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:11.554667 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7c79c-3917-46be-8512-9b2b5c4a76a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:11.555395 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7c79c-3917-46be-8512-9b2b5c4a76a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:11.557033 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7c79c-3917-46be-8512-9b2b5c4a76a0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:11.567690 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1402/2808] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:53:11.571332 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7644498-489b-451d-855e-6e3cd138a139 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:11.581921 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7644498-489b-451d-855e-6e3cd138a139 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:11.586633 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace9272-2a8b-45d7-bbf0-8e9e0d74a068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:11.587270 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace9272-2a8b-45d7-bbf0-8e9e0d74a068 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:11.587547 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace9272-2a8b-45d7-bbf0-8e9e0d74a068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:11.587843 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace9272-2a8b-45d7-bbf0-8e9e0d74a068 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:11.588572 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace9272-2a8b-45d7-bbf0-8e9e0d74a068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:11.590138 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace9272-2a8b-45d7-bbf0-8e9e0d74a068 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:11.600723 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1407/2809] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:53:11.604599 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7c79c-3917-46be-8512-9b2b5c4a76a0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:11.615288 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7c79c-3917-46be-8512-9b2b5c4a76a0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:11.620032 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af301b-78a1-41ef-9fc8-de8a124b9f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:11.620889 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af301b-78a1-41ef-9fc8-de8a124b9f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:11.621200 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af301b-78a1-41ef-9fc8-de8a124b9f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:11.621480 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af301b-78a1-41ef-9fc8-de8a124b9f46 admin admin] PATH_INFO: `/v3/projects/644ed423cc6f4c2a961235fcecf1cad3/users/0a29b448abfd4a2981b4ff79b359fba8/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:11.636532 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af301b-78a1-41ef-9fc8-de8a124b9f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=644ed423cc6f4c2a961235fcecf1cad3, user_id=0a29b448abfd4a2981b4ff79b359fba8, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:11.639182 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af301b-78a1-41ef-9fc8-de8a124b9f46 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:11.652383 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1403/2810] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:53:11 2022] PUT /identity/v3/projects/644ed423cc6f4c2a961235fcecf1cad3/users/0a29b448abfd4a2981b4ff79b359fba8/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:53:11.664429 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36595619-c76e-4714-9fb4-e0b518d21d33 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:11.664757 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36595619-c76e-4714-9fb4-e0b518d21d33 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:11.665043 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36595619-c76e-4714-9fb4-e0b518d21d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:11.691889 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-36595619-c76e-4714-9fb4-e0b518d21d33 None None] MFA Rules not processed for user `0a29b448abfd4a2981b4ff79b359fba8`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:11.693173 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-36595619-c76e-4714-9fb4-e0b518d21d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:11.754106 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1408/2811] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:11.759612 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af301b-78a1-41ef-9fc8-de8a124b9f46 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:11.818887 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af301b-78a1-41ef-9fc8-de8a124b9f46 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:11.823526 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35adc9bf-9a75-48ba-b349-818e04393795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:11.824206 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adc9bf-9a75-48ba-b349-818e04393795 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:11.824492 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adc9bf-9a75-48ba-b349-818e04393795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:11.824769 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adc9bf-9a75-48ba-b349-818e04393795 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:11.825470 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35adc9bf-9a75-48ba-b349-818e04393795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:11.827393 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35adc9bf-9a75-48ba-b349-818e04393795 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:11.852814 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1404/2812] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:53:11 2022] POST /identity/v3/projects => generated 369 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:53:11.856787 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36595619-c76e-4714-9fb4-e0b518d21d33 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:11.867473 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36595619-c76e-4714-9fb4-e0b518d21d33 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:11.921480 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02ebe7-0c2f-47b6-b0c4-69c283f68d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:11.922132 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02ebe7-0c2f-47b6-b0c4-69c283f68d80 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:11.922413 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02ebe7-0c2f-47b6-b0c4-69c283f68d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:11.922688 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02ebe7-0c2f-47b6-b0c4-69c283f68d80 admin admin] PATH_INFO: `/v3/users` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:11.923391 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02ebe7-0c2f-47b6-b0c4-69c283f68d80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:11.925317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02ebe7-0c2f-47b6-b0c4-69c283f68d80 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:11.944159 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1409/2813] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:53:11 2022] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:53:11.948116 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35adc9bf-9a75-48ba-b349-818e04393795 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:11.958785 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35adc9bf-9a75-48ba-b349-818e04393795 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:11.963343 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d92d9-d7d7-4166-b89f-65be1a7f1acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:11.964024 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d92d9-d7d7-4166-b89f-65be1a7f1acc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:11.964308 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d92d9-d7d7-4166-b89f-65be1a7f1acc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:11.964587 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d92d9-d7d7-4166-b89f-65be1a7f1acc admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:11.965348 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d92d9-d7d7-4166-b89f-65be1a7f1acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:11.966928 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d92d9-d7d7-4166-b89f-65be1a7f1acc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:11.977244 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1405/2814] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:53:11.981205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02ebe7-0c2f-47b6-b0c4-69c283f68d80 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:11.990998 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02ebe7-0c2f-47b6-b0c4-69c283f68d80 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:11.995709 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43511dff-18f1-466e-8ba9-0d3d98eddf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:11.996585 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43511dff-18f1-466e-8ba9-0d3d98eddf57 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:11.996863 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43511dff-18f1-466e-8ba9-0d3d98eddf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:11.997134 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43511dff-18f1-466e-8ba9-0d3d98eddf57 admin admin] PATH_INFO: `/v3/projects/269e725df53b4219baa279e074425e76/users/d03b8bc4d80b49439309e95073a227c1/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:12.012063 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43511dff-18f1-466e-8ba9-0d3d98eddf57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=269e725df53b4219baa279e074425e76, user_id=d03b8bc4d80b49439309e95073a227c1, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:12.014655 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43511dff-18f1-466e-8ba9-0d3d98eddf57 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:12.027493 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1410/2815] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:53:11 2022] PUT /identity/v3/projects/269e725df53b4219baa279e074425e76/users/d03b8bc4d80b49439309e95073a227c1/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:12.031543 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d92d9-d7d7-4166-b89f-65be1a7f1acc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:12.041479 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d92d9-d7d7-4166-b89f-65be1a7f1acc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:12.096753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32dbe4-9a72-469c-baa5-4bfb09945589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:12.097345 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32dbe4-9a72-469c-baa5-4bfb09945589 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:12.097630 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32dbe4-9a72-469c-baa5-4bfb09945589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:12.097907 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32dbe4-9a72-469c-baa5-4bfb09945589 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:12.098679 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32dbe4-9a72-469c-baa5-4bfb09945589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:12.100317 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32dbe4-9a72-469c-baa5-4bfb09945589 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:12.109920 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1406/2816] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:53:12.114012 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43511dff-18f1-466e-8ba9-0d3d98eddf57 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:12.124367 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43511dff-18f1-466e-8ba9-0d3d98eddf57 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:12.128954 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0161264-2cda-4645-86d9-acebfdebdcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:12.131121 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0161264-2cda-4645-86d9-acebfdebdcd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:12.131402 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0161264-2cda-4645-86d9-acebfdebdcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:12.131677 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0161264-2cda-4645-86d9-acebfdebdcd9 admin admin] PATH_INFO: `/v3/projects/269e725df53b4219baa279e074425e76/users/d03b8bc4d80b49439309e95073a227c1/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:12.133692 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0161264-2cda-4645-86d9-acebfdebdcd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=269e725df53b4219baa279e074425e76, user_id=d03b8bc4d80b49439309e95073a227c1, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:12.136546 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0161264-2cda-4645-86d9-acebfdebdcd9 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:12.147000 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1411/2817] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:53:12 2022] PUT /identity/v3/projects/269e725df53b4219baa279e074425e76/users/d03b8bc4d80b49439309e95073a227c1/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:12.157022 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739eeb8-6bbc-4e48-a8d2-f241d46eea74 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:12.157324 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739eeb8-6bbc-4e48-a8d2-f241d46eea74 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:12.157595 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739eeb8-6bbc-4e48-a8d2-f241d46eea74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:12.183556 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-1739eeb8-6bbc-4e48-a8d2-f241d46eea74 None None] MFA Rules not processed for user `d03b8bc4d80b49439309e95073a227c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:12.184785 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1739eeb8-6bbc-4e48-a8d2-f241d46eea74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:12.249460 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1407/2818] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:12 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:12.259962 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0161264-2cda-4645-86d9-acebfdebdcd9 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:12.261677 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-b0161264-2cda-4645-86d9-acebfdebdcd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:12.316521 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0161264-2cda-4645-86d9-acebfdebdcd9 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:12.320250 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10797b-72ad-4254-adee-a00608863e6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:12.320880 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10797b-72ad-4254-adee-a00608863e6a service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:12.321164 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10797b-72ad-4254-adee-a00608863e6a service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:12.321440 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10797b-72ad-4254-adee-a00608863e6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:12.330270 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10797b-72ad-4254-adee-a00608863e6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:12.331710 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10797b-72ad-4254-adee-a00608863e6a service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:12.341650 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1412/2819] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:53:12 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:53:13.593993 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739eeb8-6bbc-4e48-a8d2-f241d46eea74 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:13.653976 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739eeb8-6bbc-4e48-a8d2-f241d46eea74 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:13.658363 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9794e4c-5e32-4556-beca-838547a67334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:13.659211 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9794e4c-5e32-4556-beca-838547a67334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:13.659486 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9794e4c-5e32-4556-beca-838547a67334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:13.659839 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9794e4c-5e32-4556-beca-838547a67334 admin admin] PATH_INFO: `/v3/users/0a29b448abfd4a2981b4ff79b359fba8` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:13.661620 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9794e4c-5e32-4556-beca-838547a67334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a29b448abfd4a2981b4ff79b359fba8)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:13.663514 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9794e4c-5e32-4556-beca-838547a67334 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:13.706854 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b9794e4c-5e32-4556-beca-838547a67334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a29b448abfd4a2981b4ff79b359fba8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:13.713919 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b9794e4c-5e32-4556-beca-838547a67334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a29b448abfd4a2981b4ff79b359fba8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:13.725421 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b9794e4c-5e32-4556-beca-838547a67334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a29b448abfd4a2981b4ff79b359fba8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:13.732100 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b9794e4c-5e32-4556-beca-838547a67334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a29b448abfd4a2981b4ff79b359fba8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:13.732706 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b9794e4c-5e32-4556-beca-838547a67334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a29b448abfd4a2981b4ff79b359fba8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:13.738368 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1408/2820] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:53:13 2022] DELETE /identity/v3/users/0a29b448abfd4a2981b4ff79b359fba8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:13.743018 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9de72e-9233-407d-ab8f-d57c23ab3d5d None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:13.743512 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9de72e-9233-407d-ab8f-d57c23ab3d5d None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:13.743625 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9de72e-9233-407d-ab8f-d57c23ab3d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:13.760883 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-aa9de72e-9233-407d-ab8f-d57c23ab3d5d None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:13.762087 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-aa9de72e-9233-407d-ab8f-d57c23ab3d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:13.817340 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1413/2821] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:13.826830 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9794e4c-5e32-4556-beca-838547a67334 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:13.828253 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b9794e4c-5e32-4556-beca-838547a67334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:13.884010 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9794e4c-5e32-4556-beca-838547a67334 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:13.887714 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff941228-bcbb-4f53-a7e8-d8d0be9682e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:13.888387 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff941228-bcbb-4f53-a7e8-d8d0be9682e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:13.888676 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff941228-bcbb-4f53-a7e8-d8d0be9682e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:13.888974 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff941228-bcbb-4f53-a7e8-d8d0be9682e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:13.899738 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff941228-bcbb-4f53-a7e8-d8d0be9682e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:13.901200 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff941228-bcbb-4f53-a7e8-d8d0be9682e1 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:13.911450 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1409/2822] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:53:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:53:14.167787 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9de72e-9233-407d-ab8f-d57c23ab3d5d None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:14.169697 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-aa9de72e-9233-407d-ab8f-d57c23ab3d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:14.186263 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9de72e-9233-407d-ab8f-d57c23ab3d5d None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:14.195080 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b373c0-aaed-4b08-9473-ea7d56ebcd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:14.195972 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b373c0-aaed-4b08-9473-ea7d56ebcd6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:14.196255 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b373c0-aaed-4b08-9473-ea7d56ebcd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:14.196721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b373c0-aaed-4b08-9473-ea7d56ebcd6f admin admin] PATH_INFO: `/v3/projects/644ed423cc6f4c2a961235fcecf1cad3` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:14.197929 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b373c0-aaed-4b08-9473-ea7d56ebcd6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=644ed423cc6f4c2a961235fcecf1cad3)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:14.199931 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b373c0-aaed-4b08-9473-ea7d56ebcd6f admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:14.246618 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-00b373c0-aaed-4b08-9473-ea7d56ebcd6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '644ed423cc6f4c2a961235fcecf1cad3', 'request_id': 'req-00b373c0-aaed-4b08-9473-ea7d56ebcd6f'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:14.252986 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-00b373c0-aaed-4b08-9473-ea7d56ebcd6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '644ed423cc6f4c2a961235fcecf1cad3', 'request_id': 'req-00b373c0-aaed-4b08-9473-ea7d56ebcd6f'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:14.258753 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-00b373c0-aaed-4b08-9473-ea7d56ebcd6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '644ed423cc6f4c2a961235fcecf1cad3', 'request_id': 'req-00b373c0-aaed-4b08-9473-ea7d56ebcd6f'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:14.272317 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-00b373c0-aaed-4b08-9473-ea7d56ebcd6f admin admin] The token cache is being invalidate because project 644ed423cc6f4c2a961235fcecf1cad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:53:14.272609 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-00b373c0-aaed-4b08-9473-ea7d56ebcd6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:14.273235 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-00b373c0-aaed-4b08-9473-ea7d56ebcd6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:14.274782 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1414/2823] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:53:14 2022] DELETE /identity/v3/projects/644ed423cc6f4c2a961235fcecf1cad3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:14.279169 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff941228-bcbb-4f53-a7e8-d8d0be9682e1 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:14.288965 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff941228-bcbb-4f53-a7e8-d8d0be9682e1 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:14.342130 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8be81c-011d-4fcc-9c73-6a86d7aa1de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:14.342991 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8be81c-011d-4fcc-9c73-6a86d7aa1de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:14.343259 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8be81c-011d-4fcc-9c73-6a86d7aa1de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:14.343530 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8be81c-011d-4fcc-9c73-6a86d7aa1de7 admin admin] PATH_INFO: `/v3/users/d03b8bc4d80b49439309e95073a227c1` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:14.344746 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8be81c-011d-4fcc-9c73-6a86d7aa1de7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d03b8bc4d80b49439309e95073a227c1)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:14.346641 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8be81c-011d-4fcc-9c73-6a86d7aa1de7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:14.390939 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7e8be81c-011d-4fcc-9c73-6a86d7aa1de7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd03b8bc4d80b49439309e95073a227c1'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:14.397995 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7e8be81c-011d-4fcc-9c73-6a86d7aa1de7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd03b8bc4d80b49439309e95073a227c1'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:14.409162 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7e8be81c-011d-4fcc-9c73-6a86d7aa1de7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd03b8bc4d80b49439309e95073a227c1'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:14.417068 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7e8be81c-011d-4fcc-9c73-6a86d7aa1de7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd03b8bc4d80b49439309e95073a227c1'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:14.417707 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7e8be81c-011d-4fcc-9c73-6a86d7aa1de7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd03b8bc4d80b49439309e95073a227c1'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:14.423415 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1410/2824] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:53:14 2022] DELETE /identity/v3/users/d03b8bc4d80b49439309e95073a227c1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:14.680793 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b373c0-aaed-4b08-9473-ea7d56ebcd6f admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:14.682210 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-00b373c0-aaed-4b08-9473-ea7d56ebcd6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:14.695856 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b373c0-aaed-4b08-9473-ea7d56ebcd6f admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:14.751510 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae80323-0a93-4a89-8544-c38294f97f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:14.752378 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae80323-0a93-4a89-8544-c38294f97f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:14.752661 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae80323-0a93-4a89-8544-c38294f97f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:14.752938 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae80323-0a93-4a89-8544-c38294f97f6e admin admin] PATH_INFO: `/v3/projects/269e725df53b4219baa279e074425e76` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:14.754180 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae80323-0a93-4a89-8544-c38294f97f6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=269e725df53b4219baa279e074425e76)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:14.756834 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae80323-0a93-4a89-8544-c38294f97f6e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:14.800517 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5ae80323-0a93-4a89-8544-c38294f97f6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '269e725df53b4219baa279e074425e76', 'request_id': 'req-5ae80323-0a93-4a89-8544-c38294f97f6e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:14.807031 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5ae80323-0a93-4a89-8544-c38294f97f6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '269e725df53b4219baa279e074425e76', 'request_id': 'req-5ae80323-0a93-4a89-8544-c38294f97f6e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:14.812390 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5ae80323-0a93-4a89-8544-c38294f97f6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '269e725df53b4219baa279e074425e76', 'request_id': 'req-5ae80323-0a93-4a89-8544-c38294f97f6e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:14.824895 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5ae80323-0a93-4a89-8544-c38294f97f6e admin admin] The token cache is being invalidate because project 269e725df53b4219baa279e074425e76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:53:14.825182 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5ae80323-0a93-4a89-8544-c38294f97f6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:14.825794 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5ae80323-0a93-4a89-8544-c38294f97f6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:14.827311 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1415/2825] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:53:14 2022] DELETE /identity/v3/projects/269e725df53b4219baa279e074425e76 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:53:14.833425 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d16f7-38e6-4cd8-a434-ba8d9e3d422a None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:14.833920 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d16f7-38e6-4cd8-a434-ba8d9e3d422a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:14.834104 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d16f7-38e6-4cd8-a434-ba8d9e3d422a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:14.853099 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-3a1d16f7-38e6-4cd8-a434-ba8d9e3d422a None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:14.854291 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3a1d16f7-38e6-4cd8-a434-ba8d9e3d422a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:14.913667 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1411/2826] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 08 16:53:14.921607 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13086bd3-0fa5-4f56-86ec-2d7e357bb1b6 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:14.921894 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13086bd3-0fa5-4f56-86ec-2d7e357bb1b6 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:14.922170 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13086bd3-0fa5-4f56-86ec-2d7e357bb1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:14.940030 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-13086bd3-0fa5-4f56-86ec-2d7e357bb1b6 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:14.941133 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-13086bd3-0fa5-4f56-86ec-2d7e357bb1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:14.949335 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1416/2827] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:14.953364 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d16f7-38e6-4cd8-a434-ba8d9e3d422a None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:14.963415 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d16f7-38e6-4cd8-a434-ba8d9e3d422a None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:14.967990 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd63fe6-d884-4211-b074-85198d0c2883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:14.968630 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd63fe6-d884-4211-b074-85198d0c2883 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:14.968909 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd63fe6-d884-4211-b074-85198d0c2883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:14.969182 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd63fe6-d884-4211-b074-85198d0c2883 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:14.969910 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd63fe6-d884-4211-b074-85198d0c2883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:53:14.970214 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd63fe6-d884-4211-b074-85198d0c2883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:14.971847 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd63fe6-d884-4211-b074-85198d0c2883 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:14.982987 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1412/2828] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 08 16:53:14.986947 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13086bd3-0fa5-4f56-86ec-2d7e357bb1b6 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:14.996257 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13086bd3-0fa5-4f56-86ec-2d7e357bb1b6 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:15.001207 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e27c41-2ae7-402f-b248-b98aba2910ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:15.001841 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e27c41-2ae7-402f-b248-b98aba2910ea admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:15.002127 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e27c41-2ae7-402f-b248-b98aba2910ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:15.002402 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e27c41-2ae7-402f-b248-b98aba2910ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:15.003105 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e27c41-2ae7-402f-b248-b98aba2910ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:15.005543 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e27c41-2ae7-402f-b248-b98aba2910ea admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:15.030069 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1417/2829] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:53:14 2022] POST /identity/v3/projects => generated 367 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:53:15.034158 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd63fe6-d884-4211-b074-85198d0c2883 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:15.044202 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd63fe6-d884-4211-b074-85198d0c2883 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:15.099824 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8df7d7-8efc-472f-806c-574479d951d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:15.100467 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8df7d7-8efc-472f-806c-574479d951d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:15.100752 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8df7d7-8efc-472f-806c-574479d951d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:15.101029 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8df7d7-8efc-472f-806c-574479d951d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:15.101753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8df7d7-8efc-472f-806c-574479d951d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:15.103635 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8df7d7-8efc-472f-806c-574479d951d4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:15.122771 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1413/2830] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:53:15 2022] POST /identity/v3/users => generated 284 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:53:15.127109 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e27c41-2ae7-402f-b248-b98aba2910ea admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:15.137802 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e27c41-2ae7-402f-b248-b98aba2910ea admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:15.142399 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88730b8e-58e3-4184-b2e4-9ef668390923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:15.143039 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88730b8e-58e3-4184-b2e4-9ef668390923 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:15.143319 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88730b8e-58e3-4184-b2e4-9ef668390923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:15.143593 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88730b8e-58e3-4184-b2e4-9ef668390923 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:15.144366 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88730b8e-58e3-4184-b2e4-9ef668390923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:15.146806 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88730b8e-58e3-4184-b2e4-9ef668390923 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:15.156641 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1418/2831] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:53:15.160528 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8df7d7-8efc-472f-806c-574479d951d4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:15.170464 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8df7d7-8efc-472f-806c-574479d951d4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:15.175060 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c1e85-8451-43f7-a706-1011e3d5e7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:15.175711 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c1e85-8451-43f7-a706-1011e3d5e7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:15.176565 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c1e85-8451-43f7-a706-1011e3d5e7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:15.176845 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c1e85-8451-43f7-a706-1011e3d5e7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:15.177727 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c1e85-8451-43f7-a706-1011e3d5e7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:15.179314 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c1e85-8451-43f7-a706-1011e3d5e7b8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:15.189187 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1414/2832] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:53:15.194193 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88730b8e-58e3-4184-b2e4-9ef668390923 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:15.203918 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88730b8e-58e3-4184-b2e4-9ef668390923 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:15.209021 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d21704-da11-4395-92ac-177af18e0471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:15.209888 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d21704-da11-4395-92ac-177af18e0471 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:15.210195 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d21704-da11-4395-92ac-177af18e0471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:15.210463 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d21704-da11-4395-92ac-177af18e0471 admin admin] PATH_INFO: `/v3/projects/dbe957520cb74797b5c8f27933994db4/users/20f2c7180f414c0a93771ea64cc4e726/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:15.226059 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d21704-da11-4395-92ac-177af18e0471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe957520cb74797b5c8f27933994db4, user_id=20f2c7180f414c0a93771ea64cc4e726, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:15.228745 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d21704-da11-4395-92ac-177af18e0471 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:15.241322 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1419/2833] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:53:15 2022] PUT /identity/v3/projects/dbe957520cb74797b5c8f27933994db4/users/20f2c7180f414c0a93771ea64cc4e726/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:15.252562 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c613061-99b9-460b-a9d0-3086807fe1bd None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:15.252854 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c613061-99b9-460b-a9d0-3086807fe1bd None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:15.253133 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c613061-99b9-460b-a9d0-3086807fe1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:15.279723 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-6c613061-99b9-460b-a9d0-3086807fe1bd None None] MFA Rules not processed for user `20f2c7180f414c0a93771ea64cc4e726`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:15.280962 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6c613061-99b9-460b-a9d0-3086807fe1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:15.342737 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1415/2834] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:15.347296 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d21704-da11-4395-92ac-177af18e0471 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:15.404611 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d21704-da11-4395-92ac-177af18e0471 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:15.409145 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59b916-585b-406d-aef4-83739f7ee649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:15.409775 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59b916-585b-406d-aef4-83739f7ee649 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:15.410050 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59b916-585b-406d-aef4-83739f7ee649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:15.410323 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59b916-585b-406d-aef4-83739f7ee649 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:15.411805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59b916-585b-406d-aef4-83739f7ee649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:15.413666 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59b916-585b-406d-aef4-83739f7ee649 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:15.440286 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1420/2835] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:53:15 2022] POST /identity/v3/projects => generated 369 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:53:15.445231 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c613061-99b9-460b-a9d0-3086807fe1bd None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:15.455850 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c613061-99b9-460b-a9d0-3086807fe1bd None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:15.511030 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ff63c-51ab-4c68-a832-d2f1a7a0de17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:15.511688 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ff63c-51ab-4c68-a832-d2f1a7a0de17 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:15.511997 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ff63c-51ab-4c68-a832-d2f1a7a0de17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:15.512300 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ff63c-51ab-4c68-a832-d2f1a7a0de17 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:15.513007 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ff63c-51ab-4c68-a832-d2f1a7a0de17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:15.514905 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ff63c-51ab-4c68-a832-d2f1a7a0de17 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:15.534495 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1416/2836] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:53:15 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:53:15.538660 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59b916-585b-406d-aef4-83739f7ee649 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:15.548810 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59b916-585b-406d-aef4-83739f7ee649 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:15.553713 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3d98f-41d8-4e25-9390-a9c432dcfc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:15.554364 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3d98f-41d8-4e25-9390-a9c432dcfc69 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:15.554644 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3d98f-41d8-4e25-9390-a9c432dcfc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:15.554924 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3d98f-41d8-4e25-9390-a9c432dcfc69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:15.555651 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3d98f-41d8-4e25-9390-a9c432dcfc69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:15.557254 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3d98f-41d8-4e25-9390-a9c432dcfc69 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:15.568264 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1421/2837] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:53:15.572252 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ff63c-51ab-4c68-a832-d2f1a7a0de17 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:15.581885 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ff63c-51ab-4c68-a832-d2f1a7a0de17 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:15.587690 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdd2c9-1708-463f-bc40-fa4b91f703cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:15.588662 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdd2c9-1708-463f-bc40-fa4b91f703cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:15.588938 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdd2c9-1708-463f-bc40-fa4b91f703cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:15.589208 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdd2c9-1708-463f-bc40-fa4b91f703cd admin admin] PATH_INFO: `/v3/projects/82348468704845ab84f5555847327af7/users/0d8a05554085442ca7f473c36b497fa5/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:15.603592 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdd2c9-1708-463f-bc40-fa4b91f703cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=82348468704845ab84f5555847327af7, user_id=0d8a05554085442ca7f473c36b497fa5, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:15.606229 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdd2c9-1708-463f-bc40-fa4b91f703cd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:15.618801 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1417/2838] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:53:15 2022] PUT /identity/v3/projects/82348468704845ab84f5555847327af7/users/0d8a05554085442ca7f473c36b497fa5/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:53:15.622628 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3d98f-41d8-4e25-9390-a9c432dcfc69 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:15.633015 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3d98f-41d8-4e25-9390-a9c432dcfc69 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:15.686224 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c01a70-39c3-472f-9d1a-48281961fbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:15.686876 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c01a70-39c3-472f-9d1a-48281961fbbe admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:15.687161 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c01a70-39c3-472f-9d1a-48281961fbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:15.687438 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c01a70-39c3-472f-9d1a-48281961fbbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:15.688213 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c01a70-39c3-472f-9d1a-48281961fbbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:15.689823 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c01a70-39c3-472f-9d1a-48281961fbbe admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:15.699851 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1422/2839] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:53:15.704053 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdd2c9-1708-463f-bc40-fa4b91f703cd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:15.714929 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdd2c9-1708-463f-bc40-fa4b91f703cd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:15.719526 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34c867-eaaa-4ce3-aa66-492318d92641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:15.720416 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34c867-eaaa-4ce3-aa66-492318d92641 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:15.720699 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34c867-eaaa-4ce3-aa66-492318d92641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:15.720973 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34c867-eaaa-4ce3-aa66-492318d92641 admin admin] PATH_INFO: `/v3/projects/82348468704845ab84f5555847327af7/users/0d8a05554085442ca7f473c36b497fa5/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:15.723000 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34c867-eaaa-4ce3-aa66-492318d92641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82348468704845ab84f5555847327af7, user_id=0d8a05554085442ca7f473c36b497fa5, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:15.725771 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34c867-eaaa-4ce3-aa66-492318d92641 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:15.735799 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1418/2840] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:53:15 2022] PUT /identity/v3/projects/82348468704845ab84f5555847327af7/users/0d8a05554085442ca7f473c36b497fa5/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:15.745957 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e12f5-7525-4c59-915d-d0b4515e68cd None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:15.746252 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e12f5-7525-4c59-915d-d0b4515e68cd None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:15.746532 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e12f5-7525-4c59-915d-d0b4515e68cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:15.772793 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-c03e12f5-7525-4c59-915d-d0b4515e68cd None None] MFA Rules not processed for user `0d8a05554085442ca7f473c36b497fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:15.773979 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-c03e12f5-7525-4c59-915d-d0b4515e68cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:15.838496 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1423/2841] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:15 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:15.849374 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34c867-eaaa-4ce3-aa66-492318d92641 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:15.851177 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-bd34c867-eaaa-4ce3-aa66-492318d92641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:15.907480 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34c867-eaaa-4ce3-aa66-492318d92641 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:15.911230 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a06a8-ff75-485a-ac0f-9d79a8191580 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:15.911911 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a06a8-ff75-485a-ac0f-9d79a8191580 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:15.912198 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a06a8-ff75-485a-ac0f-9d79a8191580 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:15.912477 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a06a8-ff75-485a-ac0f-9d79a8191580 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:15.921455 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a06a8-ff75-485a-ac0f-9d79a8191580 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:15.923179 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a06a8-ff75-485a-ac0f-9d79a8191580 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:15.934424 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1419/2842] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:53:15 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:53:15.979904 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e12f5-7525-4c59-915d-d0b4515e68cd None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:15.981335 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-c03e12f5-7525-4c59-915d-d0b4515e68cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:15.994399 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e12f5-7525-4c59-915d-d0b4515e68cd None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:15.998711 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d6562-f230-48eb-a097-0a7ecce8d984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:15.999586 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d6562-f230-48eb-a097-0a7ecce8d984 service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:15.999905 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d6562-f230-48eb-a097-0a7ecce8d984 service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:16.000182 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d6562-f230-48eb-a097-0a7ecce8d984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:16.054285 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d6562-f230-48eb-a097-0a7ecce8d984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:16.055696 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d6562-f230-48eb-a097-0a7ecce8d984 service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:16.064234 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1424/2843] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:53:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:53:19.318624 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a06a8-ff75-485a-ac0f-9d79a8191580 service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:19.377735 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a06a8-ff75-485a-ac0f-9d79a8191580 service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:19.382521 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf37c0-fcc1-4cdc-9ff8-00bb162ef3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:19.383374 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf37c0-fcc1-4cdc-9ff8-00bb162ef3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:19.383653 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf37c0-fcc1-4cdc-9ff8-00bb162ef3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:19.383955 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf37c0-fcc1-4cdc-9ff8-00bb162ef3bd admin admin] PATH_INFO: `/v3/users/20f2c7180f414c0a93771ea64cc4e726` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:19.385146 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf37c0-fcc1-4cdc-9ff8-00bb162ef3bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f2c7180f414c0a93771ea64cc4e726)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:19.387059 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf37c0-fcc1-4cdc-9ff8-00bb162ef3bd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:19.430588 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-12bf37c0-fcc1-4cdc-9ff8-00bb162ef3bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f2c7180f414c0a93771ea64cc4e726'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:19.437450 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-12bf37c0-fcc1-4cdc-9ff8-00bb162ef3bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f2c7180f414c0a93771ea64cc4e726'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:19.448521 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-12bf37c0-fcc1-4cdc-9ff8-00bb162ef3bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f2c7180f414c0a93771ea64cc4e726'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:19.455496 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-12bf37c0-fcc1-4cdc-9ff8-00bb162ef3bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f2c7180f414c0a93771ea64cc4e726'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:19.456115 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-12bf37c0-fcc1-4cdc-9ff8-00bb162ef3bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f2c7180f414c0a93771ea64cc4e726'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:19.461958 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1420/2844] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:53:19 2022] DELETE /identity/v3/users/20f2c7180f414c0a93771ea64cc4e726 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:19.466463 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f052d9-3766-4d16-9853-ca998a88014a None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:19.466962 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f052d9-3766-4d16-9853-ca998a88014a None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:19.467082 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f052d9-3766-4d16-9853-ca998a88014a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:19.484511 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-00f052d9-3766-4d16-9853-ca998a88014a None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:19.485689 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-00f052d9-3766-4d16-9853-ca998a88014a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:19.544625 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1425/2845] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:19.555267 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf37c0-fcc1-4cdc-9ff8-00bb162ef3bd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:19.556684 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-12bf37c0-fcc1-4cdc-9ff8-00bb162ef3bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:19.612401 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf37c0-fcc1-4cdc-9ff8-00bb162ef3bd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:19.616729 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace54a2c-62da-4308-99ef-8246eb28209e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:19.617363 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace54a2c-62da-4308-99ef-8246eb28209e service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:19.617646 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace54a2c-62da-4308-99ef-8246eb28209e service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:19.617922 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace54a2c-62da-4308-99ef-8246eb28209e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:19.627052 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace54a2c-62da-4308-99ef-8246eb28209e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:19.628507 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace54a2c-62da-4308-99ef-8246eb28209e service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:19.637914 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1421/2846] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:53:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:53:19.892211 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f052d9-3766-4d16-9853-ca998a88014a None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:19.893832 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-00f052d9-3766-4d16-9853-ca998a88014a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:19.907008 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f052d9-3766-4d16-9853-ca998a88014a None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:19.912483 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab038e-0105-499a-a77e-0ea36b24b560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:19.913333 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab038e-0105-499a-a77e-0ea36b24b560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:19.913618 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab038e-0105-499a-a77e-0ea36b24b560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:19.913924 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab038e-0105-499a-a77e-0ea36b24b560 admin admin] PATH_INFO: `/v3/projects/dbe957520cb74797b5c8f27933994db4` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:19.915129 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab038e-0105-499a-a77e-0ea36b24b560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbe957520cb74797b5c8f27933994db4)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:19.917159 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab038e-0105-499a-a77e-0ea36b24b560 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:19.961726 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-baab038e-0105-499a-a77e-0ea36b24b560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbe957520cb74797b5c8f27933994db4', 'request_id': 'req-baab038e-0105-499a-a77e-0ea36b24b560'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:19.967416 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-baab038e-0105-499a-a77e-0ea36b24b560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbe957520cb74797b5c8f27933994db4', 'request_id': 'req-baab038e-0105-499a-a77e-0ea36b24b560'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:19.972555 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-baab038e-0105-499a-a77e-0ea36b24b560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbe957520cb74797b5c8f27933994db4', 'request_id': 'req-baab038e-0105-499a-a77e-0ea36b24b560'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:19.984910 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-baab038e-0105-499a-a77e-0ea36b24b560 admin admin] The token cache is being invalidate because project dbe957520cb74797b5c8f27933994db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:53:19.985191 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-baab038e-0105-499a-a77e-0ea36b24b560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:19.985803 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-baab038e-0105-499a-a77e-0ea36b24b560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:19.987299 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1426/2847] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:53:19 2022] DELETE /identity/v3/projects/dbe957520cb74797b5c8f27933994db4 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:19.991464 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace54a2c-62da-4308-99ef-8246eb28209e service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:20.001309 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace54a2c-62da-4308-99ef-8246eb28209e service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:20.056111 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a92add-2d0c-417c-a66b-44e8c9b6709e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:20.056967 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a92add-2d0c-417c-a66b-44e8c9b6709e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:20.057250 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a92add-2d0c-417c-a66b-44e8c9b6709e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:20.057526 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a92add-2d0c-417c-a66b-44e8c9b6709e admin admin] PATH_INFO: `/v3/users/0d8a05554085442ca7f473c36b497fa5` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:20.058859 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a92add-2d0c-417c-a66b-44e8c9b6709e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d8a05554085442ca7f473c36b497fa5)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:20.060882 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a92add-2d0c-417c-a66b-44e8c9b6709e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:20.104995 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-18a92add-2d0c-417c-a66b-44e8c9b6709e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d8a05554085442ca7f473c36b497fa5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:20.111405 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-18a92add-2d0c-417c-a66b-44e8c9b6709e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d8a05554085442ca7f473c36b497fa5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:20.122558 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-18a92add-2d0c-417c-a66b-44e8c9b6709e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d8a05554085442ca7f473c36b497fa5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:20.130282 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-18a92add-2d0c-417c-a66b-44e8c9b6709e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d8a05554085442ca7f473c36b497fa5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:20.130912 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-18a92add-2d0c-417c-a66b-44e8c9b6709e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d8a05554085442ca7f473c36b497fa5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:20.136749 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1422/2848] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:53:19 2022] DELETE /identity/v3/users/0d8a05554085442ca7f473c36b497fa5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:53:20.401541 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab038e-0105-499a-a77e-0ea36b24b560 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:20.403033 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-baab038e-0105-499a-a77e-0ea36b24b560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:20.416805 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab038e-0105-499a-a77e-0ea36b24b560 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:20.471314 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ebe88-b976-4550-8a07-42ceda5a58b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:20.472200 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ebe88-b976-4550-8a07-42ceda5a58b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:20.472476 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ebe88-b976-4550-8a07-42ceda5a58b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:20.472748 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ebe88-b976-4550-8a07-42ceda5a58b1 admin admin] PATH_INFO: `/v3/projects/82348468704845ab84f5555847327af7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:20.474536 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ebe88-b976-4550-8a07-42ceda5a58b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82348468704845ab84f5555847327af7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:20.476449 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ebe88-b976-4550-8a07-42ceda5a58b1 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:20.521250 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-9f0ebe88-b976-4550-8a07-42ceda5a58b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82348468704845ab84f5555847327af7', 'request_id': 'req-9f0ebe88-b976-4550-8a07-42ceda5a58b1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:20.527139 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-9f0ebe88-b976-4550-8a07-42ceda5a58b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82348468704845ab84f5555847327af7', 'request_id': 'req-9f0ebe88-b976-4550-8a07-42ceda5a58b1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:20.532374 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-9f0ebe88-b976-4550-8a07-42ceda5a58b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82348468704845ab84f5555847327af7', 'request_id': 'req-9f0ebe88-b976-4550-8a07-42ceda5a58b1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:20.544533 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-9f0ebe88-b976-4550-8a07-42ceda5a58b1 admin admin] The token cache is being invalidate because project 82348468704845ab84f5555847327af7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:53:20.544815 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-9f0ebe88-b976-4550-8a07-42ceda5a58b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:20.545420 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-9f0ebe88-b976-4550-8a07-42ceda5a58b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:20.547023 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1427/2849] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:53:20 2022] DELETE /identity/v3/projects/82348468704845ab84f5555847327af7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:20.552845 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b11bc9-99e3-4e49-82f7-ec45e60fcfa8 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:20.553347 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b11bc9-99e3-4e49-82f7-ec45e60fcfa8 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:20.553449 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b11bc9-99e3-4e49-82f7-ec45e60fcfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:20.570619 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-a3b11bc9-99e3-4e49-82f7-ec45e60fcfa8 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:20.571847 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a3b11bc9-99e3-4e49-82f7-ec45e60fcfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:20.630242 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1423/2850] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:20.639332 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900b635-2eb5-4d4c-8341-cd881dee77a8 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:20.639613 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900b635-2eb5-4d4c-8341-cd881dee77a8 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:20.639925 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900b635-2eb5-4d4c-8341-cd881dee77a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:20.658139 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-8900b635-2eb5-4d4c-8341-cd881dee77a8 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:20.659251 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-8900b635-2eb5-4d4c-8341-cd881dee77a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:20.667591 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1428/2851] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:20.671670 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b11bc9-99e3-4e49-82f7-ec45e60fcfa8 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:20.681414 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b11bc9-99e3-4e49-82f7-ec45e60fcfa8 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:20.685979 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46edf06-794e-4094-b70d-50a8db7e1f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:20.686622 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46edf06-794e-4094-b70d-50a8db7e1f34 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:20.686906 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46edf06-794e-4094-b70d-50a8db7e1f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:20.687184 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46edf06-794e-4094-b70d-50a8db7e1f34 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:20.687951 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46edf06-794e-4094-b70d-50a8db7e1f34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:53:20.688260 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46edf06-794e-4094-b70d-50a8db7e1f34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:20.689862 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46edf06-794e-4094-b70d-50a8db7e1f34 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:20.701536 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1424/2852] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:53:20.705724 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900b635-2eb5-4d4c-8341-cd881dee77a8 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:20.715316 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900b635-2eb5-4d4c-8341-cd881dee77a8 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:20.719952 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bbbcd-4161-45fe-94ba-7c25bbaa59b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:20.720644 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bbbcd-4161-45fe-94ba-7c25bbaa59b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:20.720926 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bbbcd-4161-45fe-94ba-7c25bbaa59b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:20.721203 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bbbcd-4161-45fe-94ba-7c25bbaa59b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:20.721907 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bbbcd-4161-45fe-94ba-7c25bbaa59b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:20.724818 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bbbcd-4161-45fe-94ba-7c25bbaa59b8 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:20.748729 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1429/2853] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:53:20 2022] POST /identity/v3/projects => generated 409 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:53:20.753106 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46edf06-794e-4094-b70d-50a8db7e1f34 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:20.763320 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46edf06-794e-4094-b70d-50a8db7e1f34 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:20.817932 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadb170-df00-4d17-9a98-74b208cf8d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:20.818582 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadb170-df00-4d17-9a98-74b208cf8d57 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:20.818865 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadb170-df00-4d17-9a98-74b208cf8d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:20.819144 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadb170-df00-4d17-9a98-74b208cf8d57 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:20.819872 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadb170-df00-4d17-9a98-74b208cf8d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:20.821774 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadb170-df00-4d17-9a98-74b208cf8d57 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:20.841171 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1425/2854] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:53:20 2022] POST /identity/v3/users => generated 305 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:53:20.845191 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bbbcd-4161-45fe-94ba-7c25bbaa59b8 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:20.855778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bbbcd-4161-45fe-94ba-7c25bbaa59b8 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:20.860343 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79743060-9ecc-4ccf-90ae-861b1ca73fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:20.860986 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79743060-9ecc-4ccf-90ae-861b1ca73fcb admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:20.861265 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79743060-9ecc-4ccf-90ae-861b1ca73fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:20.861539 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79743060-9ecc-4ccf-90ae-861b1ca73fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:20.862265 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79743060-9ecc-4ccf-90ae-861b1ca73fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:20.864037 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79743060-9ecc-4ccf-90ae-861b1ca73fcb admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:20.875301 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1430/2855] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:53:20.879583 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadb170-df00-4d17-9a98-74b208cf8d57 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:20.889719 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadb170-df00-4d17-9a98-74b208cf8d57 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:20.896603 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42d8ea-6469-41a7-84f9-788c3e752b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:20.897282 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42d8ea-6469-41a7-84f9-788c3e752b2f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:20.897565 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42d8ea-6469-41a7-84f9-788c3e752b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:20.897843 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42d8ea-6469-41a7-84f9-788c3e752b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:20.898603 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42d8ea-6469-41a7-84f9-788c3e752b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:20.900254 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42d8ea-6469-41a7-84f9-788c3e752b2f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:20.910317 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1426/2856] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:53:20.914437 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79743060-9ecc-4ccf-90ae-861b1ca73fcb admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:20.924168 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79743060-9ecc-4ccf-90ae-861b1ca73fcb admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:20.929043 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa53858-a95d-4319-a26a-60eb3ac05723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:20.929899 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa53858-a95d-4319-a26a-60eb3ac05723 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:20.930177 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa53858-a95d-4319-a26a-60eb3ac05723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:20.930447 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa53858-a95d-4319-a26a-60eb3ac05723 admin admin] PATH_INFO: `/v3/projects/655924f8606e456aace31878ac274a7f/users/cb26d7b7c36342688569f398e32de758/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:20.945168 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa53858-a95d-4319-a26a-60eb3ac05723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=655924f8606e456aace31878ac274a7f, user_id=cb26d7b7c36342688569f398e32de758, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:20.947799 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa53858-a95d-4319-a26a-60eb3ac05723 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:20.960894 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1431/2857] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:53:20 2022] PUT /identity/v3/projects/655924f8606e456aace31878ac274a7f/users/cb26d7b7c36342688569f398e32de758/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:20.970937 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dcc16-e3c0-498e-9722-b8b881c121cc None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:20.971228 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dcc16-e3c0-498e-9722-b8b881c121cc None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:20.971507 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dcc16-e3c0-498e-9722-b8b881c121cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:20.997552 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-204dcc16-e3c0-498e-9722-b8b881c121cc None None] MFA Rules not processed for user `cb26d7b7c36342688569f398e32de758`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:20.998753 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-204dcc16-e3c0-498e-9722-b8b881c121cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:21.060424 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1427/2858] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:20 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:21.064901 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa53858-a95d-4319-a26a-60eb3ac05723 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:21.122103 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa53858-a95d-4319-a26a-60eb3ac05723 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:21.126924 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbf2fd-d83e-40ab-994d-98dfbe881e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:21.127554 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbf2fd-d83e-40ab-994d-98dfbe881e95 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:21.127863 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbf2fd-d83e-40ab-994d-98dfbe881e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:21.128138 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbf2fd-d83e-40ab-994d-98dfbe881e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:21.128834 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbf2fd-d83e-40ab-994d-98dfbe881e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:21.131190 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbf2fd-d83e-40ab-994d-98dfbe881e95 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:21.155075 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1432/2859] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:53:21 2022] POST /identity/v3/projects => generated 407 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:53:21.159020 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dcc16-e3c0-498e-9722-b8b881c121cc None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:21.169419 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dcc16-e3c0-498e-9722-b8b881c121cc None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:21.225210 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936344a8-dd1d-4a04-838f-3604edf188d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:21.226295 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936344a8-dd1d-4a04-838f-3604edf188d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:21.226579 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936344a8-dd1d-4a04-838f-3604edf188d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:21.226851 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936344a8-dd1d-4a04-838f-3604edf188d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:21.227549 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936344a8-dd1d-4a04-838f-3604edf188d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:21.229499 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936344a8-dd1d-4a04-838f-3604edf188d6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:21.248794 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1428/2860] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:53:21 2022] POST /identity/v3/users => generated 310 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:53:21.253300 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbf2fd-d83e-40ab-994d-98dfbe881e95 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:21.264105 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbf2fd-d83e-40ab-994d-98dfbe881e95 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:21.268731 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370642a-2cc2-48ce-9b26-41c566a5d6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:21.269378 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370642a-2cc2-48ce-9b26-41c566a5d6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:21.269668 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370642a-2cc2-48ce-9b26-41c566a5d6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:21.269943 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370642a-2cc2-48ce-9b26-41c566a5d6f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:21.270681 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370642a-2cc2-48ce-9b26-41c566a5d6f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:21.272304 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370642a-2cc2-48ce-9b26-41c566a5d6f3 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:21.282543 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1433/2861] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:53:21.286867 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936344a8-dd1d-4a04-838f-3604edf188d6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:21.297127 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936344a8-dd1d-4a04-838f-3604edf188d6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:21.302743 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80054275-7f39-4f65-a64c-2f3e27a3834f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:21.303629 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80054275-7f39-4f65-a64c-2f3e27a3834f admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:21.303943 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80054275-7f39-4f65-a64c-2f3e27a3834f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:21.304221 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80054275-7f39-4f65-a64c-2f3e27a3834f admin admin] PATH_INFO: `/v3/projects/5b345335ac644c1492b3e91ec3d681b1/users/8e13fa668324477a81e8cd1bd00a11e3/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:21.319490 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80054275-7f39-4f65-a64c-2f3e27a3834f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b345335ac644c1492b3e91ec3d681b1, user_id=8e13fa668324477a81e8cd1bd00a11e3, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:21.322227 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80054275-7f39-4f65-a64c-2f3e27a3834f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:21.334739 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1429/2862] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:53:21 2022] PUT /identity/v3/projects/5b345335ac644c1492b3e91ec3d681b1/users/8e13fa668324477a81e8cd1bd00a11e3/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:21.338736 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370642a-2cc2-48ce-9b26-41c566a5d6f3 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:21.348642 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370642a-2cc2-48ce-9b26-41c566a5d6f3 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:21.403306 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2244e-094c-4f15-8595-cfaf578d9c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:21.403989 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2244e-094c-4f15-8595-cfaf578d9c46 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:21.404271 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2244e-094c-4f15-8595-cfaf578d9c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:21.404544 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2244e-094c-4f15-8595-cfaf578d9c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:21.405267 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2244e-094c-4f15-8595-cfaf578d9c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:21.406833 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2244e-094c-4f15-8595-cfaf578d9c46 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:21.416365 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1434/2863] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 08 16:53:21.420445 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80054275-7f39-4f65-a64c-2f3e27a3834f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:21.431356 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80054275-7f39-4f65-a64c-2f3e27a3834f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:21.435942 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adcb52-ca0f-4592-ba98-a6be3406c069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:21.436798 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adcb52-ca0f-4592-ba98-a6be3406c069 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:21.437078 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adcb52-ca0f-4592-ba98-a6be3406c069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:21.437359 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adcb52-ca0f-4592-ba98-a6be3406c069 admin admin] PATH_INFO: `/v3/projects/5b345335ac644c1492b3e91ec3d681b1/users/8e13fa668324477a81e8cd1bd00a11e3/roles/e6d18df5c4e74dfd8ebd9c636f45936e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:21.439311 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12adcb52-ca0f-4592-ba98-a6be3406c069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b345335ac644c1492b3e91ec3d681b1, user_id=8e13fa668324477a81e8cd1bd00a11e3, role_id=e6d18df5c4e74dfd8ebd9c636f45936e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:21.442875 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12adcb52-ca0f-4592-ba98-a6be3406c069 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:21.452778 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1430/2864] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:53:21 2022] PUT /identity/v3/projects/5b345335ac644c1492b3e91ec3d681b1/users/8e13fa668324477a81e8cd1bd00a11e3/roles/e6d18df5c4e74dfd8ebd9c636f45936e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 08 16:53:21.463078 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e21214-079c-4797-a6ed-4893acdb5e02 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:21.463370 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e21214-079c-4797-a6ed-4893acdb5e02 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:21.463646 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e21214-079c-4797-a6ed-4893acdb5e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:21.489661 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-f4e21214-079c-4797-a6ed-4893acdb5e02 None None] MFA Rules not processed for user `8e13fa668324477a81e8cd1bd00a11e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:21.490850 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-f4e21214-079c-4797-a6ed-4893acdb5e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:21.557334 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1435/2865] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:21 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:21.568070 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adcb52-ca0f-4592-ba98-a6be3406c069 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:21.569897 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-12adcb52-ca0f-4592-ba98-a6be3406c069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:21.624914 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adcb52-ca0f-4592-ba98-a6be3406c069 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:21.628552 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a543a-c386-4e17-b0b1-44142b7480b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:21.629228 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a543a-c386-4e17-b0b1-44142b7480b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:21.629541 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a543a-c386-4e17-b0b1-44142b7480b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:21.629791 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a543a-c386-4e17-b0b1-44142b7480b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:21.638437 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a543a-c386-4e17-b0b1-44142b7480b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:21.639895 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a543a-c386-4e17-b0b1-44142b7480b8 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:21.648999 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1431/2866] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:53:21 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:53:21.784921 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e21214-079c-4797-a6ed-4893acdb5e02 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:21.795130 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e21214-079c-4797-a6ed-4893acdb5e02 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:21.798662 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ceed4-e676-4e3c-bd32-c9813752d95b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:21.799290 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ceed4-e676-4e3c-bd32-c9813752d95b service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:21.799574 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ceed4-e676-4e3c-bd32-c9813752d95b service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:21.799911 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ceed4-e676-4e3c-bd32-c9813752d95b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:21.853266 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ceed4-e676-4e3c-bd32-c9813752d95b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:21.854681 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ceed4-e676-4e3c-bd32-c9813752d95b service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:21.863248 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1436/2867] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:53:21 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:53:30.084035 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a543a-c386-4e17-b0b1-44142b7480b8 service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:30.142812 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a543a-c386-4e17-b0b1-44142b7480b8 service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:30.147898 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7abbe-c5a6-49a3-ab0e-05351cd66fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:30.148739 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7abbe-c5a6-49a3-ab0e-05351cd66fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:30.149078 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7abbe-c5a6-49a3-ab0e-05351cd66fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:30.149351 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7abbe-c5a6-49a3-ab0e-05351cd66fd5 admin admin] PATH_INFO: `/v3/users/cb26d7b7c36342688569f398e32de758` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:30.150515 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7abbe-c5a6-49a3-ab0e-05351cd66fd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb26d7b7c36342688569f398e32de758)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:30.152458 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7abbe-c5a6-49a3-ab0e-05351cd66fd5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:30.197863 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-36c7abbe-c5a6-49a3-ab0e-05351cd66fd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb26d7b7c36342688569f398e32de758'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:30.204347 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-36c7abbe-c5a6-49a3-ab0e-05351cd66fd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb26d7b7c36342688569f398e32de758'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:30.215508 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-36c7abbe-c5a6-49a3-ab0e-05351cd66fd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb26d7b7c36342688569f398e32de758'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:30.222497 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-36c7abbe-c5a6-49a3-ab0e-05351cd66fd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb26d7b7c36342688569f398e32de758'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:30.223223 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-36c7abbe-c5a6-49a3-ab0e-05351cd66fd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb26d7b7c36342688569f398e32de758'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:30.228944 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1432/2868] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:53:30 2022] DELETE /identity/v3/users/cb26d7b7c36342688569f398e32de758 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:30.233635 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26624486-52a3-4cdb-80b5-96ff27e9dad9 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:30.234135 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26624486-52a3-4cdb-80b5-96ff27e9dad9 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:30.234362 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26624486-52a3-4cdb-80b5-96ff27e9dad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:30.251550 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-26624486-52a3-4cdb-80b5-96ff27e9dad9 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:30.252778 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-26624486-52a3-4cdb-80b5-96ff27e9dad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:30.310477 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1437/2869] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:30.320830 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7abbe-c5a6-49a3-ab0e-05351cd66fd5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:30.322277 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-36c7abbe-c5a6-49a3-ab0e-05351cd66fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:30.377648 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7abbe-c5a6-49a3-ab0e-05351cd66fd5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:30.382017 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff77a62-f24e-457d-b6bf-1b1a9d94456e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:30.382705 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff77a62-f24e-457d-b6bf-1b1a9d94456e service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:30.382982 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff77a62-f24e-457d-b6bf-1b1a9d94456e service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:30.383256 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff77a62-f24e-457d-b6bf-1b1a9d94456e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:30.392055 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff77a62-f24e-457d-b6bf-1b1a9d94456e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:30.393500 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff77a62-f24e-457d-b6bf-1b1a9d94456e service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:30.402772 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1433/2870] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:53:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:53:30.657097 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26624486-52a3-4cdb-80b5-96ff27e9dad9 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:30.658629 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-26624486-52a3-4cdb-80b5-96ff27e9dad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:30.670953 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26624486-52a3-4cdb-80b5-96ff27e9dad9 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:30.675628 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eeff9c-f439-41b0-a370-e9dae426f3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:30.677126 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eeff9c-f439-41b0-a370-e9dae426f3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:30.677405 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eeff9c-f439-41b0-a370-e9dae426f3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:30.677681 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eeff9c-f439-41b0-a370-e9dae426f3a1 admin admin] PATH_INFO: `/v3/projects/655924f8606e456aace31878ac274a7f` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:30.678935 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eeff9c-f439-41b0-a370-e9dae426f3a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=655924f8606e456aace31878ac274a7f)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:30.680865 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eeff9c-f439-41b0-a370-e9dae426f3a1 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:30.727393 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-92eeff9c-f439-41b0-a370-e9dae426f3a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '655924f8606e456aace31878ac274a7f', 'request_id': 'req-92eeff9c-f439-41b0-a370-e9dae426f3a1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:30.733171 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-92eeff9c-f439-41b0-a370-e9dae426f3a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '655924f8606e456aace31878ac274a7f', 'request_id': 'req-92eeff9c-f439-41b0-a370-e9dae426f3a1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:30.738436 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-92eeff9c-f439-41b0-a370-e9dae426f3a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '655924f8606e456aace31878ac274a7f', 'request_id': 'req-92eeff9c-f439-41b0-a370-e9dae426f3a1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:30.750577 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-92eeff9c-f439-41b0-a370-e9dae426f3a1 admin admin] The token cache is being invalidate because project 655924f8606e456aace31878ac274a7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:53:30.750862 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-92eeff9c-f439-41b0-a370-e9dae426f3a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:30.751475 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-92eeff9c-f439-41b0-a370-e9dae426f3a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:30.753015 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1438/2871] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:53:30 2022] DELETE /identity/v3/projects/655924f8606e456aace31878ac274a7f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:30.757640 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff77a62-f24e-457d-b6bf-1b1a9d94456e service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:30.767251 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff77a62-f24e-457d-b6bf-1b1a9d94456e service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:30.820507 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a0202-837e-417e-a509-c990438881b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:30.821360 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a0202-837e-417e-a509-c990438881b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:30.821638 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a0202-837e-417e-a509-c990438881b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:30.821908 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a0202-837e-417e-a509-c990438881b5 admin admin] PATH_INFO: `/v3/users/8e13fa668324477a81e8cd1bd00a11e3` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:30.823083 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a0202-837e-417e-a509-c990438881b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e13fa668324477a81e8cd1bd00a11e3)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:30.825028 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a0202-837e-417e-a509-c990438881b5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:30.868268 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-384a0202-837e-417e-a509-c990438881b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e13fa668324477a81e8cd1bd00a11e3'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:30.875044 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-384a0202-837e-417e-a509-c990438881b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e13fa668324477a81e8cd1bd00a11e3'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:30.886235 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-384a0202-837e-417e-a509-c990438881b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e13fa668324477a81e8cd1bd00a11e3'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:30.893192 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-384a0202-837e-417e-a509-c990438881b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e13fa668324477a81e8cd1bd00a11e3'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:30.893815 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-384a0202-837e-417e-a509-c990438881b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e13fa668324477a81e8cd1bd00a11e3'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:30.900305 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1434/2872] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:53:30 2022] DELETE /identity/v3/users/8e13fa668324477a81e8cd1bd00a11e3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:31.172903 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eeff9c-f439-41b0-a370-e9dae426f3a1 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:31.174363 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-92eeff9c-f439-41b0-a370-e9dae426f3a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:31.188036 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eeff9c-f439-41b0-a370-e9dae426f3a1 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:31.243271 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41c114-8e6c-4672-8ca1-3aa7ba45432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:31.244087 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41c114-8e6c-4672-8ca1-3aa7ba45432b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:31.244374 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41c114-8e6c-4672-8ca1-3aa7ba45432b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:31.244648 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41c114-8e6c-4672-8ca1-3aa7ba45432b admin admin] PATH_INFO: `/v3/projects/5b345335ac644c1492b3e91ec3d681b1` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:31.245831 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41c114-8e6c-4672-8ca1-3aa7ba45432b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b345335ac644c1492b3e91ec3d681b1)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:31.247784 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41c114-8e6c-4672-8ca1-3aa7ba45432b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:31.291802 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5d41c114-8e6c-4672-8ca1-3aa7ba45432b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b345335ac644c1492b3e91ec3d681b1', 'request_id': 'req-5d41c114-8e6c-4672-8ca1-3aa7ba45432b'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:31.297596 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5d41c114-8e6c-4672-8ca1-3aa7ba45432b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b345335ac644c1492b3e91ec3d681b1', 'request_id': 'req-5d41c114-8e6c-4672-8ca1-3aa7ba45432b'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:31.303422 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5d41c114-8e6c-4672-8ca1-3aa7ba45432b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b345335ac644c1492b3e91ec3d681b1', 'request_id': 'req-5d41c114-8e6c-4672-8ca1-3aa7ba45432b'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:31.318380 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5d41c114-8e6c-4672-8ca1-3aa7ba45432b admin admin] The token cache is being invalidate because project 5b345335ac644c1492b3e91ec3d681b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:53:31.318666 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5d41c114-8e6c-4672-8ca1-3aa7ba45432b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:31.319280 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-5d41c114-8e6c-4672-8ca1-3aa7ba45432b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:31.320849 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1439/2873] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:53:31 2022] DELETE /identity/v3/projects/5b345335ac644c1492b3e91ec3d681b1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:31.330315 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08113050-f8b8-4295-bbb7-5435bde79980 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:31.330896 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08113050-f8b8-4295-bbb7-5435bde79980 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:31.330896 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08113050-f8b8-4295-bbb7-5435bde79980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:31.349891 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-08113050-f8b8-4295-bbb7-5435bde79980 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:31.351126 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-08113050-f8b8-4295-bbb7-5435bde79980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:31.407689 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1435/2874] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:31.416323 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21d218-5814-4859-af7e-8f0ad7857a13 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:31.416615 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21d218-5814-4859-af7e-8f0ad7857a13 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:31.416896 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21d218-5814-4859-af7e-8f0ad7857a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:31.436577 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-cb21d218-5814-4859-af7e-8f0ad7857a13 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:31.437770 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-cb21d218-5814-4859-af7e-8f0ad7857a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:31.445929 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1440/2875] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:31.450220 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08113050-f8b8-4295-bbb7-5435bde79980 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:31.459701 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08113050-f8b8-4295-bbb7-5435bde79980 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:31.464183 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467478b-6768-4fd2-9057-866ccfa5bec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:31.464816 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467478b-6768-4fd2-9057-866ccfa5bec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:31.465092 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467478b-6768-4fd2-9057-866ccfa5bec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:31.465363 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467478b-6768-4fd2-9057-866ccfa5bec0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:31.466087 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467478b-6768-4fd2-9057-866ccfa5bec0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 08 16:53:31.466386 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467478b-6768-4fd2-9057-866ccfa5bec0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:31.467984 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467478b-6768-4fd2-9057-866ccfa5bec0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:31.479526 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1436/2876] 10.222.0.35 () {58 vars in 1152 bytes} [Tue Feb 8 16:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 08 16:53:31.483721 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21d218-5814-4859-af7e-8f0ad7857a13 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:31.493466 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21d218-5814-4859-af7e-8f0ad7857a13 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:31.498142 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a19a2a-0c8f-4b3c-9e94-7039a8d7f238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:31.498772 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a19a2a-0c8f-4b3c-9e94-7039a8d7f238 admin admin] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:31.499047 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a19a2a-0c8f-4b3c-9e94-7039a8d7f238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:31.499565 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a19a2a-0c8f-4b3c-9e94-7039a8d7f238 admin admin] PATH_INFO: `/v3/projects` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:31.500315 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a19a2a-0c8f-4b3c-9e94-7039a8d7f238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:31.502152 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a19a2a-0c8f-4b3c-9e94-7039a8d7f238 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:31.525870 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1441/2877] 10.222.0.35 () {60 vars in 1152 bytes} [Tue Feb 8 16:53:31 2022] POST /identity/v3/projects => generated 399 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 08 16:53:31.530025 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467478b-6768-4fd2-9057-866ccfa5bec0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:31.540513 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467478b-6768-4fd2-9057-866ccfa5bec0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:31.592766 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ebf11-60e5-43dc-85c9-5d17742d3bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:31.593418 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ebf11-60e5-43dc-85c9-5d17742d3bfe admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:31.593700 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ebf11-60e5-43dc-85c9-5d17742d3bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:31.593974 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ebf11-60e5-43dc-85c9-5d17742d3bfe admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:31.594673 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ebf11-60e5-43dc-85c9-5d17742d3bfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:31.596659 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ebf11-60e5-43dc-85c9-5d17742d3bfe admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:31.618045 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1437/2878] 10.222.0.35 () {60 vars in 1143 bytes} [Tue Feb 8 16:53:31 2022] POST /identity/v3/users => generated 300 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 08 16:53:31.622251 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a19a2a-0c8f-4b3c-9e94-7039a8d7f238 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:31.632628 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a19a2a-0c8f-4b3c-9e94-7039a8d7f238 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:31.637348 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3b44c-cb1e-4f76-8f09-d9f02ada62d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:31.637969 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3b44c-cb1e-4f76-8f09-d9f02ada62d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:31.638247 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3b44c-cb1e-4f76-8f09-d9f02ada62d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:31.638516 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3b44c-cb1e-4f76-8f09-d9f02ada62d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:31.639240 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3b44c-cb1e-4f76-8f09-d9f02ada62d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:31.640836 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3b44c-cb1e-4f76-8f09-d9f02ada62d2 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:31.652144 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1442/2879] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:53:31.656166 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ebf11-60e5-43dc-85c9-5d17742d3bfe admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:31.667011 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ebf11-60e5-43dc-85c9-5d17742d3bfe admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:31.671945 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466117a4-47ea-4c8b-a5a6-e064d5175a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:31.672663 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466117a4-47ea-4c8b-a5a6-e064d5175a00 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:31.672949 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466117a4-47ea-4c8b-a5a6-e064d5175a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:31.673228 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466117a4-47ea-4c8b-a5a6-e064d5175a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:31.673970 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466117a4-47ea-4c8b-a5a6-e064d5175a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:31.675571 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466117a4-47ea-4c8b-a5a6-e064d5175a00 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:31.693944 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1438/2880] 10.222.0.35 () {58 vars in 1121 bytes} [Tue Feb 8 16:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 08 16:53:31.698151 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3b44c-cb1e-4f76-8f09-d9f02ada62d2 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:31.710064 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3b44c-cb1e-4f76-8f09-d9f02ada62d2 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:31.714648 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e8f97-0ad1-4d2f-b600-fac185810221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:31.715507 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e8f97-0ad1-4d2f-b600-fac185810221 admin admin] REQUEST_METHOD: `PUT` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:31.715811 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e8f97-0ad1-4d2f-b600-fac185810221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:31.716086 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e8f97-0ad1-4d2f-b600-fac185810221 admin admin] PATH_INFO: `/v3/projects/31631b7128144c81ae09428c24d44349/users/c8cff335d8a9479495c7fc4536132824/roles/c5c492cc34274d1db36b946b78fa47d7` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:31.730499 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e8f97-0ad1-4d2f-b600-fac185810221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31631b7128144c81ae09428c24d44349, user_id=c8cff335d8a9479495c7fc4536132824, role_id=c5c492cc34274d1db36b946b78fa47d7)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:31.733134 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e8f97-0ad1-4d2f-b600-fac185810221 admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:31.745631 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1443/2881] 10.222.0.35 () {60 vars in 1482 bytes} [Tue Feb 8 16:53:31 2022] PUT /identity/v3/projects/31631b7128144c81ae09428c24d44349/users/c8cff335d8a9479495c7fc4536132824/roles/c5c492cc34274d1db36b946b78fa47d7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:31.756094 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59561e0-2d7c-463a-ab8a-319442478aee None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:31.756388 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59561e0-2d7c-463a-ab8a-319442478aee None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:31.756670 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59561e0-2d7c-463a-ab8a-319442478aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:31.782771 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c59561e0-2d7c-463a-ab8a-319442478aee None None] MFA Rules not processed for user `c8cff335d8a9479495c7fc4536132824`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:31.784009 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c59561e0-2d7c-463a-ab8a-319442478aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:31.844791 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1439/2882] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:31.856649 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e8f97-0ad1-4d2f-b600-fac185810221 admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:31.858297 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-885e8f97-0ad1-4d2f-b600-fac185810221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:31.913168 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e8f97-0ad1-4d2f-b600-fac185810221 admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:31.916845 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb0093-2d0e-44c0-8214-e780cdafbb1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:31.917471 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb0093-2d0e-44c0-8214-e780cdafbb1b service cinder] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:31.917747 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb0093-2d0e-44c0-8214-e780cdafbb1b service cinder] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:31.918016 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb0093-2d0e-44c0-8214-e780cdafbb1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:31.926535 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb0093-2d0e-44c0-8214-e780cdafbb1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:31.927998 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb0093-2d0e-44c0-8214-e780cdafbb1b service cinder] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:31.936453 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1444/2883] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:53:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:53:39.925143 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59561e0-2d7c-463a-ab8a-319442478aee None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:39.986152 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59561e0-2d7c-463a-ab8a-319442478aee None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:39.990660 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edd7bf-a69e-4c09-8c54-2488a33bae4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:39.991540 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edd7bf-a69e-4c09-8c54-2488a33bae4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:39.991860 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edd7bf-a69e-4c09-8c54-2488a33bae4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:39.992141 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edd7bf-a69e-4c09-8c54-2488a33bae4a admin admin] PATH_INFO: `/v3/users/c8cff335d8a9479495c7fc4536132824` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:39.993357 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edd7bf-a69e-4c09-8c54-2488a33bae4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8cff335d8a9479495c7fc4536132824)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:39.995260 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edd7bf-a69e-4c09-8c54-2488a33bae4a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:40.038714 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b3edd7bf-a69e-4c09-8c54-2488a33bae4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8cff335d8a9479495c7fc4536132824'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:40.045163 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b3edd7bf-a69e-4c09-8c54-2488a33bae4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8cff335d8a9479495c7fc4536132824'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:40.056104 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b3edd7bf-a69e-4c09-8c54-2488a33bae4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8cff335d8a9479495c7fc4536132824'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:40.062896 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b3edd7bf-a69e-4c09-8c54-2488a33bae4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8cff335d8a9479495c7fc4536132824'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:40.063487 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b3edd7bf-a69e-4c09-8c54-2488a33bae4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8cff335d8a9479495c7fc4536132824'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:40.069197 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1440/2884] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:53:39 2022] DELETE /identity/v3/users/c8cff335d8a9479495c7fc4536132824 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:40.073745 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acaf7a0-13c7-4a9c-ba84-f88e7576efe6 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:40.074240 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acaf7a0-13c7-4a9c-ba84-f88e7576efe6 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:40.074378 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acaf7a0-13c7-4a9c-ba84-f88e7576efe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:40.091313 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-5acaf7a0-13c7-4a9c-ba84-f88e7576efe6 None None] MFA Rules not processed for user `3e3abf5e1906480a9a6c24bfbb2057a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:40.092617 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5acaf7a0-13c7-4a9c-ba84-f88e7576efe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:40.149481 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1445/2885] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:40.159497 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edd7bf-a69e-4c09-8c54-2488a33bae4a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:40.161466 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b3edd7bf-a69e-4c09-8c54-2488a33bae4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:40.215656 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edd7bf-a69e-4c09-8c54-2488a33bae4a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:40.219425 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5564b15-5819-43c3-9e28-456ccb064dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:40.220087 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5564b15-5819-43c3-9e28-456ccb064dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:40.220366 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5564b15-5819-43c3-9e28-456ccb064dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:40.220639 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5564b15-5819-43c3-9e28-456ccb064dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:40.230087 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5564b15-5819-43c3-9e28-456ccb064dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:40.231499 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5564b15-5819-43c3-9e28-456ccb064dc0 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:40.240955 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1441/2886] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:53:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:53:40.495819 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acaf7a0-13c7-4a9c-ba84-f88e7576efe6 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:40.497247 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-5acaf7a0-13c7-4a9c-ba84-f88e7576efe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:40.511295 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acaf7a0-13c7-4a9c-ba84-f88e7576efe6 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:40.516864 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead31413-c6bd-4fe1-8b31-23c88c50511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:40.517902 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead31413-c6bd-4fe1-8b31-23c88c50511e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:40.518245 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead31413-c6bd-4fe1-8b31-23c88c50511e admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:40.518452 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead31413-c6bd-4fe1-8b31-23c88c50511e admin admin] PATH_INFO: `/v3/projects/31631b7128144c81ae09428c24d44349` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:40.520473 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead31413-c6bd-4fe1-8b31-23c88c50511e admin admin] RBAC: Authorizing `identity:delete_project(project_id=31631b7128144c81ae09428c24d44349)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:40.522309 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead31413-c6bd-4fe1-8b31-23c88c50511e admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:40.567047 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ead31413-c6bd-4fe1-8b31-23c88c50511e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31631b7128144c81ae09428c24d44349', 'request_id': 'req-ead31413-c6bd-4fe1-8b31-23c88c50511e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:40.573014 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ead31413-c6bd-4fe1-8b31-23c88c50511e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31631b7128144c81ae09428c24d44349', 'request_id': 'req-ead31413-c6bd-4fe1-8b31-23c88c50511e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:40.578112 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ead31413-c6bd-4fe1-8b31-23c88c50511e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31631b7128144c81ae09428c24d44349', 'request_id': 'req-ead31413-c6bd-4fe1-8b31-23c88c50511e'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:40.590325 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ead31413-c6bd-4fe1-8b31-23c88c50511e admin admin] The token cache is being invalidate because project 31631b7128144c81ae09428c24d44349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79340) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:53:40.590602 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ead31413-c6bd-4fe1-8b31-23c88c50511e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:40.591205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-ead31413-c6bd-4fe1-8b31-23c88c50511e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:53:40.592743 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1446/2887] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:53:40 2022] DELETE /identity/v3/projects/31631b7128144c81ae09428c24d44349 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:53:50.167317 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99081979-5f7c-4ce2-89d3-adcf693d6b44 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:50.167925 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99081979-5f7c-4ce2-89d3-adcf693d6b44 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:50.167925 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99081979-5f7c-4ce2-89d3-adcf693d6b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:50.185792 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-99081979-5f7c-4ce2-89d3-adcf693d6b44 None None] MFA Rules not processed for user `cd913a6397564f859fa9f1dd1edd4596`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:53:50.187027 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-99081979-5f7c-4ce2-89d3-adcf693d6b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:50.248250 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1442/2888] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:53:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:53:50.556015 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead31413-c6bd-4fe1-8b31-23c88c50511e admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:50.557485 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-ead31413-c6bd-4fe1-8b31-23c88c50511e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:50.610658 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead31413-c6bd-4fe1-8b31-23c88c50511e admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:50.614763 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec9c11-542a-44b4-bb7a-00bd27dc3153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:50.615389 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec9c11-542a-44b4-bb7a-00bd27dc3153 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:50.615668 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec9c11-542a-44b4-bb7a-00bd27dc3153 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:50.615970 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec9c11-542a-44b4-bb7a-00bd27dc3153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:50.617704 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-53ec9c11-542a-44b4-bb7a-00bd27dc3153 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:50.626999 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec9c11-542a-44b4-bb7a-00bd27dc3153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:50.628431 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec9c11-542a-44b4-bb7a-00bd27dc3153 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:50.636278 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1447/2889] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:53:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:53:51.065734 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99081979-5f7c-4ce2-89d3-adcf693d6b44 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:53:51.068018 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-99081979-5f7c-4ce2-89d3-adcf693d6b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:51.136476 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99081979-5f7c-4ce2-89d3-adcf693d6b44 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:53:51.141521 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cb092-80f3-4f9e-88f2-b6e5dda195a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c8f232fc83474b8731ee6c1eb321fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:53:51.142156 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cb092-80f3-4f9e-88f2-b6e5dda195a3 service placement] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:53:51.142439 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cb092-80f3-4f9e-88f2-b6e5dda195a3 service placement] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:53:51.142715 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cb092-80f3-4f9e-88f2-b6e5dda195a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:53:51.144524 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-021cb092-80f3-4f9e-88f2-b6e5dda195a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:53:51.155997 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021cb092-80f3-4f9e-88f2-b6e5dda195a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:53:51.157595 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021cb092-80f3-4f9e-88f2-b6e5dda195a3 service placement] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:53:51.168027 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1443/2890] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:53:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:54:04.595932 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec9c11-542a-44b4-bb7a-00bd27dc3153 service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:54:04.597378 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-53ec9c11-542a-44b4-bb7a-00bd27dc3153 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:54:04.702956 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec9c11-542a-44b4-bb7a-00bd27dc3153 service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:54:04.709500 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035773c4-72ef-4b37-b4ce-c185db5db93e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:54:04.710136 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035773c4-72ef-4b37-b4ce-c185db5db93e service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:54:04.710419 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035773c4-72ef-4b37-b4ce-c185db5db93e service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:54:04.710695 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035773c4-72ef-4b37-b4ce-c185db5db93e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:54:04.712489 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-035773c4-72ef-4b37-b4ce-c185db5db93e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:54:04.724890 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035773c4-72ef-4b37-b4ce-c185db5db93e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:54:04.726454 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035773c4-72ef-4b37-b4ce-c185db5db93e service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:54:04.736703 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1448/2891] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:54:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:54:09.511518 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cb092-80f3-4f9e-88f2-b6e5dda195a3 service placement] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:54:09.513085 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-021cb092-80f3-4f9e-88f2-b6e5dda195a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:54:09.577069 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cb092-80f3-4f9e-88f2-b6e5dda195a3 service placement] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:54:09.582702 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad5397-ad2c-44aa-9429-d938161727dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:54:09.583367 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad5397-ad2c-44aa-9429-d938161727dc service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:54:09.583650 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad5397-ad2c-44aa-9429-d938161727dc service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:54:09.583954 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad5397-ad2c-44aa-9429-d938161727dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:54:09.586453 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-59ad5397-ad2c-44aa-9429-d938161727dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:54:09.598765 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad5397-ad2c-44aa-9429-d938161727dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:54:09.601068 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad5397-ad2c-44aa-9429-d938161727dc service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:54:09.611857 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1444/2892] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:54:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:54:43.803120 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035773c4-72ef-4b37-b4ce-c185db5db93e service nova] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:54:43.838453 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035773c4-72ef-4b37-b4ce-c185db5db93e service nova] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:54:43.843302 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520a7ff-a7d5-45a2-9441-3245a64fc7c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c8f232fc83474b8731ee6c1eb321fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:54:43.843957 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520a7ff-a7d5-45a2-9441-3245a64fc7c3 service placement] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:54:43.844236 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520a7ff-a7d5-45a2-9441-3245a64fc7c3 service placement] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:54:43.844507 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520a7ff-a7d5-45a2-9441-3245a64fc7c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:54:43.846248 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-b520a7ff-a7d5-45a2-9441-3245a64fc7c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:54:43.869087 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520a7ff-a7d5-45a2-9441-3245a64fc7c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:54:43.870639 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520a7ff-a7d5-45a2-9441-3245a64fc7c3 service placement] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:54:43.881128 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1449/2893] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:54:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:55:59.188861 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad5397-ad2c-44aa-9429-d938161727dc service nova] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:55:59.190275 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-59ad5397-ad2c-44aa-9429-d938161727dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:55:59.273902 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad5397-ad2c-44aa-9429-d938161727dc service nova] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:55:59.278793 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b1067-adaa-4be5-8cc2-61740384e98a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591ac81647b8446ab342e44c3fb35174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:55:59.279542 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b1067-adaa-4be5-8cc2-61740384e98a service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:55:59.279874 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b1067-adaa-4be5-8cc2-61740384e98a service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:55:59.280143 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b1067-adaa-4be5-8cc2-61740384e98a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:55:59.281941 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1b8b1067-adaa-4be5-8cc2-61740384e98a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:55:59.294084 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b1067-adaa-4be5-8cc2-61740384e98a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:55:59.295539 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b1067-adaa-4be5-8cc2-61740384e98a service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:55:59.304822 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1445/2894] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:55:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:56:09.379428 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983954f2-bc6b-4d13-b1cd-48c3e257e9e0 None None] REQUEST_METHOD: `POST` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:56:09.380049 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983954f2-bc6b-4d13-b1cd-48c3e257e9e0 None None] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:56:09.380161 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983954f2-bc6b-4d13-b1cd-48c3e257e9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:56:09.399695 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.auth.core [None req-983954f2-bc6b-4d13-b1cd-48c3e257e9e0 None None] MFA Rules not processed for user `cd913a6397564f859fa9f1dd1edd4596`. Rule list: `[]` (Enabled: `True`). {{(pid=79340) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 08 16:56:09.400941 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-983954f2-bc6b-4d13-b1cd-48c3e257e9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:56:09.408205 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1450/2895] 10.222.0.35 () {58 vars in 957 bytes} [Tue Feb 8 16:56:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 08 16:56:09.761341 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b1067-adaa-4be5-8cc2-61740384e98a service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:56:09.762774 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1b8b1067-adaa-4be5-8cc2-61740384e98a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:56:09.795155 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b1067-adaa-4be5-8cc2-61740384e98a service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:56:09.798708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f75e26-7855-4bf5-bbd9-cd01637c3652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:56:09.799342 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f75e26-7855-4bf5-bbd9-cd01637c3652 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:56:09.799621 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f75e26-7855-4bf5-bbd9-cd01637c3652 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:56:09.799922 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f75e26-7855-4bf5-bbd9-cd01637c3652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:56:09.801685 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-63f75e26-7855-4bf5-bbd9-cd01637c3652 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:56:09.812624 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f75e26-7855-4bf5-bbd9-cd01637c3652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:56:09.814079 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f75e26-7855-4bf5-bbd9-cd01637c3652 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:56:09.822830 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1446/2896] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:56:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:56:32.474880 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983954f2-bc6b-4d13-b1cd-48c3e257e9e0 None None] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:56:32.486015 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983954f2-bc6b-4d13-b1cd-48c3e257e9e0 None None] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:56:32.489798 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5465f72-a174-44f1-bad3-f162d187e5fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:56:32.490449 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5465f72-a174-44f1-bad3-f162d187e5fe service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:56:32.490732 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5465f72-a174-44f1-bad3-f162d187e5fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:56:32.491008 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5465f72-a174-44f1-bad3-f162d187e5fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:56:32.492889 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-d5465f72-a174-44f1-bad3-f162d187e5fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:56:32.565559 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5465f72-a174-44f1-bad3-f162d187e5fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:56:32.567056 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5465f72-a174-44f1-bad3-f162d187e5fe service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:56:32.577407 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1451/2897] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:56:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:57:58.588752 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f75e26-7855-4bf5-bbd9-cd01637c3652 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:57:58.602933 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f75e26-7855-4bf5-bbd9-cd01637c3652 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:57:58.608668 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf22f9-d7ac-4f67-bba0-2c509272a11f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:57:58.609960 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf22f9-d7ac-4f67-bba0-2c509272a11f service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:57:58.609960 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf22f9-d7ac-4f67-bba0-2c509272a11f service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:57:58.610614 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf22f9-d7ac-4f67-bba0-2c509272a11f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:57:58.613061 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-32cf22f9-d7ac-4f67-bba0-2c509272a11f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:57:58.623223 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf22f9-d7ac-4f67-bba0-2c509272a11f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:57:58.624679 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf22f9-d7ac-4f67-bba0-2c509272a11f service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:57:58.633520 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1447/2898] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:57:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:58:24.276007 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5465f72-a174-44f1-bad3-f162d187e5fe service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:58:24.290658 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5465f72-a174-44f1-bad3-f162d187e5fe service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:58:24.294798 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158f10f-b680-47de-80b4-2aa5b50d5e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:58:24.295513 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158f10f-b680-47de-80b4-2aa5b50d5e58 service neutron] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:58:24.295858 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158f10f-b680-47de-80b4-2aa5b50d5e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:58:24.296132 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158f10f-b680-47de-80b4-2aa5b50d5e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:58:24.298438 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-7158f10f-b680-47de-80b4-2aa5b50d5e58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:58:24.348586 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158f10f-b680-47de-80b4-2aa5b50d5e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:58:24.350109 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158f10f-b680-47de-80b4-2aa5b50d5e58 service neutron] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:58:24.377203 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1452/2899] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:58:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 08 16:58:25.671888 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf22f9-d7ac-4f67-bba0-2c509272a11f service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:58:25.683966 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf22f9-d7ac-4f67-bba0-2c509272a11f service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:58:25.689686 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b7a00-733d-4cf3-9540-aa1b0050a844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:58:25.690598 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b7a00-733d-4cf3-9540-aa1b0050a844 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:58:25.691054 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b7a00-733d-4cf3-9540-aa1b0050a844 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:58:25.691516 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b7a00-733d-4cf3-9540-aa1b0050a844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:58:25.694152 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-aa9b7a00-733d-4cf3-9540-aa1b0050a844 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:58:25.713645 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b7a00-733d-4cf3-9540-aa1b0050a844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:58:25.715226 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b7a00-733d-4cf3-9540-aa1b0050a844 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:58:25.731115 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1448/2900] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:58:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:58:26.570820 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158f10f-b680-47de-80b4-2aa5b50d5e58 service neutron] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:58:26.597532 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158f10f-b680-47de-80b4-2aa5b50d5e58 service neutron] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:58:26.607103 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bb0c2-a8df-41d8-b031-6031f346a744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb02e5d8ef14f8f85bbacfa5b1f5be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:58:26.608432 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bb0c2-a8df-41d8-b031-6031f346a744 service nova] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:58:26.608867 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bb0c2-a8df-41d8-b031-6031f346a744 service nova] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:58:26.609227 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bb0c2-a8df-41d8-b031-6031f346a744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:58:26.612192 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-647bb0c2-a8df-41d8-b031-6031f346a744 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:58:26.631998 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647bb0c2-a8df-41d8-b031-6031f346a744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:58:26.637010 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647bb0c2-a8df-41d8-b031-6031f346a744 service nova] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:58:26.649668 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1453/2901] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:58:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:58:37.329941 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b7a00-733d-4cf3-9540-aa1b0050a844 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:58:37.339719 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b7a00-733d-4cf3-9540-aa1b0050a844 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:58:37.343686 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff02e7f-8233-40dd-b4ea-b202176281cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b936dc9a67846f08e51648e64c3d6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:58:37.344406 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff02e7f-8233-40dd-b4ea-b202176281cb service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:58:37.345407 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff02e7f-8233-40dd-b4ea-b202176281cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:58:37.345729 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff02e7f-8233-40dd-b4ea-b202176281cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:58:37.349891 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3ff02e7f-8233-40dd-b4ea-b202176281cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:58:37.441678 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff02e7f-8233-40dd-b4ea-b202176281cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:58:37.443115 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff02e7f-8233-40dd-b4ea-b202176281cb service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:58:37.463365 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1449/2902] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:58:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 08 16:58:43.987456 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bb0c2-a8df-41d8-b031-6031f346a744 service nova] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:58:43.989095 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-647bb0c2-a8df-41d8-b031-6031f346a744 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:58:44.005731 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bb0c2-a8df-41d8-b031-6031f346a744 service nova] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:58:44.010454 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d925543-71cd-432d-9c60-8fee17e3e39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:58:44.011370 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d925543-71cd-432d-9c60-8fee17e3e39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:58:44.011649 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d925543-71cd-432d-9c60-8fee17e3e39b admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:58:44.011950 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d925543-71cd-432d-9c60-8fee17e3e39b admin admin] PATH_INFO: `/v3/users/cd913a6397564f859fa9f1dd1edd4596` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:58:44.013177 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d925543-71cd-432d-9c60-8fee17e3e39b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd913a6397564f859fa9f1dd1edd4596)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:58:44.015085 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d925543-71cd-432d-9c60-8fee17e3e39b admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:58:44.066303 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-1d925543-71cd-432d-9c60-8fee17e3e39b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd913a6397564f859fa9f1dd1edd4596'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:58:44.077787 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-1d925543-71cd-432d-9c60-8fee17e3e39b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd913a6397564f859fa9f1dd1edd4596'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:58:44.084799 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-1d925543-71cd-432d-9c60-8fee17e3e39b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd913a6397564f859fa9f1dd1edd4596'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:58:44.092752 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-1d925543-71cd-432d-9c60-8fee17e3e39b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd913a6397564f859fa9f1dd1edd4596'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:58:44.093367 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-1d925543-71cd-432d-9c60-8fee17e3e39b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd913a6397564f859fa9f1dd1edd4596'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:58:44.099972 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1454/2903] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:58:43 2022] DELETE /identity/v3/users/cd913a6397564f859fa9f1dd1edd4596 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:58:44.274668 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff02e7f-8233-40dd-b4ea-b202176281cb service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:58:44.287730 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff02e7f-8233-40dd-b4ea-b202176281cb service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:58:44.346132 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b4dce-da21-446b-8298-b945662294d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:58:44.346982 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b4dce-da21-446b-8298-b945662294d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:58:44.347271 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b4dce-da21-446b-8298-b945662294d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:58:44.347548 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b4dce-da21-446b-8298-b945662294d6 admin admin] PATH_INFO: `/v3/projects/9a449e431c5240b897d5cab55009fdbf` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:58:44.348783 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b4dce-da21-446b-8298-b945662294d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a449e431c5240b897d5cab55009fdbf)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:58:44.350671 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b4dce-da21-446b-8298-b945662294d6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:58:44.397614 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a93b4dce-da21-446b-8298-b945662294d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a449e431c5240b897d5cab55009fdbf', 'request_id': 'req-a93b4dce-da21-446b-8298-b945662294d6'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:58:44.403911 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a93b4dce-da21-446b-8298-b945662294d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a449e431c5240b897d5cab55009fdbf', 'request_id': 'req-a93b4dce-da21-446b-8298-b945662294d6'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:58:44.410166 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a93b4dce-da21-446b-8298-b945662294d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a449e431c5240b897d5cab55009fdbf', 'request_id': 'req-a93b4dce-da21-446b-8298-b945662294d6'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:58:44.423212 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a93b4dce-da21-446b-8298-b945662294d6 admin admin] The token cache is being invalidate because project 9a449e431c5240b897d5cab55009fdbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:58:44.423666 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a93b4dce-da21-446b-8298-b945662294d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:58:44.424666 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a93b4dce-da21-446b-8298-b945662294d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:58:44.426462 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1450/2904] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:58:44 2022] DELETE /identity/v3/projects/9a449e431c5240b897d5cab55009fdbf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:58:44.430885 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d925543-71cd-432d-9c60-8fee17e3e39b admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:58:44.432372 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-1d925543-71cd-432d-9c60-8fee17e3e39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:58:44.447403 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d925543-71cd-432d-9c60-8fee17e3e39b admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:58:44.508059 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135362c3-958b-4db7-8dfc-f1b11239bc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:58:44.508932 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135362c3-958b-4db7-8dfc-f1b11239bc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:58:44.509215 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135362c3-958b-4db7-8dfc-f1b11239bc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:58:44.509492 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135362c3-958b-4db7-8dfc-f1b11239bc8c admin admin] PATH_INFO: `/v3/users/9c1175ba0f2647c2b7b04ad667f9a8d1` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:58:44.510719 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135362c3-958b-4db7-8dfc-f1b11239bc8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1175ba0f2647c2b7b04ad667f9a8d1)` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:58:44.512801 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135362c3-958b-4db7-8dfc-f1b11239bc8c admin admin] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:58:44.560267 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-135362c3-958b-4db7-8dfc-f1b11239bc8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1175ba0f2647c2b7b04ad667f9a8d1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:58:44.571654 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-135362c3-958b-4db7-8dfc-f1b11239bc8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1175ba0f2647c2b7b04ad667f9a8d1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:58:44.578224 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-135362c3-958b-4db7-8dfc-f1b11239bc8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1175ba0f2647c2b7b04ad667f9a8d1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:58:44.585831 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-135362c3-958b-4db7-8dfc-f1b11239bc8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1175ba0f2647c2b7b04ad667f9a8d1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:58:44.586444 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.notifications [None req-135362c3-958b-4db7-8dfc-f1b11239bc8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1175ba0f2647c2b7b04ad667f9a8d1'} {{(pid=79340) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:58:44.592274 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1455/2905] 10.222.0.35 () {58 vars in 1223 bytes} [Tue Feb 8 16:58:44 2022] DELETE /identity/v3/users/9c1175ba0f2647c2b7b04ad667f9a8d1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:58:44.759708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b4dce-da21-446b-8298-b945662294d6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:58:44.761159 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a93b4dce-da21-446b-8298-b945662294d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:58:44.775040 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b4dce-da21-446b-8298-b945662294d6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:58:44.838701 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc3d69-ba58-42e7-a488-c03402c328d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e3abf5e1906480a9a6c24bfbb2057a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5e4fc6dd694372b7f8775a6f881cca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:58:44.839630 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc3d69-ba58-42e7-a488-c03402c328d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:58:44.839957 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc3d69-ba58-42e7-a488-c03402c328d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:58:44.840240 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc3d69-ba58-42e7-a488-c03402c328d0 admin admin] PATH_INFO: `/v3/projects/b19ce5c3d7f341bcb5c8440adcc7ca49` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:58:44.841429 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc3d69-ba58-42e7-a488-c03402c328d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b19ce5c3d7f341bcb5c8440adcc7ca49)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:58:44.843325 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc3d69-ba58-42e7-a488-c03402c328d0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:58:44.888165 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9acc3d69-ba58-42e7-a488-c03402c328d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b19ce5c3d7f341bcb5c8440adcc7ca49', 'request_id': 'req-9acc3d69-ba58-42e7-a488-c03402c328d0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:58:44.895105 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9acc3d69-ba58-42e7-a488-c03402c328d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b19ce5c3d7f341bcb5c8440adcc7ca49', 'request_id': 'req-9acc3d69-ba58-42e7-a488-c03402c328d0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:58:44.900356 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9acc3d69-ba58-42e7-a488-c03402c328d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b19ce5c3d7f341bcb5c8440adcc7ca49', 'request_id': 'req-9acc3d69-ba58-42e7-a488-c03402c328d0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:58:44.912422 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9acc3d69-ba58-42e7-a488-c03402c328d0 admin admin] The token cache is being invalidate because project b19ce5c3d7f341bcb5c8440adcc7ca49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 08 16:58:44.912708 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9acc3d69-ba58-42e7-a488-c03402c328d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:58:44.913320 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9acc3d69-ba58-42e7-a488-c03402c328d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 08 16:58:44.914868 dv-cinder-827860-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1451/2906] 10.222.0.35 () {58 vars in 1232 bytes} [Tue Feb 8 16:58:44 2022] DELETE /identity/v3/projects/b19ce5c3d7f341bcb5c8440adcc7ca49 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 08 16:59:45.813804 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135362c3-958b-4db7-8dfc-f1b11239bc8c admin admin] Authenticating user token {{(pid=79340) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 08 16:59:45.815197 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-135362c3-958b-4db7-8dfc-f1b11239bc8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:59:45.881887 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135362c3-958b-4db7-8dfc-f1b11239bc8c admin admin] Validating token access rules against request {{(pid=79340) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 08 16:59:45.950954 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436ecd1-b513-40c1-85d3-a8fc686c5cc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c8f232fc83474b8731ee6c1eb321fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b01069799b34858bbebc201a3f2046d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79340) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 08 16:59:45.951592 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436ecd1-b513-40c1-85d3-a8fc686c5cc6 service placement] REQUEST_METHOD: `GET` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 08 16:59:45.951910 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436ecd1-b513-40c1-85d3-a8fc686c5cc6 service placement] SCRIPT_NAME: `/identity` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 08 16:59:45.952814 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436ecd1-b513-40c1-85d3-a8fc686c5cc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79340) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 08 16:59:45.954495 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.fernet_utils [None req-8436ecd1-b513-40c1-85d3-a8fc686c5cc6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79340) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 08 16:59:45.965505 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436ecd1-b513-40c1-85d3-a8fc686c5cc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 08 16:59:45.967060 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436ecd1-b513-40c1-85d3-a8fc686c5cc6 service placement] RBAC: Authorization granted {{(pid=79340) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 08 16:59:45.977282 dv-cinder-827860-2-iscsi devstack@keystone.service[79340]: [pid: 79340|app: 0|req: 1456/2907] 10.222.0.35 () {60 vars in 1365 bytes} [Tue Feb 8 16:59:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)